00000100:00100000:1.0:1787857555.180474:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+40:14739:x1874704171428736:12345-192.168.204.36@tcp:36:chown.0 00010000:00010000:1.0:1787857555.180578:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857555.180619:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a79aa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d42 expref: 40 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.180644:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9998d8bfd400) 00010000:00010000:1.0:1787857555.180651:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857555.180692:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a79aca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.180710:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a79aca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.180723:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a79aca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857555.181488:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 88 off8664 00000004:00080000:1.0:1787857555.181504:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379231686126ns, next at 380231682799ns, rc = 0 00000004:00010000:1.0:1787857555.181606:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037fa9df9 reply state 00000000d861e70e transno 4294967597 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a79aca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857555.181618:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857555.181772:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+41:14739:x1874704171428736:12345-192.168.204.36@tcp:36:chown.0 Request processed in 1298us (6054us total) trans 4294967597 rc 0/0 00000100:00100000:1.0:1787857555.181782:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 404 00000100:00100000:1.0:1787857555.248423:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171429504 00000100:00100000:1.0:1787857555.248437:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171429504 00000100:00100000:1.0:1787857555.248516:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 91 00000100:00100000:1.0:1787857555.248716:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+42:14742:x1874704171429504:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1787857555.249715:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+43:14742:x1874704171429504:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 1179us (1663us total) trans 4294967599 rc 0/0 00000100:00100000:1.0:1787857555.249748:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 91 00010000:00010000:1.0:1787857555.321675:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79afb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.321691:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79afb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.321700:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79afb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.321707:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c1e44000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857555.321713:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79afb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.321721:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79afb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.321752:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9998d8bfd400) 00010000:00010000:1.0:1787857555.321756:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857555.321761:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79afb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.321767:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79afb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857555.322095:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171429888 00000100:00100000:1.0:1787857555.322107:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171429888 00000100:00100000:1.0:1787857555.322200:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:1.0:1787857555.322211:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+8:14747:x1874704171429888:12345-192.168.204.36@tcp:101:truncate.0 00010000:00010000:1.0:1787857555.322239:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857555.322285:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7f3a8d5/0xd3f183cab4a79b02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2d57 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.322323:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a79a7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d34 expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.322333:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857555.322338:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857555.322344:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f3a8d5/0xd3f183cab4a79b02 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d57 expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.322385:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a79a7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d34 expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.322402:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a79a7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d34 expref: 9 pid: 6713 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857555.322419:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188146304:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857555.333626:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2f50d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787857555.333660:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a79a7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d34 expref: 10 pid: 6713 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857555.333680:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188146304:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857555.333707:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7f3a8d5/0xd3f183cab4a79b02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d57 expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.333745:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706a00, rc 0) 00000100:00100000:1.0:1787857555.333783:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+9:14747:x1874704171429888:12345-192.168.204.36@tcp:101:truncate.0 Request processed in 11573us (11741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857555.333793:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:1.0:1787857555.340707:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171430144 00000100:00100000:1.0:1787857555.340720:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171430144 00002000:00010000:1.0:1787857555.340922:0:6719:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/9 (1->18446744073709551615) 00002000:00100000:1.0:1787857555.340929:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dacc0b40 with x1874704171430144 ext(1->18446744073709551615) 00002000:00010000:1.0:1787857555.341192:0:6719:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998dacc0b40. 00000100:00100000:1.0:1787857555.341281:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:1.0:1787857555.341294:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+9:2350:x1874704171430144:12345-192.168.204.36@tcp:10:truncate.0 00002000:00010000:1.0:1787857555.341697:0:6719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb size from disk: 0 -> 1 00002000:00010000:1.0:1787857555.341702:0:6719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1787857554 00002000:00010000:1.0:1787857555.341705:0:6719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787857555.341708:0:6719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb ctime from disk: 1787857554 -> 1787857554 00002000:00010000:1.0:1787857555.341711:0:6719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787857555.342698:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171430144:12345-192.168.204.36@tcp:10:truncate.0 Request processed in 1400us (2345us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787857555.342712:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 42 00002000:00010000:1.0:1787857555.342718:0:6719:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/9 (1->18446744073709551615) 00002000:00100000:1.0:1787857555.342721:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dacc0b40 with x1874704171430144 ext(1->18446744073709551615) 00002000:00010000:1.0:1787857555.342741:0:6719:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998dacc0b40. 00000100:00100000:1.0:1787857555.369552:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171430400 00000100:00100000:1.0:1787857555.369567:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171430400 00000100:00100000:1.0:1787857555.369680:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:1.0:1787857555.369693:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+45:14750:x1874704171430400:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857555.369727:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857555.370080:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a79b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2d5e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.370286:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a79b10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.370306:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a79b10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.370322:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a79b10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.370341:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a79b17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x16:0x0].0x950f374f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.370349:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a79b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x950f374f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.370357:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a79b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x950f374f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857555.377152:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171430528 00000100:00100000:1.0:1787857555.377167:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171430528 00000100:00100000:1.0:1787857555.377253:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:1.0:1787857555.377267:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+47:14750:x1874704171430528:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1787857555.378037:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378091:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378105:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378155:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378163:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378171:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378177:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857555.378182:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378191:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378205:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9998d8bfd400) 00010000:00010000:1.0:1787857555.378208:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857555.378214:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.378222:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857555.378341:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+47:14750:x1874704171430528:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 1073us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857555.378362:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:1.0:1787857555.481985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857555.482042:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857555.490895:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.491903:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.492196:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.492206:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.492214:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.492220:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857555.492225:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.492235:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.492259:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9998d8bfd400) 00010000:00010000:1.0:1787857555.492262:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787857555.492269:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.492275:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a79b48 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857555.492435:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+48:14755:x1874704171431424:12345-192.168.204.36@tcp:55:lfs.0 Request processed in 20397us (20662us total) trans 4294967606 rc 0/0 00000100:00100000:1.0:1787857555.492447:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 411 00000100:00100000:1.0:1787857555.500021:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857555.542410:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171432320 00000100:00100000:1.0:1787857555.542424:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171432320 00000100:00100000:1.0:1787857555.542508:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:1.0:1787857555.542529:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+51:14758:x1874704171432320:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1787857555.542622:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542645:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542659:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542694:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542701:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542710:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542718:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857555.542722:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542755:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542770:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9998d8bfd400) 00010000:00010000:1.0:1787857555.542774:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857555.542779:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857555.542785:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857555.543363:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+51:14758:x1874704171432320:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 841us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857555.543374:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:1.0:1787857555.546622:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857556.565574:0:6714:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787857556.565587:0:6714:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787857558.385229:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857558.385255:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188146944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857558.385344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787857558.385626:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787857558.385787:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857558.385943:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188146944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 285us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857558.385955:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000001:00080000:1.0:1787857560.029622:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967609 is committed 00000004:00080000:1.0:1787857560.029693:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1787857560.032267:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998dacc0f00/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787857560.032288:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188147840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787857560.436712:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188147968 00000100:00100000:1.0:1787857560.436721:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188147968 00000100:00100000:1.0:1787857560.436793:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787857560.436804:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188147968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857560.436861:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787857560.445159:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188147968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8346us (8568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857560.445177:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787857561.685184:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171433600 00000100:00100000:1.0:1787857561.685190:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171433600 00000100:00100000:1.0:1787857561.685232:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:1.0:1787857561.685240:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171433600:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857561.685278:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171433600:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857561.685285:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00080000:1.0:1787857561.686478:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857561.686482:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857561.687115:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857561.687715:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857561.687719:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857562.003139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.024269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.024306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171434880 00000100:00100000:1.0:1787857562.024315:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171434880 00010000:00010000:1.0:1787857562.024356:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091600/0xd3f183cab4a7996c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2cee expref: 16 pid: 5857 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857562.024392:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 147 00000100:00100000:1.0:1787857562.024410:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2350:x1874704171434880:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857562.024426:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857562.024433:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091600/0xd3f183cab4a7996c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2cee expref: 16 pid: 5857 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.024448:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091600/0xd3f183cab4a7996c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2cee expref: 16 pid: 5857 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.024474:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316400) 00010000:00010000:1.0:1787857562.024480:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79b8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.024490:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79b8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.024499:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79b8e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.024517:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857562.024567:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2350:x1874704171434880:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 159us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857562.024575:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 147 00010000:00010000:1.0:1787857562.033154:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0031600/0xd3f183cab4a79b95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79bbb45c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.033174:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0031600/0xd3f183cab4a79b95 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x79bbb45c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.033182:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0031600/0xd3f183cab4a79b95 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x79bbb45c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.033200:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0031600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857562.033205:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0031600/0xd3f183cab4a79b95 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x79bbb45c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.033213:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0031600/0xd3f183cab4a79b95 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x79bbb45c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.033254:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79bbb45c (ffff9998d8bfd600) 00010000:00010000:1.0:1787857562.033258:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857562.033263:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0031600/0xd3f183cab4a79b95 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x79bbb45c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.033270:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0031600/0xd3f183cab4a79b95 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x79bbb45c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857562.051402:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.051442:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171435008 00000100:00100000:1.0:1787857562.051452:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171435008 00000100:00100000:1.0:1787857562.051506:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 416 00000100:00100000:1.0:1787857562.051516:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+31:15327:x1874704171435008:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857562.051540:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857562.051565:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a79b9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2d7a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.051632:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a79ba3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.051664:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a79ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.051705:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a79ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857562.051773:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787857562.051777:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857562.051842:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a79ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.051868:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a79b9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d7a expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.051886:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a79ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d7a expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.051896:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53aea00) 00010000:00010000:1.0:1787857562.051899:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857562.051903:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706600, rc 0) 00000100:00100000:1.0:1787857562.051961:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+32:15327:x1874704171435008:12345-192.168.204.36@tcp:101:cp.0 Request processed in 447us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857562.051969:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 416 00000100:00100000:1.0:1787857562.065083:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.084705:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857562.129523:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44400/0xd3f183cab4a79c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.129540:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44400/0xd3f183cab4a79c21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.129549:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44400/0xd3f183cab4a79c21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.129565:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c1e44400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857562.129570:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44400/0xd3f183cab4a79c21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.129578:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44400/0xd3f183cab4a79c21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.129599:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x18:0x0].0x0 (ffff9998d8797000) 00010000:00010000:1.0:1787857562.129603:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857562.129609:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44400/0xd3f183cab4a79c21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.129615:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44400/0xd3f183cab4a79c21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857562.142124:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171436544 00000100:00100000:1.0:1787857562.142134:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171436544 00000100:00100000:1.0:1787857562.142188:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:1.0:1787857562.142199:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+7:2349:x1874704171436544:12345-192.168.204.36@tcp:2:cp.0 00002000:00010000:1.0:1787857562.142523:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787857562.142527:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1645827007 00002000:00010000:1.0:1787857562.142529:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb atime from disk: 0 -> 1787857189 00002000:00010000:1.0:1787857562.142531:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1787857561 00002000:00010000:1.0:1787857562.142533:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787857562.142594:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+8:2349:x1874704171436544:12345-192.168.204.36@tcp:2:cp.0 Request processed in 397us (561us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787857562.142601:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:1.0:1787857562.147150:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.159932:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857562.164529:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45400/0xd3f183cab4a79c36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.164542:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45400/0xd3f183cab4a79c36 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.164550:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45400/0xd3f183cab4a79c36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.164557:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c1e45400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857562.164562:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45400/0xd3f183cab4a79c36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.164571:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45400/0xd3f183cab4a79c36 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.164590:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x18:0x0].0x0 (ffff9998d8797300) 00010000:00010000:1.0:1787857562.164593:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857562.164598:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45400/0xd3f183cab4a79c36 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.164605:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45400/0xd3f183cab4a79c36 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857562.191293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.223913:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.296258:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.301973:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.307719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.375641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.400009:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.476786:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.519223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.636465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.641399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.646729:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171441280 00000100:00100000:1.0:1787857562.646736:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171441280 00000100:00100000:1.0:1787857562.646792:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 100 00000100:00100000:1.0:1787857562.646802:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+53:9460:x1874704171441280:12345-192.168.204.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787857562.647368:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+54:9460:x1874704171441280:12345-192.168.204.36@tcp:35:ldlm_bl.0 Request processed in 566us (901us total) trans 4294967626 rc 0/0 00000100:00100000:1.0:1787857562.647377:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 100 00000100:00100000:1.0:1787857562.650678:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.764779:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.772916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857562.791274:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x9126f063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.791292:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79d40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x9126f063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.791301:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79d40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x9126f063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.791308:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c1e45600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857562.791312:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79d40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x9126f063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.791320:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79d40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x9126f063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.791360:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x9126f063 (ffff9998d8797500) 00010000:00010000:1.0:1787857562.791363:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857562.791367:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79d40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x9126f063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.791373:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79d40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x9126f063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857562.792646:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.797859:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171442304 00000100:00100000:1.0:1787857562.797869:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171442304 00010000:00010000:1.0:1787857562.797911:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a79d55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2df1 expref: 9 pid: 6711 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857562.797955:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 153 00000100:00100000:1.0:1787857562.797966:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2350:x1874704171442304:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857562.797996:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857562.798022:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a79d55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2df1 expref: 9 pid: 6711 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.798037:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a79d55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2df1 expref: 9 pid: 6711 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.798065:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857562.798070:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857562.798079:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071723477/0xd3f183cab4a79d5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2df8 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.798104:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071723477/0xd3f183cab4a79d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2df8 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.798155:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000071723477/0xd3f183cab4a79d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2df8 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857562.798173:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188149120:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857562.798257:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857562.805306:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188149120:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857562.805339:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857562.805422:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+7:2350:x1874704171442304:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 7457us (7744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857562.805435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 153 00000100:00100000:1.0:1787857562.809382:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857562.814119:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a79d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.814138:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a79d63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.814157:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a79d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.814164:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857562.814169:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a79d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.814201:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a79d63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.814219:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9998d8bfd300) 00010000:00010000:1.0:1787857562.814223:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857562.814229:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a79d63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.814235:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a79d63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857562.816639:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.828502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.834504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.842571:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.867654:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.885466:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.891714:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.910440:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.922639:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171444992 00000100:00100000:1.0:1787857562.922651:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171444992 00000100:00100000:1.0:1787857562.922723:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:1.0:1787857562.922735:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+62:15365:x1874704171444992:12345-192.168.204.36@tcp:35:dd.0 00000001:00080000:1.0:1787857562.923083:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967635 00000100:00100000:1.0:1787857562.923216:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+64:15365:x1874704171444992:12345-192.168.204.36@tcp:35:dd.0 Request processed in 483us (892us total) trans 4294967636 rc 0/0 00000100:00100000:1.0:1787857562.923224:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 103 00000020:00080000:1.0:1787857562.923229:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787857562.947671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857562.948201:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 446 00000100:00100000:1.0:1787857562.948213:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+64:15368:x1874704171445248:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857562.948239:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857562.948261:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a79dcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2e14 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.948382:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79dd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.948399:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.948411:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857562.948422:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 1519 00010000:00010000:1.0:1787857562.948556:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a79dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e14 expref: 67 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.948575:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707e00/0xd3f183cab4a79dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e14 expref: 66 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857562.948584:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff9998d8bfdb00) 00010000:00010000:1.0:1787857562.948587:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787857562.948602:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707e00, rc 0) 00000100:00100000:1.0:1787857562.948669:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+66:15368:x1874704171445248:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 458us (1007us total) trans 4294967637 rc 0/0 00000100:00100000:1.0:1787857562.948677:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 446 00000100:00080000:1.0:1787857563.025673:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857563.032287:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00080000:1.0:1787857563.055740:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857563.061660:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.067565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.086285:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.094509:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.113738:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171447296 00000100:00100000:1.0:1787857563.113749:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171447296 00000100:00100000:1.0:1787857563.113852:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 454 00000100:00100000:1.0:1787857563.113863:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+69:15373:x1874704171447296:12345-192.168.204.36@tcp:36:cp.0 00010000:00010000:1.0:1787857563.113943:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a79e58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.113960:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a79e58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.113981:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a79e58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857563.114199:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043949c69 reply state 00000000a97239aa transno 4294967640 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a79e58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.114209:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857563.114276:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+71:15373:x1874704171447296:12345-192.168.204.36@tcp:36:cp.0 Request processed in 415us (723us total) trans 4294967640 rc 0/0 00000100:00100000:1.0:1787857563.114284:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 454 00000100:00100000:1.0:1787857563.120253:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171447552 00000100:00100000:1.0:1787857563.120266:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171447552 00000100:00100000:1.0:1787857563.120332:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 104 00000100:00100000:1.0:1787857563.120359:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+70:15373:x1874704171447552:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:1.0:1787857563.121158:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+71:15373:x1874704171447552:12345-192.168.204.36@tcp:35:cp.0 Request processed in 799us (1614us total) trans 4294967641 rc 0/0 00000100:00100000:1.0:1787857563.121168:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 104 00000100:00100000:1.0:1787857563.146407:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.151432:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171448064 00000100:00100000:1.0:1787857563.151443:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171448064 00000100:00100000:1.0:1787857563.151504:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 456 00000100:00100000:1.0:1787857563.151513:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+73:15374:x1874704171448064:12345-192.168.204.36@tcp:55:lfs.0 00010000:00010000:1.0:1787857563.151599:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a79e82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.151619:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79e74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e45 expref: 73 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.151628:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a79e82 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.151664:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e45 expref: 73 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.151690:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44000/0xd3f183cab4a79e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e45 expref: 73 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.151704:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188149632:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857563.151794:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857563.156704:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.161415:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.182658:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171448960 00000100:00100000:1.0:1787857563.182668:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171448960 00000100:00100000:1.0:1787857563.182741:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 106 00000100:00100000:1.0:1787857563.182753:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+76:15375:x1874704171448960:12345-192.168.204.36@tcp:35:dd.0 00000100:00100000:1.0:1787857563.183121:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+77:15375:x1874704171448960:12345-192.168.204.36@tcp:35:dd.0 Request processed in 369us (565us total) trans 4294967646 rc 0/0 00000100:00100000:1.0:1787857563.183128:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 106 00000100:00100000:1.0:1787857563.205347:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000040:00080000:1.0:1787857563.246211:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857563.246224:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857563.246588:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 10 count 1 00000040:00080000:1.0:1787857563.246598:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857563.271928:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.325862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171450240 00000100:00100000:1.0:1787857563.325871:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171450240 00010000:00010000:1.0:1787857563.325904:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048309038/0xd3f183cab4a79f15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e6f expref: 10 pid: 6713 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.325942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 157 00000100:00100000:1.0:1787857563.325951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171450240:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857563.325976:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857563.326006:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048309038/0xd3f183cab4a79f15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e6f expref: 10 pid: 6713 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.326020:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048309038/0xd3f183cab4a79f15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e6f expref: 10 pid: 6713 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.326059:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048309038/0xd3f183cab4a79f15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e6f expref: 10 pid: 6713 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.326075:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857563.326079:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857563.326087:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b5103aa/0xd3f183cab4a79f1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e76 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.326098:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b5103aa/0xd3f183cab4a79f1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e76 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.326131:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000b5103aa/0xd3f183cab4a79f1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e76 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.326145:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188149888:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857563.326216:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857563.329173:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188149888:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857563.329199:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857563.329257:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2350:x1874704171450240:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3307us (4199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857563.329269:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 157 00000100:00100000:1.0:1787857563.345855:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171450752 00000100:00100000:1.0:1787857563.345866:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171450752 00000100:00100000:1.0:1787857563.345925:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 116 00000100:00100000:1.0:1787857563.345951:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+9:2350:x1874704171450752:12345-192.168.204.36@tcp:2:cp.0 00002000:00010000:1.0:1787857563.346214:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787857563.346218:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1645827007 00002000:00010000:1.0:1787857563.346220:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb atime from disk: 0 -> 1787857189 00002000:00010000:1.0:1787857563.346223:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1787857562 00002000:00010000:1.0:1787857563.346225:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787857563.346331:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171450752:12345-192.168.204.36@tcp:2:cp.0 Request processed in 382us (766us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787857563.346350:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 116 00010000:00010000:1.0:1787857563.372979:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.372998:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.373006:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.373013:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d0400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857563.373017:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.373026:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.373043:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9998d8bfd300) 00010000:00010000:1.0:1787857563.373046:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857563.373051:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.373075:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.373774:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171451520 00000100:00100000:1.0:1787857563.373783:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171451520 00000100:00100000:1.0:1787857563.373940:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:1.0:1787857563.373951:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c5af1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+83:15383:x1874704171451520:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:1.0:1787857563.374290:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c5af1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+84:15383:x1874704171451520:12345-192.168.204.36@tcp:35:cp.0 Request processed in 340us (586us total) trans 4294967651 rc 0/0 00000100:00100000:1.0:1787857563.374297:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:1.0:1787857563.414546:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171452160 00000100:00100000:1.0:1787857563.414554:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171452160 00010000:00010000:1.0:1787857563.414594:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1a00/0xd3f183cab4a79f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e84 expref: 87 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.414633:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:1.0:1787857563.414644:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+87:2349:x1874704171452160:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857563.414661:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857563.414680:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1a00/0xd3f183cab4a79f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e84 expref: 87 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.414692:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1a00/0xd3f183cab4a79f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e84 expref: 87 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.414721:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1a00/0xd3f183cab4a79f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e84 expref: 87 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.414750:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9998d8bfd300) 00010000:00010000:1.0:1787857563.414755:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.414764:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.414772:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.414800:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857563.414900:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+86:2349:x1874704171452160:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 257us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857563.414908:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:1.0:1787857563.420251:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171452416 00000100:00100000:1.0:1787857563.420261:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171452416 00000100:00100000:1.0:1787857563.420320:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:1.0:1787857563.420330:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+86:15384:x1874704171452416:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1787857563.420773:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+87:15384:x1874704171452416:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 443us (609us total) trans 4294967654 rc 0/0 00000100:00100000:1.0:1787857563.420781:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:1.0:1787857563.480704:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171452928 00000100:00100000:1.0:1787857563.480717:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171452928 00010000:00010000:1.0:1787857563.480768:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a79f7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e8b expref: 90 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.480888:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:1.0:1787857563.480917:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+90:2350:x1874704171452928:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857563.480937:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857563.480944:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a79f7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e8b expref: 90 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.480958:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a79f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e8b expref: 90 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.480996:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a79f7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e8b expref: 90 pid: 7656 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.481015:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9998d8bfd300) 00010000:00010000:1.0:1787857563.481020:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79f8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.481030:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79f8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.481040:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79f8c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.481074:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857563.481125:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:2350:x1874704171452928:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 210us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857563.481133:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 159 00010000:00010000:1.0:1787857563.493862:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.493881:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.493906:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.493912:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d0400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857563.493917:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.493925:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.493942:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9998d8bfd300) 00010000:00010000:1.0:1787857563.493946:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857563.493951:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.493957:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a79f9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.503546:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188150400 00000100:00100000:1.0:1787857563.503554:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188150400 00000100:00100000:1.0:1787857563.503625:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787857563.503635:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188150400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857563.503680:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857563.503747:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188150400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857563.503754:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787857563.505847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171453568 00000100:00100000:1.0:1787857563.505855:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171453568 00010000:00010000:1.0:1787857563.505893:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79f8c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e92 expref: 94 pid: 5856 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.505950:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 160 00000100:00100000:1.0:1787857563.505960:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+94:2349:x1874704171453568:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857563.505977:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857563.505985:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79f8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e92 expref: 94 pid: 5856 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.505999:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79f8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e92 expref: 94 pid: 5856 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.506025:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45600/0xd3f183cab4a79f8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2e92 expref: 94 pid: 5856 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.507922:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9998d8bfd300) 00010000:00010000:1.0:1787857563.507937:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0600/0xd3f183cab4a79fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.507952:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0600/0xd3f183cab4a79fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.507961:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0600/0xd3f183cab4a79fa8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.508001:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857563.508072:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+93:2349:x1874704171453568:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2108us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857563.508084:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 160 00000100:00100000:1.0:1787857563.550805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.561804:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171454592 00000100:00100000:1.0:1787857563.561834:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171454592 00000100:00100000:1.0:1787857563.561931:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:1.0:1787857563.561944:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+96:2349:x1874704171454592:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857563.561976:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857563.562008:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a79fc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ea0 expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.562031:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff9998d8bfd300) 00010000:00010000:1.0:1787857563.562036:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857563.562102:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+95:2349:x1874704171454592:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 161us (5061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857563.562109:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:1.0:1787857563.637473:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.653468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.659737:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171455488 00000100:00100000:1.0:1787857563.659746:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171455488 00010000:00010000:1.0:1787857563.659786:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6973764/0xd3f183cab4a7a026 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ebc expref: 13 pid: 14028 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.659857:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:1.0:1787857563.659867:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171455488:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857563.659884:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857563.659908:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6973764/0xd3f183cab4a7a026 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ebc expref: 13 pid: 14028 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.659940:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6973764/0xd3f183cab4a7a026 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ebc expref: 13 pid: 14028 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.659975:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857563.659980:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857563.659988:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081f74b81/0xd3f183cab4a7a02d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ec3 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.659998:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081f74b81/0xd3f183cab4a7a02d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ec3 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.660031:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000081f74b81/0xd3f183cab4a7a02d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ec3 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.660045:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188150656:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857563.660126:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857563.665101:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188150656:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857563.665130:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857563.665198:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171455488:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5331us (5559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857563.665210:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:1.0:1787857563.668040:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171455744 00000100:00100000:1.0:1787857563.668051:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171455744 00000100:00100000:1.0:1787857563.668296:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 478 00000100:00100000:1.0:1787857563.668373:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:15393:x1874704171455744:12345-192.168.204.36@tcp:36:cp.0 00010000:00010000:1.0:1787857563.668432:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857563.668462:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2eb5 expref: 97 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.668480:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9998d5316700) 00010000:00010000:1.0:1787857563.668490:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857563.668534:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.668561:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.668571:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857563.668737:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eb4aa72 reply state 0000000003d230c9 transno 4294967663 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.668746:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857563.668888:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+98:15393:x1874704171455744:12345-192.168.204.36@tcp:36:cp.0 Request processed in 518us (962us total) trans 4294967663 rc 0/0 00000100:00100000:1.0:1787857563.668894:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 478 00010000:00010000:1.0:1787857563.675855:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.675873:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.675881:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.675903:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857563.675908:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.675916:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.675934:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9998c53aec00) 00010000:00010000:1.0:1787857563.675937:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857563.675942:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.675949:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a034 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857563.692508:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.698421:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.756283:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171457024 00000100:00100000:1.0:1787857563.756294:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171457024 00000100:00100000:1.0:1787857563.756371:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:1.0:1787857563.756383:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:15394:x1874704171457024:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857563.756408:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857563.756429:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2ed1 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756510:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756524:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756552:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756568:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756575:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756582:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756741:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756750:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756757:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857563.756768:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 1516 00010000:00010000:1.0:1787857563.756921:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756931:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756937:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756943:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857563.756954:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756963:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756977:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9998d8797800) 00010000:00010000:1.0:1787857563.756980:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857563.756985:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.756992:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757007:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757013:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757020:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757025:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857563.757028:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757033:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757041:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x193a76c9 (ffff9998c53aeb00) 00010000:00010000:1.0:1787857563.757044:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857563.757054:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757060:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a05e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757103:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ed1 expref: 103 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757116:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ed1 expref: 102 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857563.757123:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9998c53aec00) 00010000:00010000:1.0:1787857563.757125:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857563.757128:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00100000:1.0:1787857563.757212:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+102:15394:x1874704171457024:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 831us (1138us total) trans 4294967666 rc 0/0 00000100:00100000:1.0:1787857563.757220:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:1.0:1787857563.769235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.778071:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857563.792554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000001:00080000:1.0:1787857564.583377:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000100:00100000:1.0:1787857565.038671:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188151552 00000100:00100000:1.0:1787857565.038679:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188151552 00000100:00100000:1.0:1787857565.038742:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787857565.038752:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188151552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857565.038807:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188151552:12345-0@lo:400:kworker.0 Request processed in 57us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857565.038839:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1787857565.038885:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787857565.136473:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967671 is committed 00010000:00010000:1.0:1787857565.424420:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857566.806781:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857566.806857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857566.806912:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857566.806944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857566.806996:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857566.807021:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857566.807779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857566.812467:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857568.624268:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188151808 00000100:00100000:1.0:1787857568.624278:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188151808 00000100:00100000:1.0:1787857568.624351:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787857568.624362:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188151808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857568.624398:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857568.624451:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188151808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857568.624458:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787857568.624512:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188151808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857570.017907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857570.035157:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171461120 00000100:00100000:1.0:1787857570.035170:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171461120 00002000:00100000:1.0:1787857570.035230:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff9998ffa84000 x1874704171461120/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:216/0 lens 488/0 e 0 to 0 dl 1787857581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857570.035256:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa84000 with x1874704171461120 ext(0->1048575) 00002000:00010000:1.0:1787857570.035261:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffa84000 00000100:00100000:1.0:1787857570.035310:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:1.0:1787857570.035320:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2349:x1874704171461120:12345-192.168.204.36@tcp:4:dd.0 00000100:00100000:1.0:1787857570.164303:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188152192 00000100:00100000:1.0:1787857570.164308:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188152192 00000100:00100000:1.0:1787857570.164340:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188152320 00000100:00100000:1.0:1787857570.164343:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188152320 00000100:00100000:1.0:1787857570.164366:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787857570.164373:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188152192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857570.164417:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188152192:12345-0@lo:400:kworker.0 Request processed in 44us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857570.164425:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787857570.164440:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787857570.164447:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188152320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857570.164491:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188152320:12345-0@lo:400:kworker.0 Request processed in 45us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857570.164497:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:1.0:1787857570.164519:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857570.167124:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188152576 00000100:00100000:1.0:1787857570.167131:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188152576 00000100:00100000:1.0:1787857570.167192:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787857570.167201:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188152576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857570.167281:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188152576:12345-0@lo:400:kworker.0 Request processed in 81us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857570.167289:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787857570.177475:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:15975:x1874704171461248:12345-192.168.204.36@tcp:44:dd.0 Request processed in 33690us (33865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857570.177489:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 494 00000100:00100000:1.0:1787857570.183399:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171461376 00000100:00100000:1.0:1787857570.183417:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171461376 00000100:00100000:1.0:1787857570.246094:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2350:x1874704171461376:12345-192.168.204.36@tcp:16:dd.0 Request processed in 60871us (65984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857570.246107:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 124 00000100:00100000:1.0:1787857570.255090:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171461632 00000100:00100000:1.0:1787857570.255101:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171461632 00000100:00100000:1.0:1787857570.255156:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 114 00000100:00100000:1.0:1787857570.255167:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:15975:x1874704171461632:12345-192.168.204.36@tcp:35:dd.0 00000100:00100000:1.0:1787857570.255982:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:15975:x1874704171461632:12345-192.168.204.36@tcp:35:dd.0 Request processed in 813us (1043us total) trans 4294967674 rc 0/0 00000100:00100000:1.0:1787857570.255993:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 114 00000100:00100000:1.0:1787857570.323403:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171462272 00000100:00100000:1.0:1787857570.323414:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171462272 00000100:00100000:1.0:1787857570.323513:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 498 00000100:00100000:1.0:1787857570.323525:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+48:15978:x1874704171462272:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857570.323557:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857570.323579:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a1a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2f33 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857570.323692:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a1ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857570.323708:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a1ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857570.323720:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a1ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857570.324098:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787857570.324103:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857570.324186:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a1ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857570.324215:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a1a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f33 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857570.324231:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706e00/0xd3f183cab4a7a1ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f33 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857570.324400:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9998d8797200) 00010000:00010000:1.0:1787857570.324403:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857570.324407:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706e00, rc 0) 00000100:00100000:1.0:1787857570.324515:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+49:15978:x1874704171462272:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 991us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857570.324522:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 498 00000100:00100000:1.0:1787857570.347692:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171462656 00000100:00100000:1.0:1787857570.347715:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171462656 00000100:00100000:1.0:1787857570.348050:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 499 00000100:00100000:1.0:1787857570.348060:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+49:15978:x1874704171462656:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1787857570.348247:0:7656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857570.348251:0:7656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857570.350360:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857570.350379:0:7656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857570.350491:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+49:15978:x1874704171462656:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 2427us (4069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857570.350521:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 499 00000040:00080000:1.0:1787857570.414095:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857570.414105:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857570.414636:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857570.414648:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857570.673344:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188153088 00000100:00100000:1.0:1787857570.673358:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188153088 00000100:00100000:1.0:1787857570.673436:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787857570.673445:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188153088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857570.673474:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3858759680 avail 3855613952 00000100:00100000:1.0:1787857570.679453:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188153088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5996us (8798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857570.679470:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787857571.921638:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171462784 00000100:00100000:1.0:1787857571.921654:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171462784 00000100:00100000:1.0:1787857571.921685:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 322 00000100:00100000:1.0:1787857571.921692:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171462784:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857571.921719:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171462784:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857571.921726:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 322 00000100:00100000:1.0:1787857571.921783:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171463168 00000100:00100000:1.0:1787857571.921786:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171463168 00000100:00100000:1.0:1787857571.921835:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171463424 00000100:00100000:1.0:1787857571.921838:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171463424 00000100:00100000:1.0:1787857571.921864:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00100000:1.0:1787857571.921871:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+8:2347:x1874704171463168:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857571.921928:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+8:2347:x1874704171463168:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 57us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857571.921935:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00100000:1.0:1787857571.921947:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:1.0:1787857571.921953:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2347:x1874704171463424:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857571.921978:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2347:x1874704171463424:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857571.921985:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00080000:1.0:1787857571.922023:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857571.922027:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857575.278328:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188153600:0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.278420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857575.278490:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857575.278498:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188153728:0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.278527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857575.278564:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188153600 00000100:00100000:1.0:1787857575.278572:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188153600 00000100:00100000:1.0:1787857575.278627:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787857575.278636:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188153600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.278690:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188153600:12345-0@lo:400:kworker.0 Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857575.278698:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787857575.278720:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188153728 00000100:00100000:1.0:1787857575.278724:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188153728 00000100:00100000:1.0:1787857575.278750:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787857575.278758:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188153728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.278799:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188153728:12345-0@lo:400:kworker.0 Request processed in 42us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857575.278805:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787857575.278843:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857575.278847:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857575.278875:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188153728:0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.278884:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188153600:0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.279468:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188153344 00000100:00100000:1.0:1787857575.279473:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188153344 00000100:00100000:1.0:1787857575.279509:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787857575.279518:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188153344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.279557:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188153344:12345-0@lo:400:kworker.0 Request processed in 40us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857575.279564:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787857575.279589:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188153856 00000100:00100000:1.0:1787857575.279592:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188153856 00000100:00100000:1.0:1787857575.279616:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188153472 00000100:00100000:1.0:1787857575.279619:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188153472 00000100:00100000:1.0:1787857575.279636:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787857575.279641:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188153856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.279673:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188153856:12345-0@lo:400:kworker.0 Request processed in 31us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857575.279679:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787857575.279690:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787857575.279695:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188153472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.279723:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188153472:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857575.279736:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1787857575.279757:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857575.279779:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188153472:0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.279788:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188153344:0@lo:400:kworker.0 00000100:00100000:1.0:1787857575.279796:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188153856:0@lo:400:kworker.0 00000001:00080000:1.0:1787857575.369411:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967674 is committed 00000100:00100000:1.0:1787857577.044192:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171463680 00000100:00100000:1.0:1787857577.044205:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171463680 00000100:00100000:1.0:1787857577.044293:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 221 00000100:00100000:1.0:1787857577.044307:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+49:2348:x1874704171463680:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857577.044426:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+49:2348:x1874704171463680:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 123us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857577.044434:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 221 00000100:00100000:1.0:1787857577.056690:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171463808 00000100:00100000:1.0:1787857577.056696:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171463808 00000100:00100000:1.0:1787857578.449714:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171464448 00000100:00100000:1.0:1787857578.449724:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171464448 00000100:00100000:1.0:1787857578.449792:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 500 00000100:00100000:1.0:1787857578.449802:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:16580:x1874704171464448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857578.449858:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857578.449879:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2f41 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.449963:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.449997:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.450010:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.450071:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.450256:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.450264:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451324:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451343:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451352:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857578.451367:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787857578.451592:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451602:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451609:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451621:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.451626:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451634:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451647:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:1.0:1787857578.451651:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.451655:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451662:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a1c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451940:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451947:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451952:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451957:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.451960:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451966:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451986:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9998c53aea00) 00010000:00010000:1.0:1787857578.451988:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.451992:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.451997:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.452658:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f41 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.454008:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f41 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.454021:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857578.454025:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.454029:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707600, rc 0) 00000100:00100000:1.0:1787857578.454175:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:16580:x1874704171464448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 4373us (4586us total) trans 4294967675 rc 0/0 00000100:00100000:1.0:1787857578.454184:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 500 00000100:00100000:1.0:1787857578.467035:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171464704 00000100:00100000:1.0:1787857578.467044:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171464704 00000100:00100000:1.0:1787857578.467120:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:1.0:1787857578.467131:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2347:x1874704171464704:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857578.467147:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857578.467175:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f41 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.467213:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857578.467218:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857578.467275:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2347:x1874704171464704:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 146us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857578.467282:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:1.0:1787857578.481798:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171464832 00000100:00100000:1.0:1787857578.481850:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171464832 00000100:00100000:1.0:1787857578.481921:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 502 00000100:00100000:1.0:1787857578.481931:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+49:16581:x1874704171464832:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857578.481954:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857578.481976:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2f48 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482042:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482058:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482071:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482120:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482128:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482155:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482475:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482484:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482491:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482498:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.482503:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482511:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482524:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316700) 00010000:00010000:1.0:1787857578.482528:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.482533:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482539:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a1e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482552:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482558:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482571:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482576:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.482579:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482585:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482593:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1d08857 (ffff9998c53aea00) 00010000:00010000:1.0:1787857578.482595:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.482598:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482604:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a1ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482638:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f48 expref: 50 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482647:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316700) 00010000:00010000:1.0:1787857578.482650:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.482654:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f48 expref: 50 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.482663:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707600, rc 0) 00000100:00100000:1.0:1787857578.482741:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+49:16581:x1874704171464832:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 812us (1062us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857578.482757:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 502 00010000:00010000:1.0:1787857578.497688:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091e00/0xd3f183cab4a7a0dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2eed expref: 18 pid: 7656 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857578.497715:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188154240:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857578.497745:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.497755:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.497760:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.497793:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.497806:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.497913:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857578.502262:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 512 00010000:00010000:1.0:1787857578.502301:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.502314:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.502343:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.502351:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d1000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.502356:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.502363:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.502391:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316700) 00010000:00010000:1.0:1787857578.502395:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.502400:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.502407:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7a1f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857578.502431:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065bb03ef reply state 0000000081fbc54c transno 4294967676 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a1fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857578.502440:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857578.502558:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+50:16581:x1874704171465088:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 14185us (14383us total) trans 4294967676 rc 0/0 00000100:00100000:1.0:1787857578.502568:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 503 00000100:00100000:1.0:1787857578.513426:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171465344 00000100:00100000:1.0:1787857578.513437:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171465344 00000100:00100000:1.0:1787857578.513508:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 504 00000100:00100000:1.0:1787857578.513518:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+49:16582:x1874704171465344:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857578.513561:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857578.513585:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a202 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2f4f expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.513651:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a209 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.513665:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.513676:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857578.513735:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787857578.513738:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857578.513783:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.513804:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a202 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f4f expref: 51 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.513861:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f4f expref: 50 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.513871:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:1.0:1787857578.513874:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857578.513878:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707800, rc 0) 00000100:00100000:1.0:1787857578.513938:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+50:16582:x1874704171465344:12345-192.168.204.36@tcp:101:bash.0 Request processed in 422us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857578.513946:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 504 00000100:00100000:1.0:1787857578.520501:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171465472 00000100:00100000:1.0:1787857578.520510:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171465472 00000100:00100000:1.0:1787857578.520601:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 505 00000100:00100000:1.0:1787857578.520612:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+50:16582:x1874704171465472:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857578.520634:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857578.520655:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a210 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2f56 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.520750:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.520763:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.520774:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.520788:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.520794:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.520801:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521010:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706400/0xd3f183cab4a7a225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521019:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706400/0xd3f183cab4a7a225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521036:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706400/0xd3f183cab4a7a225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857578.521071:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 512 00000004:00200000:1.0:1787857578.521085:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857578.521108:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706400/0xd3f183cab4a7a225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521120:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521126:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521133:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521140:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.521144:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521150:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521161:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:1.0:1787857578.521164:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.521168:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521173:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521194:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521199:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521203:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521207:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.521209:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521215:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521222:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1d08857 (ffff9998c53aed00) 00010000:00010000:1.0:1787857578.521224:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.521226:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521232:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a21e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521259:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a210 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f56 expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521270:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706400/0xd3f183cab4a7a225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f56 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.521287:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9998c53ae100) 00010000:00010000:1.0:1787857578.521290:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857578.521292:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706400, rc 0) 00000100:00100000:1.0:1787857578.521364:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+51:16582:x1874704171465472:12345-192.168.204.36@tcp:101:bash.0 Request processed in 754us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857578.521372:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 505 00000100:00100000:1.0:1787857578.557109:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171465984 00000100:00100000:1.0:1787857578.557119:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171465984 00000100:00100000:1.0:1787857578.557193:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 509 00000100:00100000:1.0:1787857578.557203:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:16583:x1874704171465984:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857578.557223:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857578.557246:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a26b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2f72 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557313:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557329:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557342:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557369:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557393:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557418:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557489:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557497:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557503:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557510:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.557514:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557522:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557535:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9998c53ae100) 00010000:00010000:1.0:1787857578.557538:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.557543:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557550:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557564:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557571:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557582:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557588:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.557591:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557597:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557606:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x70ee8377 (ffff9998c53aed00) 00010000:00010000:1.0:1787857578.557608:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.557611:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557616:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557649:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a26b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f72 expref: 21 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557659:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9998c53ae100) 00010000:00010000:1.0:1787857578.557662:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.557665:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a26b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f72 expref: 21 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.557675:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707200, rc 0) 00000100:00100000:1.0:1787857578.557738:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:16583:x1874704171465984:12345-192.168.204.36@tcp:101:rm.0 Request processed in 536us (797us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857578.559516:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 509 00000100:00100000:1.0:1787857578.564096:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171466112 00000100:00100000:1.0:1787857578.564105:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171466112 00000100:00100000:1.0:1787857578.564172:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 510 00000100:00100000:1.0:1787857578.564183:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:16583:x1874704171466112:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857578.564203:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857578.564223:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2f79 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564302:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564318:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564330:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564636:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564644:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564651:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564786:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564810:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564920:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564927:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.564931:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564938:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564950:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9998c53ae100) 00010000:00010000:1.0:1787857578.564953:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.564958:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564964:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a287 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564980:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564986:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564993:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.564998:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.565008:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.565015:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.565023:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x70ee8377 (ffff9998c53ae800) 00010000:00010000:1.0:1787857578.565026:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.565028:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.565035:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a28e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.565070:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a280 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f79 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.565079:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9998c53ae100) 00010000:00010000:1.0:1787857578.565081:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.565084:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f79 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.565092:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00100000:1.0:1787857578.565164:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:16583:x1874704171466112:12345-192.168.204.36@tcp:101:rm.0 Request processed in 984us (1240us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857578.565172:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 510 00000100:00100000:1.0:1787857578.604857:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171466624 00000100:00100000:1.0:1787857578.604869:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171466624 00000100:00100000:1.0:1787857578.604943:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 513 00000100:00100000:1.0:1787857578.604954:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:16584:x1874704171466624:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857578.604991:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857578.605015:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a2bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2f8e expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.605170:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.605185:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.605198:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.605213:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.605219:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.605225:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857578.609192:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb:0x0], index 0: 0 00010000:00010000:1.0:1787857578.611541:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a2d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611565:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611577:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611636:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611642:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611649:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611654:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.611659:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611665:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611738:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9998c53ae100) 00010000:00010000:1.0:1787857578.611742:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.611747:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611836:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a2c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857578.611853:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9187c1a reply state 00000000881d82fb transno 4294967677 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857578.611861:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857578.611902:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a2bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f8e expref: 23 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611929:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f8e expref: 22 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.611936:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9998c53aed00) 00010000:00010000:1.0:1787857578.611939:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857578.611941:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707200, rc 0) 00000100:00100000:1.0:1787857578.612027:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:16584:x1874704171466624:12345-192.168.204.36@tcp:101:cp.0 Request processed in 7074us (7287us total) trans 4294967677 rc 0/0 00000100:00100000:1.0:1787857578.612036:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 513 00010000:00010000:1.0:1787857578.626951:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.626969:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.626978:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.626984:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857578.626989:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.626997:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.627014:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x70ee8377 (ffff9998c53ae800) 00010000:00010000:1.0:1787857578.627017:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857578.627022:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.627043:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a2cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857578.640474:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857578.650221:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857578.723190:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857578.731585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00002000:00010000:1.0:1787857578.743363:0:8490:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787857578.743384:0:8490:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime: 0 -> 1787857578 00002000:00010000:1.0:1787857578.743387:0:8490:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb atime: 0 -> 1787857578 00002000:00010000:1.0:1787857578.743389:0:8490:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime: 0 -> 1787857578 00000100:00100000:1.0:1787857578.743413:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188154624:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857578.743455:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b693846f/0xd3f183cab4a7a313 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2faa expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.743481:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b693846f/0xd3f183cab4a7a313 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2faa expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.743494:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c70b3e00, rc 0) 00000100:00100000:1.0:1787857578.743564:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171467648:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 11818us (11992us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857578.743575:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 130 00000100:00100000:1.0:1787857578.751788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857578.765213:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171467904 00000100:00100000:1.0:1787857578.765224:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171467904 00000100:00100000:1.0:1787857578.765302:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 131 00000100:00100000:1.0:1787857578.765327:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171467904:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857578.765348:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857578.765783:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fc18352/0xd3f183cab4a7a328 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2fb8 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857578.765913:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188154752:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857578.766019:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff999902153a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857578.772030:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188154752:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857578.772514:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fc18352/0xd3f183cab4a7a328 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2fb8 expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.772550:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fc18352/0xd3f183cab4a7a328 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2fb8 expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857578.772566:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707c00, rc 0) 00000100:00100000:1.0:1787857578.772700:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171467904:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 7373us (8338us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857578.772710:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 131 00000100:00100000:1.0:1787857578.862117:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188154880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857578.862268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857578.871514:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188154880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857579.671797:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171468544 00000100:00100000:1.0:1787857579.671809:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171468544 00000100:00100000:1.0:1787857579.672010:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 518 00000100:00100000:1.0:1787857579.672020:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:16597:x1874704171468544:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857579.672066:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857579.672089:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a32f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd2fbf expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.672202:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a336 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.672217:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.672232:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857579.672243:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xc:0x0]: returning size 1516 00010000:00010000:1.0:1787857579.672383:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a32f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2fbf expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.672400:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2fbf expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.672408:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9998c53aed00) 00010000:00010000:1.0:1787857579.672410:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857579.672413:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00100000:1.0:1787857579.672481:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:16597:x1874704171468544:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 463us (1292us total) trans 4294967679 rc 0/0 00000100:00100000:1.0:1787857579.672488:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 518 00000100:00100000:1.0:1787857579.680761:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857579.680806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857579.769659:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857579.822452:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171469440 00000100:00100000:1.0:1787857579.822464:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171469440 00000100:00100000:1.0:1787857579.827783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857579.833566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857579.861489:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171470592 00000100:00100000:1.0:1787857579.861497:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171470592 00010000:00010000:1.0:1787857579.861539:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a359 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2fcd expref: 26 pid: 7656 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857579.861606:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 167 00000100:00100000:1.0:1787857579.861616:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d0398450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:2350:x1874704171470592:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857579.861632:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857579.861639:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a359 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2fcd expref: 26 pid: 7656 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.861660:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a359 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2fcd expref: 26 pid: 7656 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.861683:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a359 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2fcd expref: 26 pid: 7656 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.861696:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9998c53aed00) 00010000:00010000:1.0:1787857579.861701:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a367 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.861709:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a367 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.861716:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a367 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857579.865586:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857580.398079:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188155776:0@lo:400:kworker.0 00000100:00100000:1.0:1787857580.398171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857580.398233:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857580.398240:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188155648:0@lo:400:kworker.0 00000100:00100000:1.0:1787857580.398282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857580.400222:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188155648:0@lo:400:kworker.0 00000100:00100000:1.0:1787857580.400234:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188155776:0@lo:400:kworker.0 00000001:00080000:1.0:1787857580.493658:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967679 is committed 00000001:00080000:1.0:1787857580.493677:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967676 is committed 00000001:00080000:1.0:1787857580.493686:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967681 is committed 00000100:00080000:1.0:1787857582.178440:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857582.183267:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857582.183275:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857582.183882:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171472256 00000100:00100000:1.0:1787857582.183890:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171472256 00000100:00100000:1.0:1787857582.183952:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171472384 00000100:00100000:1.0:1787857582.183956:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171472384 00000100:00100000:1.0:1787857582.183978:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 174 00000100:00100000:1.0:1787857582.183987:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171472256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857582.184056:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171472256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 70us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857582.184064:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 174 00000100:00100000:1.0:1787857582.184219:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:1.0:1787857582.184228:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2349:x1874704171472384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857582.184272:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2349:x1874704171472384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 46us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857582.184279:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 175 00010000:00010000:1.0:1787857582.830017:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857583.984977:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188156288 00000100:00100000:1.0:1787857583.984987:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188156288 00000100:00100000:1.0:1787857583.985071:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787857583.985082:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188156288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857583.985123:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857583.985172:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188156288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857583.985180:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000001:00080000:1.0:1787857585.083710:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1787857585.519284:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188157056 00000100:00100000:1.0:1787857585.519288:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188157056 00000100:00100000:1.0:1787857585.519331:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188156800 00000100:00100000:1.0:1787857585.519334:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188156800 00000100:00100000:1.0:1787857585.519354:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787857585.519362:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188157056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857585.519400:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188157056:12345-0@lo:400:kworker.0 Request processed in 40us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857585.519406:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787857585.519419:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787857585.519424:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188156800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857585.519457:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188156800:12345-0@lo:400:kworker.0 Request processed in 32us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857585.519472:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787857585.519507:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188156800:0@lo:400:kworker.0 00000100:00100000:1.0:1787857585.519526:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188157056:0@lo:400:kworker.0 00010000:00010000:1.0:1787857585.903916:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857586.031658:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188157184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857586.031944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857588.977047:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857589.106633:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188157312 00000100:00100000:1.0:1787857589.106653:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188157312 00000100:00100000:1.0:1787857589.107071:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787857589.107086:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188157312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857589.107145:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857589.107284:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188157312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857589.107293:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787857589.562092:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00080000:1.0:1787857589.568990:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857590.638487:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188157440:0@lo:400:kworker.0 00000100:00100000:1.0:1787857590.638592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857590.639053:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188157952:0@lo:400:kworker.0 00000100:00100000:1.0:1787857590.639106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857590.639153:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787857590.639161:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188157568:0@lo:400:kworker.0 00000100:00100000:1.0:1787857590.639187:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857590.639226:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188158080:0@lo:400:kworker.0 00000100:00100000:1.0:1787857590.639563:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188157824 00000100:00100000:1.0:1787857590.639567:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188157824 00000100:00100000:1.0:1787857590.639606:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787857590.639614:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188157824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857590.646697:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188157824:12345-0@lo:400:kworker.0 Request processed in 7067us (7440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857590.646716:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787857591.155856:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857591.159300:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188158208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857591.159424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857592.046033:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787857592.406303:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857594.222477:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188158336 00000100:00100000:1.0:1787857594.222485:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188158336 00000100:00100000:1.0:1787857594.222559:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787857594.222569:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188158336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857594.222606:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 56164352 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857594.222661:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188158336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857594.222669:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00010000:1.0:1787857595.117988:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857595.758605:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188158592:0@lo:400:kworker.0 00000100:00100000:1.0:1787857595.758634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857595.758655:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188159104:0@lo:400:kworker.0 00000100:00100000:1.0:1787857595.758679:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857595.758713:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787857595.758723:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188158464:0@lo:400:kworker.0 00000100:00100000:1.0:1787857595.758775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857595.758807:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188158976:0@lo:400:kworker.0 00000100:00100000:1.0:1787857595.758852:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857595.758871:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188158976 00000100:00100000:1.0:1787857595.758875:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188158976 00000100:00100000:1.0:1787857595.765509:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787857595.765523:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188158976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857595.765628:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188158976:12345-0@lo:400:kworker.0 Request processed in 110us (6775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857595.765637:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787857595.765689:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188158976:0@lo:400:kworker.0 00000100:00100000:1.0:1787857596.272902:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188159232 00000100:00100000:1.0:1787857596.272917:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188159232 00000100:00100000:1.0:1787857596.273003:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787857596.273015:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188159232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857596.273078:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857596.273175:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188159232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857596.273184:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000001:02000400:1.0:1787857596.812661:0:15156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool 00000100:00100000:1.0:1787857597.521865:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857597.521920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857597.521953:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857597.521978:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857597.522066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857597.522099:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171475712 00000100:00100000:1.0:1787857597.522113:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171475712 00002000:00100000:1.0:1787857597.522195:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->1515) req@ffff999901588000 x1874704171475712/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:243/0 lens 2008/0 e 0 to 0 dl 1787857608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857597.522208:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901588000 with x1874704171475712 ext(0->1515) 00002000:00010000:1.0:1787857597.522215:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff999901588000 00000100:00100000:1.0:1787857597.522237:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171475968 00000100:00100000:1.0:1787857597.522240:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171475968 00002000:00100000:1.0:1787857597.522256:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (0->1515) req@ffff99990158a940 x1874704171475968/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:243/0 lens 2008/0 e 0 to 0 dl 1787857608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857597.522264:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990158a940 with x1874704171475968 ext(0->1515) 00002000:00010000:1.0:1787857597.522269:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99990158a940 00000100:00100000:1.0:1787857597.522276:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171475584 00000100:00100000:1.0:1787857597.522279:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171475584 00002000:00100000:1.0:1787857597.522299:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (0->1518) req@ffff9998efa6d680 x1874704171475584/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:243/0 lens 2008/0 e 0 to 0 dl 1787857608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857597.522319:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6d680 with x1874704171475584 ext(0->1518) 00002000:00010000:1.0:1787857597.522323:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6d680 00000100:00100000:1.0:1787857597.522332:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171475840 00000100:00100000:1.0:1787857597.522335:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171475840 00002000:00100000:1.0:1787857597.522350:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->646) req@ffff9998efa6e580 x1874704171475840/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:243/0 lens 1136/0 e 0 to 0 dl 1787857608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857597.522358:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6e580 with x1874704171475840 ext(0->646) 00002000:00010000:1.0:1787857597.522361:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6e580 00000100:00100000:1.0:1787857597.522376:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:1.0:1787857597.522388:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171475712:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857597.523141:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171475712:12345-192.168.204.36@tcp:4:cp.0 Request processed in 751us (1215us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787857597.523152:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 47 00002000:00100000:1.0:1787857597.523161:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->1515) req@ffff999901588000 x1874704171475712/t4294967322(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:243/0 lens 2008/448 e 0 to 0 dl 1787857608 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857597.523170:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901588000 with x1874704171475712 ext(0->1515) 00002000:00010000:1.0:1787857597.523174:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff999901588000 00000100:00100000:1.0:1787857597.523200:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:1.0:1787857597.523208:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171475968:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857597.523431:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2348:x1874704171475968:12345-192.168.204.36@tcp:4:cp.0 Request processed in 223us (1474us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787857597.523438:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 48 00002000:00100000:1.0:1787857597.523444:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (0->1515) req@ffff99990158a940 x1874704171475968/t4294967323(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:243/0 lens 2008/448 e 0 to 0 dl 1787857608 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857597.523451:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990158a940 with x1874704171475968 ext(0->1515) 00002000:00010000:1.0:1787857597.523455:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99990158a940 00000100:00100000:1.0:1787857597.523469:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:1.0:1787857597.523476:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2348:x1874704171475584:12345-192.168.204.36@tcp:4:dd.0 00000100:00100000:1.0:1787857597.523761:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171475584:12345-192.168.204.36@tcp:4:dd.0 Request processed in 284us (1781us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787857597.523768:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 49 00002000:00100000:1.0:1787857597.523774:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (0->1518) req@ffff9998efa6d680 x1874704171475584/t4294967326(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:243/0 lens 2008/448 e 0 to 0 dl 1787857608 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857597.523793:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6d680 with x1874704171475584 ext(0->1518) 00002000:00010000:1.0:1787857597.523797:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6d680 00000100:00100000:1.0:1787857597.523855:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:1.0:1787857597.523864:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171475840:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857597.524092:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171475840:12345-192.168.204.36@tcp:4:cp.0 Request processed in 229us (2025us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1787857597.524098:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 50 00002000:00100000:1.0:1787857597.524104:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->646) req@ffff9998efa6e580 x1874704171475840/t4294967327(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:243/0 lens 1136/448 e 0 to 0 dl 1787857608 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857597.524110:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6e580 with x1874704171475840 ext(0->646) 00002000:00010000:1.0:1787857597.524113:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6e580 00010000:00010000:1.0:1787857598.190975:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857600.883007:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188159872:0@lo:400:kworker.0 00000100:00100000:1.0:1787857600.883111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857600.883190:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857600.883197:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188159744:0@lo:400:kworker.0 00000100:00100000:1.0:1787857600.883228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857601.262019:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857602.642119:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171476480 00000100:00100000:1.0:1787857602.642124:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171476480 00000100:00100000:1.0:1787857602.642167:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 334 00000100:00100000:1.0:1787857602.642175:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171476480:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857602.642209:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171476480:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857602.642225:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 334 00000100:00100000:1.0:1787857602.642918:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171476608 00000100:00100000:1.0:1787857602.642924:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171476608 00000100:00100000:1.0:1787857602.643093:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 246 00000100:00100000:1.0:1787857602.643101:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+52:2350:x1874704171476608:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857602.643483:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+52:2350:x1874704171476608:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 382us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857602.643491:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 246 00000100:00080000:1.0:1787857602.643530:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857602.643535:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857602.643538:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857602.644110:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171476864 00000100:00100000:1.0:1787857602.644115:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171476864 00000100:00100000:1.0:1787857602.644144:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171477120 00000100:00100000:1.0:1787857602.644147:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171477120 00000100:00100000:1.0:1787857602.644177:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:1.0:1787857602.644183:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2350:x1874704171477248:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857602.644219:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2350:x1874704171477248:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857602.644225:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:1.0:1787857602.644238:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:1.0:1787857602.644244:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+8:2350:x1874704171476864:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857602.644264:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+8:2350:x1874704171476864:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857602.644270:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:1.0:1787857602.644286:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 197 00000100:00100000:1.0:1787857602.644292:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2350:x1874704171477120:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857602.644313:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2350:x1874704171477120:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857602.644318:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 197 00000100:00080000:1.0:1787857602.644330:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857602.644333:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787857603.643135:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a3c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.643157:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a3c9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.643166:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a3c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.643174:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857603.643180:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a3c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.643657:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a3c9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.643681:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4f27b7ce (ffff9998d5316300) 00010000:00010000:1.0:1787857603.643684:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857603.643690:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a3c9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.643697:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a3c9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857603.654493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857603.686663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857603.686714:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171478400 00000100:00100000:1.0:1787857603.686724:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171478400 00000100:00100000:1.0:1787857603.686782:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 535 00000100:00100000:1.0:1787857603.686793:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:17730:x1874704171478400:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857603.686836:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857603.687223:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a41d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3005 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687301:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687317:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687329:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687350:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687358:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687365:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687515:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a432 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687541:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687551:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857603.687594:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x21:0x0]: returning size 512 00000004:00200000:1.0:1787857603.687599:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857603.687632:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687647:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687655:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687662:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687669:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857603.687675:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687683:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687699:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291300) 00010000:00010000:1.0:1787857603.687703:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857603.687708:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687726:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687741:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687748:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687754:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687760:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857603.687763:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687769:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687777:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4f27b7ce (ffff9998c53ae600) 00010000:00010000:1.0:1787857603.687780:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857603.687783:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687790:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a42b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687852:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a41d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3005 expref: 22 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687867:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3005 expref: 21 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.687883:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9998d5316100) 00010000:00010000:1.0:1787857603.687899:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857603.687903:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707a00, rc 0) 00000100:00100000:1.0:1787857603.687982:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:17730:x1874704171478400:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1190us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857603.687991:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 535 00000100:00100000:1.0:1787857603.702739:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171478656 00000100:00100000:1.0:1787857603.702751:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171478656 00000100:00100000:1.0:1787857603.703554:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 537 00000100:00100000:1.0:1787857603.703568:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:17730:x1874704171478656:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857603.703595:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857603.703619:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a44e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3013 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703697:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703714:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703728:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703745:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703752:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703774:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703860:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703867:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703875:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703881:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857603.703885:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703909:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703924:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9998d5316100) 00010000:00010000:1.0:1787857603.703927:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857603.703934:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703941:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703953:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703960:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703971:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703976:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857603.703979:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703986:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.703994:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff9998c53ae600) 00010000:00010000:1.0:1787857603.703997:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857603.704000:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.704006:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a45c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.704041:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a44e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3013 expref: 22 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.704051:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9998d5316100) 00010000:00010000:1.0:1787857603.704054:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857603.704057:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a44e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3013 expref: 22 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857603.704067:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706600, rc 0) 00000100:00100000:1.0:1787857603.704143:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:17730:x1874704171478656:12345-192.168.204.36@tcp:101:rm.0 Request processed in 578us (2078us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857603.704297:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 537 00000100:00100000:1.0:1787857603.895441:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171480576 00000100:00100000:1.0:1787857603.895455:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171480576 00000100:00100000:1.0:1787857603.895549:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 543 00000100:00100000:1.0:1787857603.895563:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+56:17735:x1874704171480576:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1787857603.895944:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 136 off9824 00000100:00100000:1.0:1787857603.896044:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+56:17735:x1874704171480576:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 484us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857603.896052:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 543 00010000:00010000:1.0:1787857604.333966:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787857604.463863:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857604.465001:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188161024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2426us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857604.465014:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787857604.470845:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857604.485687:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171481216 00000100:00100000:1.0:1787857604.485697:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171481216 00000100:00100000:1.0:1787857604.485765:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:1.0:1787857604.485775:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:2347:x1874704171481216:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857604.485792:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857604.485848:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1800/0xd3f183cab4a7a4fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3059 expref: 26 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.485868:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9998d8aea100) 00010000:00010000:1.0:1787857604.485883:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857604.485930:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:2347:x1874704171481216:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 157us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857604.485945:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00080000:1.0:1787857604.486944:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857604.495698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857604.495734:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171481344 00000100:00100000:1.0:1787857604.495742:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171481344 00002000:00100000:1.0:1787857604.495789:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xd:0x0] (0->1515) req@ffff9998ffa81a40 x1874704171481344/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:250/0 lens 2008/0 e 0 to 0 dl 1787857615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857604.495802:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa81a40 with x1874704171481344 ext(0->1515) 00010000:00010000:1.0:1787857604.495812:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005aa42830/0xd3f183cab4a7a4b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3036 expref: 8 pid: 14028 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.495850:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005aa42830/0xd3f183cab4a7a4b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3036 expref: 8 pid: 14028 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857604.495857:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998ffa81a40 00000100:00100000:1.0:1787857604.495894:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:1.0:1787857604.495905:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171481344:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857604.498067:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171481344:12345-192.168.204.36@tcp:4:cp.0 Request processed in 2152us (2367us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787857604.498083:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 2 00002000:00100000:1.0:1787857604.498098:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xd:0x0] (0->1515) req@ffff9998ffa81a40 x1874704171481344/t4294967328(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:250/0 lens 2008/448 e 0 to 0 dl 1787857615 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857604.498109:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa81a40 with x1874704171481344 ext(0->1515) 00010000:00010000:1.0:1787857604.498120:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005aa42830/0xd3f183cab4a7a4b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3036 expref: 10 pid: 14028 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.498147:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005aa42830/0xd3f183cab4a7a4b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3036 expref: 10 pid: 14028 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857604.498155:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998ffa81a40 00000100:00100000:1.0:1787857604.512474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857604.517062:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171481728 00000100:00100000:1.0:1787857604.517076:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171481728 00000100:00100000:1.0:1787857604.517152:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 546 00000100:00100000:1.0:1787857604.517163:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:17745:x1874704171481728:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857604.517292:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:17745:x1874704171481728:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 130us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857604.517300:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 546 00000100:00100000:1.0:1787857604.549904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857604.574376:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171482368 00000100:00100000:1.0:1787857604.574389:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171482368 00000100:00100000:1.0:1787857604.574493:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 548 00000100:00100000:1.0:1787857604.574506:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:17745:x1874704171482368:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857604.574533:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857604.574561:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a519 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3067 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.574610:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a520 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.574625:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.574650:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.574762:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a519 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3067 expref: 27 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.574782:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3067 expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.574792:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9998d8aea100) 00010000:00010000:1.0:1787857604.574795:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857604.574799:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707600, rc 0) 00000100:00100000:1.0:1787857604.575644:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:17745:x1874704171482368:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1136us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857604.575655:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 548 00000100:00100000:1.0:1787857604.603052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857604.608064:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857604.608113:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171482880 00000100:00100000:1.0:1787857604.608123:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171482880 00000100:00100000:1.0:1787857604.608245:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 550 00000100:00100000:1.0:1787857604.608256:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:17745:x1874704171482880:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787857604.608461:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.608480:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a520 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3067 expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.608501:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.608538:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3067 expref: 26 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.608552:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a520 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3067 expref: 26 pid: 5856 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857604.608567:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188161408:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857604.608660:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857604.613065:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857604.613918:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.613929:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.614139:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.614147:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.614154:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.614161:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857604.614166:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.614182:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.614194:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9998d8aea100) 00010000:00010000:1.0:1787857604.614197:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857604.614201:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.614208:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a52e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857604.614412:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:17745:x1874704171482880:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 6156us (6360us total) trans 4294967690 rc 0/0 00000100:00100000:1.0:1787857604.614421:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 550 00000100:00100000:1.0:1787857604.759165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857604.759218:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857604.759254:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171483648 00000100:00100000:1.0:1787857604.759267:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171483648 00000100:00100000:1.0:1787857604.759335:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:1.0:1787857604.759350:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+59:2347:x1874704171483648:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857604.759368:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857604.759399:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a53c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd306e expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857604.759441:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9998d8aea100) 00010000:00010000:1.0:1787857604.759446:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857604.759512:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+58:2347:x1874704171483648:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 166us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857604.759530:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:1.0:1787857604.764654:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000001:00080000:1.0:1787857606.072725:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967686 is committed 00000001:00080000:1.0:1787857606.072928:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967690 is committed 00000001:00080000:1.0:1787857606.072940:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967692 is committed 00000001:00080000:1.0:1787857606.072945:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967691 is committed 00000001:00080000:1.0:1787857606.072954:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967693 is committed 00000100:00100000:1.0:1787857606.510217:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857606.511220:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857606.511304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857607.407344:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857609.583482:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188162432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857609.583601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857609.587230:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188162432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857611.120932:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188162944:0@lo:400:kworker.0 00000100:00100000:1.0:1787857611.121008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857611.121073:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857611.121079:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188162816:0@lo:400:kworker.0 00000100:00100000:1.0:1787857611.121108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857611.121168:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188162944 00000100:00100000:1.0:1787857611.121176:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188162944 00000100:00100000:1.0:1787857611.121251:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787857611.121260:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188162944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857611.121308:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188162944:12345-0@lo:400:kworker.0 Request processed in 49us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857611.121326:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787857611.121372:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188162944:0@lo:400:kworker.0 00000100:00100000:1.0:1787857611.121404:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188162816 00000100:00100000:1.0:1787857611.121408:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188162816 00000100:00100000:1.0:1787857611.121444:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787857611.121450:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188162816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857611.121485:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188162816:12345-0@lo:400:kworker.0 Request processed in 36us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857611.121493:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787857611.121517:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188162816:0@lo:400:kworker.0 00000001:02000400:1.0:1787857612.795517:0:15700:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_9a Need 3 or more clients, have 1 00000100:00100000:1.0:1787857614.935977:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171486720 00000100:00100000:1.0:1787857614.935993:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171486720 00000100:00100000:1.0:1787857614.936092:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:1.0:1787857614.936103:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:2348:x1874704171486720:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857614.936121:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857614.936148:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a566 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3075 expref: 24 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857614.936170:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857614.936176:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857614.936257:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2348:x1874704171486720:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 155us (5546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857614.936265:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:1.0:1787857614.944243:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00080000:1.0:1787857614.948722:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857614.968957:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171487232 00000100:00100000:1.0:1787857614.969027:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171487232 00010000:00010000:1.0:1787857614.969076:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090c00/0xd3f183cab4a7a416 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ffe expref: 23 pid: 5856 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857614.969166:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 172 00000100:00100000:1.0:1787857614.969177:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2350:x1874704171487232:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857614.969193:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857614.969201:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090c00/0xd3f183cab4a7a416 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ffe expref: 23 pid: 5856 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857614.969215:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090c00/0xd3f183cab4a7a416 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ffe expref: 23 pid: 5856 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857614.969240:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090c00/0xd3f183cab4a7a416 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ffe expref: 23 pid: 5856 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857614.969257:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291300) 00010000:00010000:1.0:1787857614.969262:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a589 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857614.969271:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a589 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857614.969278:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a589 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857614.969316:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857614.969406:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2350:x1874704171487232:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 230us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857614.969648:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 172 00000100:00100000:1.0:1787857615.003499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857615.033857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857615.044691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857615.049465:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+58:18646:x1874704171488384:12345-192.168.204.36@tcp:101:bash.0 Request processed in 4139us (4770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857615.049481:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 564 00000100:00100000:1.0:1787857615.060283:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857615.092282:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171488640 00000100:00100000:2.0:1787857615.092358:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 566 00000100:00100000:2.0:1787857615.092369:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:18647:x1874704171488640:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857615.092388:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857615.092418:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a60e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30a6 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.094927:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a615 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.094956:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.094972:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857615.095060:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787857615.095065:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857615.095116:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.095156:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a60e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30a6 expref: 24 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.095188:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a615 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30a6 expref: 23 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.095197:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291300) 00010000:00010000:2.0:1787857615.095200:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857615.095205:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0e00, rc 0) 00000100:00100000:2.0:1787857615.095304:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:18647:x1874704171488640:12345-192.168.204.36@tcp:101:rm.0 Request processed in 2935us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857615.095334:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 566 00000100:00100000:1.0:1787857615.101779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857615.117151:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857615.117254:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171488896 00000100:00100000:2.0:1787857615.117266:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171488896 00000100:00100000:2.0:1787857615.117345:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 568 00000100:00100000:2.0:1787857615.117748:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18647:x1874704171488896:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857615.117782:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857615.117903:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30b4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118055:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118070:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118083:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118098:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118106:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118112:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118180:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118208:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118216:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118222:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.118227:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118235:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118248:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.118251:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.118256:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118263:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a63f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118278:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118285:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118291:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118296:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.118306:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118312:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118320:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff9998d8aea400) 00010000:00010000:2.0:1787857615.118323:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.118326:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.118332:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.119191:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a638 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30b4 expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.119209:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.119212:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.119217:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30b4 expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.119230:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0600, rc 0) 00000100:00100000:2.0:1787857615.119328:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18647:x1874704171488896:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1588us (2190us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857615.119337:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 568 00000100:00100000:2.0:1787857615.123911:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171489024 00000100:00100000:2.0:1787857615.123923:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171489024 00000100:00100000:2.0:1787857615.123996:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 569 00000100:00100000:2.0:1787857615.124006:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18647:x1874704171489024:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857615.124044:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857615.124064:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a64d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30bb expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124132:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124147:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124158:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124172:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124179:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124186:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124249:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124257:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124263:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124269:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.124280:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124288:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124301:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.124304:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.124309:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124315:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a654 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124330:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124336:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124343:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124349:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.124351:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124357:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124364:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff9998d8aea800) 00010000:00010000:2.0:1787857615.124367:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.124377:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124383:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a65b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124436:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a64d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30bb expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124446:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.124449:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.124452:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a64d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30bb expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.124461:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0a00, rc 0) 00000100:00100000:2.0:1787857615.124519:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18647:x1874704171489024:12345-192.168.204.36@tcp:101:rm.0 Request processed in 515us (801us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857615.124527:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 569 00000100:00100000:2.0:1787857615.150856:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171489152 00000100:00100000:2.0:1787857615.150867:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171489152 00000100:00100000:2.0:1787857615.150950:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 570 00000100:00100000:2.0:1787857615.150962:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18648:x1874704171489152:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857615.150999:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857615.151026:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30c2 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151116:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151150:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151164:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151180:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151188:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151195:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151271:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151279:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151285:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151291:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.151295:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151302:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151313:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.151322:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.151327:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151332:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a669 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151348:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151354:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151360:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151557:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.151561:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151567:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151575:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff9998d8aea800) 00010000:00010000:2.0:1787857615.151577:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.151581:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151586:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.151977:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a662 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30c2 expref: 25 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.152002:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.152004:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.152009:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30c2 expref: 25 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.152019:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0a00, rc 0) 00000100:00100000:2.0:1787857615.152095:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18648:x1874704171489152:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1133us (1463us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857615.152104:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 570 00000100:00100000:2.0:1787857615.156505:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171489280 00000100:00100000:2.0:1787857615.156516:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171489280 00000100:00100000:2.0:1787857615.156582:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 571 00000100:00100000:2.0:1787857615.156593:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18648:x1874704171489280:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857615.156625:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857615.156653:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30c9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156737:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156753:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156764:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156779:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156812:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156856:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156931:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156938:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156946:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156953:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.156968:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156976:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.156988:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.156991:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.156996:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157001:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a67e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157015:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157027:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157032:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157036:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.157039:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157045:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157052:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff9998d8aea400) 00010000:00010000:2.0:1787857615.157055:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.157058:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157062:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157100:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a677 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30c9 expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157109:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.157111:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.157115:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30c9 expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.157135:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0600, rc 0) 00000100:00100000:2.0:1787857615.157196:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18648:x1874704171489280:12345-192.168.204.36@tcp:101:cp.0 Request processed in 604us (875us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857615.157203:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 571 00000100:00100000:1.0:1787857615.165851:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171489536 00000100:00100000:1.0:1787857615.165866:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171489536 00000100:00100000:1.0:1787857615.165937:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 572 00000100:00100000:1.0:1787857615.165948:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18648:x1874704171489536:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857615.166576:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857615.166604:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a68c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30d0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.167220:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.167235:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.167246:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.167283:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.167436:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.167446:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857615.168178:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc:0x0], index 0: 0 00010000:00010000:1.0:1787857615.169243:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a6a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.169263:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.169273:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170273:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170288:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170464:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170470:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857615.170474:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170500:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170515:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:1.0:1787857615.170518:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857615.170523:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170529:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a693 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857615.170547:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd27bc4c reply state 0000000098e2000c transno 4294967698 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857615.170556:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857615.170602:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a68c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d0 expref: 27 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170627:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707000/0xd3f183cab4a7a6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d0 expref: 26 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.170634:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9998c53ae600) 00010000:00010000:1.0:1787857615.170636:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857615.170638:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707000, rc 0) 00000100:00100000:1.0:1787857615.171094:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:18648:x1874704171489536:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5144us (6129us total) trans 4294967698 rc 0/0 00000100:00100000:1.0:1787857615.171104:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 572 00000100:00100000:1.0:1787857615.179265:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171489664 00000100:00100000:1.0:1787857615.179303:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171489664 00000100:00100000:1.0:1787857615.179384:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 142 00000100:00100000:1.0:1787857615.179396:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+6:2349:x1874704171489664:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857615.179426:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857615.179449:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30d7 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857615.179477:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857615.179497:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1787857615.179503:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857615.179512:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 7 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.179532:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 7 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.179546:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707400, rc 0) 00000100:00100000:1.0:1787857615.179605:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2349:x1874704171489664:12345-192.168.204.36@tcp:101:cp.0 Request processed in 212us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857615.179626:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 142 00010000:00010000:2.0:1787857615.184764:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.184791:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.184800:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.184807:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.184812:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.184835:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.184855:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff9998c53aeb00) 00010000:00010000:2.0:1787857615.184859:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.184863:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.184870:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a69a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857615.188641:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171489792 00000100:00100000:1.0:1787857615.188653:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171489792 00000100:00100000:1.0:1787857615.188735:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 143 00000100:00100000:1.0:1787857615.188746:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:18648:x1874704171489792:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857615.188767:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857615.188786:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30de expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.188861:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 8 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.188871:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857615.188875:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857615.188881:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 8 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.188913:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 8 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.188926:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 8 pid: 8490 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857615.188942:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188163712:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857615.189046:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0dffe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857615.196177:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188163712:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857615.196215:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 8 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.196237:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706200, rc 0) 00000100:00100000:1.0:1787857615.196305:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:18648:x1874704171489792:12345-192.168.204.36@tcp:101:cp.0 Request processed in 7561us (7841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857615.196314:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 143 00000100:00100000:2.0:1787857615.196501:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171489920 00000100:00100000:2.0:1787857615.196513:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171489920 00010000:00010000:2.0:1787857615.196548:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 8 pid: 8490 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857615.196589:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 173 00000100:00100000:2.0:1787857615.196599:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171489920:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857615.196615:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857615.196642:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 8 pid: 8490 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.196657:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 8 pid: 8490 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.196698:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7a6af lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30d7 expref: 8 pid: 8490 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.199994:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857615.200044:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857615.200062:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 7 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.200078:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 7 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.200134:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 7 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857615.200169:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188163840:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857615.200246:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857615.205778:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188163840:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857615.205848:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857615.205921:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2350:x1874704171489920:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 9322us (9958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857615.205933:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 173 00000100:00100000:2.0:1787857615.213374:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171490176 00000100:00100000:2.0:1787857615.213384:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171490176 00000100:00100000:2.0:1787857615.213443:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 123 00000100:00100000:2.0:1787857615.213454:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:18648:x1874704171490176:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:2.0:1787857615.213897:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:18648:x1874704171490176:12345-192.168.204.36@tcp:35:cp.0 Request processed in 443us (617us total) trans 4294967699 rc 0/0 00000100:00100000:2.0:1787857615.213906:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 123 00000100:00100000:2.0:1787857615.302596:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171490304 00000100:00100000:2.0:1787857615.302624:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171490304 00000100:00100000:2.0:1787857615.302786:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 573 00000100:00100000:2.0:1787857615.302798:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+58:18651:x1874704171490304:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857615.302853:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857615.302877:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a6bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30e5 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.302953:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.302969:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.302981:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303017:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303025:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303033:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303322:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a6d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303332:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303340:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857615.303381:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00000004:00200000:2.0:1787857615.303386:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857615.303408:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303421:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303429:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303435:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303455:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303461:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.303465:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303474:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303487:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:2.0:1787857615.303490:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.303496:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303503:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1200/0xd3f183cab4a7a6c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303520:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303526:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303532:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303537:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857615.303539:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303555:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303564:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff9998d8aea400) 00010000:00010000:2.0:1787857615.303566:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857615.303569:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303574:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a6cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303673:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a6bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30e5 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303693:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0c00/0xd3f183cab4a7a6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30e5 expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.303700:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9998c53ae600) 00010000:00010000:2.0:1787857615.303703:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857615.303705:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0c00, rc 0) 00000100:00100000:2.0:1787857615.303905:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+59:18651:x1874704171490304:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1109us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857615.303914:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 573 00000100:00080000:1.0:1787857615.319606:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857615.340705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857615.347650:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171490688 00000100:00100000:1.0:1787857615.347672:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171490688 00000100:00100000:1.0:1787857615.347731:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 145 00000100:00100000:1.0:1787857615.347740:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+9:2350:x1874704171490688:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857615.347762:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857615.347781:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a6ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd30fa expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857615.347870:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188164096:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857615.347985:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0dffe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857615.354845:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188164096:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857615.354889:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a6ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30fa expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.354915:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a6ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30fa expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.354927:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707600, rc 0) 00000100:00100000:1.0:1787857615.355073:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+9:2350:x1874704171490688:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 7331us (7619us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857615.355162:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 145 00000100:00100000:2.0:1787857615.370694:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857615.377484:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+60:18651:x1874704171490944:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 6524us (6789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857615.377499:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 575 00010000:00010000:2.0:1787857615.599143:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857615.931434:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857615.931470:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171491072 00000100:00100000:2.0:1787857615.931478:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171491072 00000100:00100000:2.0:1787857615.931531:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 576 00000100:00100000:2.0:1787857615.931541:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:18661:x1874704171491072:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857615.931578:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857615.931691:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:18661:x1874704171491072:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 151us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857615.931700:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 576 00000100:00100000:2.0:1787857615.931802:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188164224:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857615.953756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857615.953805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857615.953857:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171491584 00000100:00100000:2.0:1787857615.953868:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171491584 00000100:00100000:2.0:1787857615.953930:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:2.0:1787857615.953940:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2349:x1874704171491584:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857615.953955:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857615.953981:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a6fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3101 expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.953999:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9998c53ae600) 00010000:00010000:2.0:1787857615.954004:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857615.954056:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:2349:x1874704171491584:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 117us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857615.954064:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:1.0:1787857615.970365:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188164352:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857615.970414:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d0939d2/0xd3f183cab4a7a70a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857615.975751:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857615.976843:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171491712:12345-192.168.204.36@tcp:4:cp.0 Request processed in 787us (1097us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787857615.976853:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 3 00002000:00100000:2.0:1787857615.976863:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc:0x0] (0->157) req@ffff9998efab7480 x1874704171491712/t4294967324(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:261/0 lens 648/448 e 0 to 0 dl 1787857626 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857615.976872:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab7480 with x1874704171491712 ext(0->157) 00010000:00010000:2.0:1787857615.976880:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 10 pid: 14028 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857615.976894:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 10 pid: 14028 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857615.976902:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998efab7480 00000100:00100000:1.0:1787857615.980271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171491840 00000100:00100000:1.0:1787857615.980280:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171491840 00010000:00010000:1.0:1787857615.980321:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 10 pid: 14028 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857615.980366:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 174 00000100:00100000:1.0:1787857615.980376:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171491840:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857615.980402:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857615.980428:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 10 pid: 14028 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.980443:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 10 pid: 14028 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.980470:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056d0840d/0xd3f183cab4a7a6b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30de expref: 10 pid: 14028 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.980487:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857615.980492:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857615.980499:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d0939d2/0xd3f183cab4a7a70a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.980525:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0939d2/0xd3f183cab4a7a70a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857615.980562:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857615.980616:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171491840:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 242us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857615.980624:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 174 00010000:00010000:0.0:1787857615.980989:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0939d2/0xd3f183cab4a7a70a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857615.981012:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0939d2/0xd3f183cab4a7a70a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857615.981025:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d0939d2/0xd3f183cab4a7a70a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857615.981033:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0939d2/0xd3f183cab4a7a70a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857615.981107:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171491456:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 22921us (27364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857615.981115:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 146 00000100:00100000:1.0:1787857615.989544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857615.997724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857616.003513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00080000:1.0:1787857616.003924:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857616.021104:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857616.029960:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.048043:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857616.058500:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171492992 00000100:00100000:1.0:1787857616.058515:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171492992 00000100:00100000:1.0:1787857616.058584:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 148 00000100:00100000:1.0:1787857616.058593:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171492992:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857616.058636:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058664:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857616.058669:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857616.058674:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058688:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058740:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058749:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058757:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058764:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857616.058769:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058777:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058791:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857616.058798:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054bc5509/0xd3f183cab4a7a726 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857616.059739:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171492992:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 1142us (4592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857616.059750:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 148 00000100:00100000:0.0:1787857616.068790:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.069311:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 582 00000100:00100000:2.0:1787857616.069324:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:18661:x1874704171493248:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857616.069530:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a72d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.069550:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a71f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd310f expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.069560:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a72d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.069594:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a71f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd310f expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.069625:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a71f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd310f expref: 29 pid: 5857 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857616.069641:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188164480:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857616.069797:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857616.072730:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188164480:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857616.072762:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a72d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857616.073226:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.073301:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171493376 00000100:00100000:2.0:1787857616.073308:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171493376 00010000:00010000:2.0:1787857616.073453:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a71f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd310f expref: 30 pid: 5857 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857616.073498:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:2.0:1787857616.073508:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d039b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:2350:x1874704171493376:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857616.073522:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857616.073529:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a71f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd310f expref: 30 pid: 5857 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.073541:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a71f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd310f expref: 30 pid: 5857 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.073562:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7a71f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd310f expref: 30 pid: 5857 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.073593:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9998c53ae600) 00010000:00010000:2.0:1787857616.073599:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a72d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.073607:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a72d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.073615:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a72d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.073638:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857616.073697:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d039b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2350:x1874704171493376:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 190us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857616.073703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:2.0:1787857616.074853:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:18661:x1874704171493248:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 5494us (6036us total) trans 4294967701 rc 0/0 00000100:00100000:2.0:1787857616.074864:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 582 00000100:00100000:0.0:1787857616.079498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.079585:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171493632 00000100:00100000:2.0:1787857616.079596:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171493632 00000100:00100000:2.0:1787857616.079669:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 124 00000100:00100000:2.0:1787857616.079680:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:18661:x1874704171493632:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857616.079972:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:18661:x1874704171493632:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 292us (485us total) trans 4294967702 rc 0/0 00000100:00100000:2.0:1787857616.079981:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 124 00000100:00100000:1.0:1787857616.238221:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188164608:0@lo:400:kworker.0 00000100:00100000:2.0:1787857616.238268:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188164736:0@lo:400:kworker.0 00000100:00100000:2.0:1787857616.242906:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857616.243161:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188165248:0@lo:400:kworker.0 00000100:00100000:2.0:1787857616.243473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857616.243633:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188164736 00000100:00100000:2.0:1787857616.243653:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188164736 00000100:00100000:2.0:1787857616.243712:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787857616.243721:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188164736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857616.243777:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188164736:12345-0@lo:400:kworker.0 Request processed in 57us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857616.243785:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787857616.243807:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188165248 00000100:00100000:2.0:1787857616.243810:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188165248 00000100:00100000:2.0:1787857616.243861:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787857616.243867:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188165248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857616.243898:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188165248:12345-0@lo:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857616.243904:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1787857616.243921:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857616.245322:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188165248:0@lo:400:kworker.0 00000100:00100000:2.0:1787857616.245365:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188164736:0@lo:400:kworker.0 00000100:00100000:0.0:1787857616.249593:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188164992:0@lo:400:kworker.0 00000100:00100000:0.0:1787857616.249673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857616.249737:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188164992 00000100:00100000:0.0:1787857616.249743:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188164992 00000100:00100000:0.0:1787857616.249798:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787857616.249806:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188164992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857616.249984:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188164992:12345-0@lo:400:kworker.0 Request processed in 178us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857616.249991:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1787857616.250015:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857616.250041:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188164992:0@lo:400:kworker.0 00000100:00100000:2.0:1787857616.259312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857616.259372:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188164864 00000100:00100000:0.0:1787857616.259580:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857616.259619:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188165120:0@lo:400:kworker.0 00000100:00100000:0.0:1787857616.259660:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857616.259692:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188164608 00000100:00100000:0.0:1787857616.259698:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188164608 00000100:00100000:0.0:1787857616.259739:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787857616.259747:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188164608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857616.259795:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188164608:12345-0@lo:400:kworker.0 Request processed in 48us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857616.259802:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787857616.259848:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188165120 00000100:00100000:0.0:1787857616.259852:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188165120 00000100:00100000:0.0:1787857616.259887:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787857616.259893:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188165120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857616.259924:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188165120:12345-0@lo:400:kworker.0 Request processed in 31us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857616.259930:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787857616.260027:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188164864 00000100:00100000:2.0:1787857616.260058:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787857616.260064:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188164864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857616.260484:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188164864:12345-0@lo:400:kworker.0 Request processed in 419us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857616.260501:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787857616.260627:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188164864:0@lo:400:kworker.0 00000100:00080000:0.0:1787857616.261294:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857616.261853:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188164608:0@lo:400:kworker.0 00000100:00100000:0.0:1787857616.261872:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188165120:0@lo:400:kworker.0 00000001:00080000:0.0:1787857616.341861:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967698 is committed 00000001:00080000:0.0:1787857616.341873:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967702 is committed 00000001:00080000:0.0:1787857616.341882:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967697 is committed 00000100:00100000:0.0:1787857616.654805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.655217:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171493760 00000100:00100000:2.0:1787857616.655228:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171493760 00000100:00100000:2.0:1787857616.655293:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 149 00000100:00100000:2.0:1787857616.655303:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171493760:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:2.0:1787857616.655323:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857616.655353:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab59e54/0xd3f183cab4a7a734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3116 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.655381:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857616.655386:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857616.655396:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab59e54/0xd3f183cab4a7a734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3116 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.655414:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eab59e54/0xd3f183cab4a7a734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3116 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.655428:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1800, rc 0) 00000100:00100000:2.0:1787857616.655492:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171493760:12345-192.168.204.36@tcp:101:diff.0 Request processed in 191us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857616.655501:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 149 00000100:00100000:0.0:1787857616.665435:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.665879:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171494016 00000100:00100000:2.0:1787857616.665890:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171494016 00000100:00100000:2.0:1787857616.666089:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 583 00000100:00100000:2.0:1787857616.666099:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+58:18680:x1874704171494016:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:2.0:1787857616.666135:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857616.666155:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1000/0xd3f183cab4a7a73b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd311d expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.666280:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a742 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.666296:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.666309:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857616.666321:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00010000:00010000:2.0:1787857616.666730:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1000/0xd3f183cab4a7a73b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd311d expref: 61 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.666750:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a742 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd311d expref: 60 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.666759:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9998c53ae600) 00010000:00010000:2.0:1787857616.666762:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857616.666766:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1a00, rc 0) 00000100:00100000:2.0:1787857616.667057:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+60:18680:x1874704171494016:12345-192.168.204.36@tcp:101:diff.0 Request processed in 959us (1633us total) trans 4294967703 rc 0/0 00000100:00100000:2.0:1787857616.667066:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 583 00000100:00080000:0.0:1787857616.667224:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857616.677543:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857616.677753:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.677861:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171494144 00000100:00100000:2.0:1787857616.677871:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171494144 00000100:00100000:2.0:1787857616.677960:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:2.0:1787857616.677981:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+60:2349:x1874704171494144:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857616.678003:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857616.678034:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a742 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd311d expref: 60 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.678068:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9998c53ae600) 00010000:00010000:2.0:1787857616.678075:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857616.678148:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+59:2349:x1874704171494144:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 171us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857616.678156:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:0.0:1787857616.680350:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171494272 00000100:00100000:0.0:1787857616.680365:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171494272 00002000:00100000:0.0:1787857616.680424:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff9997c3041e00 x1874704171494272/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:262/0 lens 488/0 e 0 to 0 dl 1787857627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857616.680437:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c3041e00 with x1874704171494272 ext(0->4095) 00002000:00010000:0.0:1787857616.680442:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c3041e00 00000100:00100000:0.0:1787857616.680481:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00100000:0.0:1787857616.680491:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171494272:12345-192.168.204.36@tcp:3:diff.0 00000100:00100000:0.0:1787857616.680881:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171494272:12345-192.168.204.36@tcp:3:diff.0 Request processed in 390us (3352us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857616.680889:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 53 00002000:00100000:0.0:1787857616.680897:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff9997c3041e00 x1874704171494272/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:262/0 lens 488/4536 e 0 to 0 dl 1787857627 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857616.680906:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c3041e00 with x1874704171494272 ext(0->4095) 00002000:00010000:0.0:1787857616.680909:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c3041e00 00000100:00100000:0.0:1787857616.689628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.689926:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171494528 00000100:00100000:2.0:1787857616.689936:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171494528 00000100:00100000:2.0:1787857616.689994:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 125 00000100:00100000:2.0:1787857616.690004:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c5af2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+59:18680:x1874704171494528:12345-192.168.204.36@tcp:35:diff.0 00000100:00100000:2.0:1787857616.690305:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c5af2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+60:18680:x1874704171494528:12345-192.168.204.36@tcp:35:diff.0 Request processed in 302us (687us total) trans 4294967704 rc 0/0 00000100:00100000:2.0:1787857616.690314:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 125 00000100:00100000:1.0:1787857616.751039:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857616.751073:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188165376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857616.751149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857616.751201:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188165376 00000100:00100000:2.0:1787857616.751208:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188165376 00000100:00100000:2.0:1787857616.751256:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787857616.751265:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188165376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857616.751309:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54460416 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857616.751484:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188165376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857616.751533:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188165376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857616.751540:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787857616.751933:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857616.752090:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171494784 00000100:00100000:2.0:1787857616.752111:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171494784 00000100:00100000:2.0:1787857616.752153:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 584 00000100:00100000:2.0:1787857616.752160:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+60:18683:x1874704171494784:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857616.752321:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857616.752344:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a750 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3124 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.752459:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1000/0xd3f183cab4a7a757 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.752474:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1000/0xd3f183cab4a7a757 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.752486:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1000/0xd3f183cab4a7a757 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857616.752497:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00010000:00010000:2.0:1787857616.752622:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a750 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3124 expref: 63 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.752652:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1000/0xd3f183cab4a7a757 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3124 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857616.752661:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9998c53ae600) 00010000:00010000:2.0:1787857616.752664:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787857616.752668:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1000, rc 0) 00000100:00100000:2.0:1787857616.752722:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+62:18683:x1874704171494784:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 561us (791us total) trans 4294967705 rc 0/0 00000100:00100000:2.0:1787857616.752728:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 584 00000100:00100000:1.0:1787857616.761897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857616.871771:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857617.646160:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857618.670213:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857619.701123:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857619.823228:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188165504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857619.823347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857619.827086:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188165504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857620.719602:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787857620.984907:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:0.0:1787857621.365324:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188165632:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.365407:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857621.365456:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188166144:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.365505:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857621.365541:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787857621.365560:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188165760:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.365587:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857621.365605:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188166272:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.365630:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857621.365659:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188165888:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.365683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857621.365701:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857621.365706:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188166016:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.365728:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857621.365756:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188165632 00000100:00100000:0.0:1787857621.365762:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188165632 00000100:00100000:0.0:1787857621.365804:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787857621.365833:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188165632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.365884:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188165632:12345-0@lo:400:kworker.0 Request processed in 71us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857621.365891:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787857621.365956:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188165632:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.366421:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188166144 00000100:00100000:0.0:1787857621.366427:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188166144 00000100:00100000:0.0:1787857621.366468:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188165760 00000100:00100000:0.0:1787857621.366471:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188165760 00000100:00100000:0.0:1787857621.366485:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188165888 00000100:00100000:0.0:1787857621.366495:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188165888 00000100:00100000:0.0:1787857621.366517:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787857621.366524:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188166144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.366584:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188166144:12345-0@lo:400:kworker.0 Request processed in 61us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857621.366591:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787857621.366605:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787857621.366611:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188165760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.366639:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188165760:12345-0@lo:400:kworker.0 Request processed in 29us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857621.366645:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787857621.366657:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787857621.366663:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188165888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.366693:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188165888:12345-0@lo:400:kworker.0 Request processed in 31us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857621.366699:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787857621.366715:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188166272 00000100:00100000:0.0:1787857621.366719:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188166272 00000100:00100000:0.0:1787857621.366744:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188166016 00000100:00100000:0.0:1787857621.366747:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188166016 00000100:00100000:0.0:1787857621.366767:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787857621.366773:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188166272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.367805:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188166272:12345-0@lo:400:kworker.0 Request processed in 1019us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857621.367812:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787857621.367886:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188165760:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.367912:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188166272:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.367924:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188166144:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.367971:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188166016:0@lo:400:kworker.0 00000100:00100000:0.0:1787857621.367984:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188165888:0@lo:400:kworker.0 00010000:00010000:1.0:1787857621.742962:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857621.870134:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857621.870490:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188166400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857621.870575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857621.870716:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188166400 00000100:00100000:2.0:1787857621.870727:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188166400 00000100:00100000:2.0:1787857621.870782:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787857621.870795:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188166400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857621.870881:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54460416 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857621.870935:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188166400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857621.870943:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787857621.871092:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188166400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857622.067378:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00080000:0.0:1787857622.067785:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857622.073556:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171496320 00000100:00100000:2.0:1787857622.073565:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171496320 00000100:00100000:2.0:1787857622.073623:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 126 00000100:00100000:2.0:1787857622.073634:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+24:18643:x1874704171496320:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857622.074495:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:18643:x1874704171496320:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 859us (1121us total) trans 4294967706 rc 0/0 00000100:00100000:2.0:1787857622.074505:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 126 00010000:00010000:2.0:1787857622.767541:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857623.124690:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857623.124740:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857623.124768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857623.124790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857623.124812:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857623.124866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857623.124894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857623.124938:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171496704 00000100:00100000:0.0:1787857623.124948:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171496704 00000100:00100000:0.0:1787857623.125006:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171497216 00000100:00100000:0.0:1787857623.125010:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171497216 00000100:00100000:0.0:1787857623.125026:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171496832 00000100:00100000:0.0:1787857623.125029:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171496832 00000100:00100000:0.0:1787857623.125043:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171497088 00000100:00100000:0.0:1787857623.125045:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171497088 00000100:00100000:0.0:1787857623.125061:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:0.0:1787857623.125071:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171496704:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857623.125149:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171496704:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 79us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857623.125157:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:0.0:1787857623.125189:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 219 00000100:00100000:0.0:1787857623.125195:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2347:x1874704171497216:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857623.125350:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2347:x1874704171497216:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 154us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857623.125358:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 219 00000100:00100000:0.0:1787857623.125610:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00100000:0.0:1787857623.125618:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+8:2347:x1874704171496832:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857623.125642:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+8:2347:x1874704171496832:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857623.125649:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00100000:0.0:1787857623.125659:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 221 00000100:00100000:0.0:1787857623.125665:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2347:x1874704171497088:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857623.125687:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2347:x1874704171497088:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857623.125693:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 221 00000100:00100000:0.0:1787857623.125714:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171496960 00000100:00100000:0.0:1787857623.125718:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171496960 00000100:00100000:0.0:1787857623.125749:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171496576 00000100:00100000:0.0:1787857623.125752:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171496576 00000100:00100000:0.0:1787857623.125775:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:0.0:1787857623.125782:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:2347:x1874704171496960:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857623.125813:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:2347:x1874704171496960:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857623.125846:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:0.0:1787857623.125868:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:0.0:1787857623.125874:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+59:2347:x1874704171496576:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857623.125899:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+59:2347:x1874704171496576:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857623.125905:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:1.0:1787857623.126750:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171496448 00000100:00100000:1.0:1787857623.126757:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171496448 00000100:00100000:1.0:1787857623.126795:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:1.0:1787857623.126802:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171496448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857623.126864:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171496448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 64us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857623.126870:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00080000:1.0:1787857623.131082:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857623.131094:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857623.131097:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787857623.790533:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787857623.830578:0:15998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 15:07:01 (1787857621) 00000100:00100000:1.0:1787857624.114552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857624.114698:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171497472 00000100:00100000:2.0:1787857624.114709:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171497472 00000100:00100000:2.0:1787857624.114791:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 588 00000100:00100000:2.0:1787857624.114804:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:19295:x1874704171497472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857624.114851:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857624.114870:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a773 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd312b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.114960:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.114975:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.114988:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115006:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115013:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115020:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115565:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a788 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115578:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115586:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857624.115597:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787857624.115743:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115751:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115763:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115770:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.115774:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115781:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115794:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:2.0:1787857624.115797:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.115802:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.115808:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a77a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787857624.115907:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857624.115948:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.118664:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.118676:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.118682:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.118687:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.118714:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.118732:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9998d8aea800) 00010000:00010000:2.0:1787857624.118735:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.118740:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.118747:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a781 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.119247:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a773 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd312b expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.119265:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a788 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd312b expref: 27 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.119273:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857624.119276:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.119278:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0a00, rc 0) 00000100:00100000:2.0:1787857624.119358:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19295:x1874704171497472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 4557us (4815us total) trans 4294967707 rc 0/0 00000100:00100000:2.0:1787857624.119368:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 588 00000100:00100000:1.0:1787857624.140443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857624.140512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857624.140551:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171497728 00000100:00100000:2.0:1787857624.140562:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171497728 00000100:00100000:2.0:1787857624.140632:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:2.0:1787857624.140644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:2348:x1874704171497728:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857624.140677:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857624.140706:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a788 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd312b expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.140729:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857624.140736:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857624.140783:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:2348:x1874704171497728:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 142us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857624.140790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:2.0:1787857624.148593:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857624.168303:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857624.173732:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857624.173870:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171498240 00000100:00100000:2.0:1787857624.173880:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171498240 00010000:00010000:2.0:1787857624.173923:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a615 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30a6 expref: 26 pid: 7656 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857624.173957:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 176 00000100:00100000:2.0:1787857624.173968:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:2349:x1874704171498240:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857624.173982:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857624.173988:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a615 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30a6 expref: 26 pid: 7656 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.174003:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a615 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30a6 expref: 26 pid: 7656 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.174026:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291300) 00010000:00010000:2.0:1787857624.174032:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2000/0xd3f183cab4a7a7ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.174054:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2000/0xd3f183cab4a7a7ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.174061:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2000/0xd3f183cab4a7a7ab lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.174077:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857624.174121:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+25:2349:x1874704171498240:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 155us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857624.174128:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 176 00010000:00010000:0.0:1787857624.184436:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3a00/0xd3f183cab4a7a7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.184453:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3a00/0xd3f183cab4a7a7b2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.184461:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3a00/0xd3f183cab4a7a7b2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.184467:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c70b3a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857624.184473:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3a00/0xd3f183cab4a7a7b2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.184481:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3a00/0xd3f183cab4a7a7b2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.184509:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80c094a7 (ffff9998d1291700) 00010000:00010000:0.0:1787857624.184512:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857624.184517:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3a00/0xd3f183cab4a7a7b2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.184523:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3a00/0xd3f183cab4a7a7b2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857624.208417:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857624.208581:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171498368 00000100:00100000:2.0:1787857624.208592:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171498368 00000100:00100000:2.0:1787857624.208649:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 592 00000100:00100000:2.0:1787857624.208659:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+59:19297:x1874704171498368:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857624.208683:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857624.208706:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3139 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.208774:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a7c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.208788:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.208799:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857624.208905:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857624.208909:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857624.208954:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.208986:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3139 expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.209003:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3139 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.209011:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aea800) 00010000:00010000:2.0:1787857624.209014:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857624.209018:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0200, rc 0) 00000100:00100000:2.0:1787857624.209085:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+60:19297:x1874704171498368:12345-192.168.204.36@tcp:101:bash.0 Request processed in 427us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857624.209091:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 592 00000100:00100000:1.0:1787857624.219550:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857624.219702:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171498496 00000100:00100000:0.0:1787857624.219734:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171498496 00000100:00100000:0.0:1787857624.219853:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 593 00000100:00100000:0.0:1787857624.219866:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+60:19297:x1874704171498496:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857624.219889:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857624.219911:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a7c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3140 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.219980:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.219994:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220005:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220020:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220027:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220033:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220203:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091e00/0xd3f183cab4a7a7dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220212:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091e00/0xd3f183cab4a7a7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220219:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091e00/0xd3f183cab4a7a7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857624.220262:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00000004:00200000:0.0:1787857624.220266:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857624.220290:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091e00/0xd3f183cab4a7a7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220302:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220308:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220315:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220321:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857624.220325:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220331:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220344:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aea800) 00010000:00010000:0.0:1787857624.220358:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857624.220362:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220368:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a7ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220381:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220395:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220401:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220405:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857624.220408:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220413:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.220420:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80c094a7 (ffff9998d5316400) 00010000:00010000:0.0:1787857624.221945:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857624.221954:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.221963:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a7d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.222018:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3140 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.222031:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091e00/0xd3f183cab4a7a7dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3140 expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.222039:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:0.0:1787857624.222042:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857624.222059:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091e00, rc 0) 00000100:00100000:1.0:1787857624.225405:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+61:19297:x1874704171498496:12345-192.168.204.36@tcp:101:bash.0 Request processed in 5530us (5860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857624.225419:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 593 00000100:00100000:0.0:1787857624.228446:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857624.228576:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171498624 00000100:00100000:2.0:1787857624.228590:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171498624 00000100:00100000:2.0:1787857624.228704:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 594 00000100:00100000:2.0:1787857624.228717:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+61:19297:x1874704171498624:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857624.228764:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857624.228793:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3147 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.228934:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.228952:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.228966:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231560:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231586:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231599:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231696:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231703:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231710:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231716:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.231720:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231729:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231743:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:2.0:1787857624.231746:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.231750:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.231756:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a7ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233155:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233164:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233171:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233178:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.233182:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233189:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233204:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff9998d8aeaf00) 00010000:00010000:2.0:1787857624.233207:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.233211:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233218:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a7f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233286:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7e3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3147 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233297:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:2.0:1787857624.233300:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.233319:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3147 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.233330:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1400, rc 0) 00000100:00100000:2.0:1787857624.233426:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+61:19297:x1874704171498624:12345-192.168.204.36@tcp:101:bash.0 Request processed in 4710us (4994us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857624.233436:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 594 00000100:00100000:2.0:1787857624.245971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857624.248449:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.248468:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.248481:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857624.248558:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857624.248563:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857624.248591:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.248622:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2000/0xd3f183cab4a7a7f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 27 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.248647:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 26 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.248655:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aea800) 00010000:00010000:2.0:1787857624.248658:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857624.248682:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1400, rc 0) 00000100:00100000:2.0:1787857624.248780:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:19298:x1874704171498752:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1190us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857624.248789:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 595 00000100:00100000:1.0:1787857624.253630:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857624.263288:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857624.263347:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171499008 00000100:00100000:1.0:1787857624.263360:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171499008 00000100:00100000:1.0:1787857624.263517:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 597 00000100:00100000:1.0:1787857624.263530:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19298:x1874704171499008:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857624.263558:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857624.263585:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a822 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd315c expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263675:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263691:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263703:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263746:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263754:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263761:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263900:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263908:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263915:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263921:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857624.263925:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263934:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263947:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:1.0:1787857624.263950:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857624.263956:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263962:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a829 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263985:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263991:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.263996:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.264000:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857624.264003:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.264010:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.264018:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff9998c53ae800) 00010000:00010000:1.0:1787857624.264020:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857624.264023:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.264028:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.264310:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a822 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd315c expref: 28 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.264324:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:1.0:1787857624.264327:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857624.264340:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a822 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd315c expref: 28 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.264352:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707c00, rc 0) 00000100:00100000:1.0:1787857624.264559:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19298:x1874704171499008:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1030us (1285us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857624.264569:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 597 00000100:00100000:1.0:1787857624.271904:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857624.272318:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171499136 00000100:00100000:2.0:1787857624.272333:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171499136 00000100:00100000:2.0:1787857624.272420:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 598 00000100:00100000:2.0:1787857624.272433:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19298:x1874704171499136:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857624.272462:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857624.272503:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a837 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3163 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.272728:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.272748:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.272764:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.272793:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.272801:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.272808:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.273083:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.273111:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.273119:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.274868:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.274890:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.274905:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.274928:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:2.0:1787857624.274932:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.274939:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.274947:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a83e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.274972:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.274978:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.274985:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.274991:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.275016:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.275024:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.275033:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff9998d8aeaf00) 00010000:00010000:2.0:1787857624.275036:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.275039:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.275045:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a845 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.275111:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a837 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3163 expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.275122:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:2.0:1787857624.275124:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.275144:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a837 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3163 expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.275154:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1a00, rc 0) 00000100:00100000:2.0:1787857624.275623:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19298:x1874704171499136:12345-192.168.204.36@tcp:101:rm.0 Request processed in 3187us (3732us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857624.275635:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 598 00000100:00100000:2.0:1787857624.297937:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171499264 00000100:00100000:2.0:1787857624.297952:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171499264 00000100:00100000:2.0:1787857624.298038:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 599 00000100:00100000:2.0:1787857624.298051:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19299:x1874704171499264:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857624.298099:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857624.298128:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a84c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd316a expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298230:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298248:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298263:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298281:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298288:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298295:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298380:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298388:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298396:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298402:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.298413:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298422:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298436:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:2.0:1787857624.298439:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.298445:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298452:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298467:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298474:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298480:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298495:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.298499:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298506:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298514:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff9998d8aeaf00) 00010000:00010000:2.0:1787857624.298517:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.298528:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298534:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a85a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298573:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a84c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd316a expref: 28 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298585:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:2.0:1787857624.298587:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.298591:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a84c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd316a expref: 28 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.298601:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1a00, rc 0) 00000100:00100000:2.0:1787857624.298690:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19299:x1874704171499264:12345-192.168.204.36@tcp:101:cp.0 Request processed in 642us (939us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857624.298699:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 599 00000100:00100000:0.0:1787857624.302657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857624.304052:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171499392 00000100:00100000:1.0:1787857624.304070:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171499392 00000100:00100000:1.0:1787857624.304164:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 600 00000100:00100000:1.0:1787857624.304174:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19299:x1874704171499392:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857624.304208:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857624.304236:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3171 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304344:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304363:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304379:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304395:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304401:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304430:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304528:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304537:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304545:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304551:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857624.304556:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304564:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304579:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:1.0:1787857624.304582:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857624.304587:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304593:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304607:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304613:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304627:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304632:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857624.304636:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304642:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304651:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff9998c53ae800) 00010000:00010000:1.0:1787857624.304653:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857624.304656:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304662:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a86f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304699:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a861 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3171 expref: 28 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304709:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:1.0:1787857624.304712:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857624.304715:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3171 expref: 28 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.304724:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707c00, rc 0) 00000100:00100000:1.0:1787857624.305077:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19299:x1874704171499392:12345-192.168.204.36@tcp:101:cp.0 Request processed in 903us (2432us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857624.305097:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 600 00000100:00100000:2.0:1787857624.315654:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171499648 00000100:00100000:2.0:1787857624.315669:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171499648 00000100:00100000:2.0:1787857624.315767:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 601 00000100:00100000:2.0:1787857624.315782:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19299:x1874704171499648:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857624.315810:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857624.315859:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a876 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3178 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.316628:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.316674:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.316690:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.316712:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.316720:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.316727:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857624.320117:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe:0x0], index 1: 0 00010000:00010000:2.0:1787857624.320398:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0000/0xd3f183cab4a7a88b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320420:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0000/0xd3f183cab4a7a88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320437:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0000/0xd3f183cab4a7a88b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320501:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320510:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320519:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320535:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.320540:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320549:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320563:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:2.0:1787857624.320566:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.320572:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320579:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7a87d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857624.320596:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000db979fa reply state 000000003fee60cd transno 4294967709 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857624.320607:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857624.320656:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a876 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3178 expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320674:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0000/0xd3f183cab4a7a88b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3178 expref: 29 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.320682:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9998d8aeac00) 00010000:00010000:2.0:1787857624.320685:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857624.320687:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0000, rc 0) 00000100:00100000:2.0:1787857624.320792:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:19299:x1874704171499648:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5013us (5850us total) trans 4294967709 rc 0/0 00000100:00100000:2.0:1787857624.320809:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 601 00010000:00010000:2.0:1787857624.326709:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.326734:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.326742:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.326749:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857624.326754:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.326763:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.326796:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff9998d8aeaf00) 00010000:00010000:2.0:1787857624.326800:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857624.326806:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.326813:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a884 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857624.327692:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171499776 00000100:00100000:0.0:1787857624.327706:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171499776 00000100:00100000:0.0:1787857624.327793:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 150 00000100:00100000:0.0:1787857624.327806:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2349:x1874704171499776:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857624.327861:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857624.327886:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd317f expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857624.327920:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857624.327948:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1787857624.327954:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857624.327965:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 8 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.327989:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 8 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.328005:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091400, rc 0) 00000100:00100000:0.0:1787857624.328085:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171499776:12345-192.168.204.36@tcp:101:cp.0 Request processed in 282us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857624.328093:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 150 00000100:00100000:1.0:1787857624.332198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857624.332922:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171499904 00000100:00100000:0.0:1787857624.332938:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171499904 00000100:00100000:0.0:1787857624.333046:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 151 00000100:00100000:0.0:1787857624.333058:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:19299:x1874704171499904:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857624.333083:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857624.333109:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3186 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.333165:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 9 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.333176:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857624.333180:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857624.333197:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3186 expref: 9 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.333243:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 9 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.333259:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 9 pid: 14028 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857624.333276:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188166656:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857624.333402:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857624.336552:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188166656:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857624.336609:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3186 expref: 9 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.336662:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090400, rc 0) 00000100:00100000:0.0:1787857624.336742:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:19299:x1874704171499904:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3685us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857624.336752:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 151 00000100:00100000:2.0:1787857624.339713:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171500032 00000100:00100000:2.0:1787857624.339727:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171500032 00010000:00010000:2.0:1787857624.339796:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 9 pid: 14028 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857624.339920:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 177 00000100:00100000:2.0:1787857624.339932:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171500032:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857624.339957:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857624.339991:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 9 pid: 14028 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.340009:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 9 pid: 14028 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.340042:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e800fca1/0xd3f183cab4a7a899 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd317f expref: 9 pid: 14028 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.340066:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857624.340071:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857624.340082:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3186 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.340096:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3186 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857624.340150:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3186 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857624.340168:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188166784:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857624.340427:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f72950c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857624.344779:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188166784:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857624.344850:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857624.344931:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171500032:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 4999us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857624.344945:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 177 00000100:00100000:0.0:1787857624.350014:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857624.402937:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171500416 00000100:00100000:1.0:1787857624.402951:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171500416 00000100:00100000:1.0:1787857624.403036:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 602 00000100:00100000:1.0:1787857624.403049:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+61:19302:x1874704171500416:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857624.403079:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857624.403111:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a8a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd318d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403232:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403250:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403263:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403279:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403286:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403293:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403425:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a8bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403456:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a8bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403464:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a8bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857624.403519:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 158 00000004:00200000:1.0:1787857624.403524:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857624.403547:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a8bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403561:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a8bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403570:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403577:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403584:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403590:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857624.403595:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403604:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403617:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:1.0:1787857624.403627:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857624.403634:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403641:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a8ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403659:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403665:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403672:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403677:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857624.403680:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403687:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403695:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff9998c53ae800) 00010000:00010000:1.0:1787857624.403697:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857624.403700:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403706:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a8b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403741:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a8a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd318d expref: 63 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403762:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706200/0xd3f183cab4a7a8bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd318d expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857624.403770:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9998d8aeac00) 00010000:00010000:1.0:1787857624.403773:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857624.403776:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706200, rc 0) 00000100:00100000:1.0:1787857624.404303:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+62:19302:x1874704171500416:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1251us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857624.404312:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 602 00000100:00100000:1.0:1787857624.410714:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857624.410864:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171500544 00000100:00100000:0.0:1787857624.410877:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171500544 00000100:00100000:0.0:1787857624.410957:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 152 00000100:00100000:0.0:1787857624.410971:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+8:2349:x1874704171500544:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857624.410995:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857624.411019:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be7ac141/0xd3f183cab4a7a8c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3194 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857624.411111:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188166912:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857624.411343:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857624.419592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000004:00200000:0.0:1787857624.420682:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00000004:00200000:0.0:1787857624.420688:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857624.420717:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2600/0xd3f183cab4a7a8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.420755:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3a00/0xd3f183cab4a7a8ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd319b expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.420914:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2600/0xd3f183cab4a7a8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd319b expref: 63 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.420941:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9998d5316000) 00010000:00010000:0.0:1787857624.420945:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857624.420950:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c70b2600, rc 0) 00000100:00100000:0.0:1787857624.421088:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+63:19302:x1874704171500672:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1151us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857624.421098:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 603 00000100:00100000:1.0:1787857624.425258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857624.425542:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171500800 00000100:00100000:0.0:1787857624.425554:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171500800 00000100:00100000:0.0:1787857624.425670:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 153 00000100:00100000:0.0:1787857624.425683:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+8:2350:x1874704171500800:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857624.425707:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857624.425732:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7a8d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31a2 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857624.425850:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188167040:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857624.425962:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857624.428722:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188167040:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857624.428792:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7a8d8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31a2 expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.428864:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7a8d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31a2 expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857624.428881:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091a00, rc 0) 00000100:00100000:0.0:1787857624.428978:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+8:2350:x1874704171500800:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3297us (3854us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857624.428989:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 153 00000100:00100000:0.0:1787857624.434469:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171501056 00000100:00100000:0.0:1787857624.434482:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171501056 00000100:00100000:0.0:1787857624.434560:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 604 00000100:00100000:0.0:1787857624.434572:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+63:19302:x1874704171501056:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857624.435411:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 136 off10096 00000100:00100000:0.0:1787857624.435608:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+63:19302:x1874704171501056:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 1034us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857624.435620:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 604 00010000:00010000:0.0:1787857624.832015:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857624.942057:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188167168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857624.942143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857624.942252:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188167168 00000100:00100000:2.0:1787857624.942261:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188167168 00000100:00080000:1.0:1787857624.942378:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857624.943011:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787857624.943038:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188167168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857624.943076:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857624.943149:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188167168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857624.943156:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787857624.943250:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188167168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857625.344685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857625.354036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857625.354173:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171501440 00000100:00100000:0.0:1787857625.354182:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171501440 00000100:00100000:0.0:1787857625.354243:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 606 00000100:00100000:0.0:1787857625.354254:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:19312:x1874704171501440:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857625.354277:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857625.354301:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a8df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31a9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857625.354420:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7a8e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857625.354437:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7a8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857625.354451:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7a8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857625.354493:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 158 00010000:00010000:0.0:1787857625.354626:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7a8df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31a9 expref: 33 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857625.354642:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7a8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31a9 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857625.354651:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9998d8aeac00) 00010000:00010000:0.0:1787857625.354654:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857625.354657:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090600, rc 0) 00000100:00100000:0.0:1787857625.354738:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19312:x1874704171501440:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 486us (716us total) trans 4294967711 rc 0/0 00000100:00100000:0.0:1787857625.354746:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 606 00000100:00100000:2.0:1787857625.367732:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857625.367781:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171501696 00000100:00100000:2.0:1787857625.367793:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171501696 00000100:00100000:2.0:1787857625.367894:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:2.0:1787857625.367906:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:2347:x1874704171501696:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857625.367924:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857625.367957:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7a8e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31a9 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.367978:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9998d8aeac00) 00010000:00010000:2.0:1787857625.367996:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857625.368073:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2347:x1874704171501696:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 169us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857625.368082:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:1.0:1787857625.378038:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171501568 00000100:00100000:1.0:1787857625.378050:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171501568 00000100:00100000:1.0:1787857625.378117:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 154 00000100:00100000:1.0:1787857625.378130:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171501568:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857625.378197:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000054bc5509/0xd3f183cab4a7a8f4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857625.378220:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3186 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857625.378248:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787857625.378254:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857625.378260:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054bc5509/0xd3f183cab4a7a8f4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857625.378301:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3186 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857625.378316:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7a8a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3186 expref: 8 pid: 8490 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857625.378333:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa82940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188167424:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857625.378426:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6600 going to sleep for 11 seconds 00000100:00100000:0.0:1787857625.382934:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa82940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188167424:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857625.382962:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054bc5509/0xd3f183cab4a7a8f4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857625.398742:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857625.399340:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054bc5509/0xd3f183cab4a7a8f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.399357:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054bc5509/0xd3f183cab4a7a8f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857625.399403:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171501568:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 21277us (21502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857625.399410:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 154 00000100:00100000:1.0:1787857625.405104:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857625.405377:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171502208 00000100:00100000:3.0:1787857625.405387:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171502208 00000100:00100000:3.0:1787857625.405449:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 607 00000100:00100000:3.0:1787857625.405459:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:19312:x1874704171502208:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857625.405573:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:19312:x1874704171502208:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 115us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857625.405581:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 607 00000100:00100000:2.0:1787857625.414350:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857625.414405:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171502336 00000100:00100000:2.0:1787857625.414415:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171502336 00000100:00100000:2.0:1787857625.414483:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 155 00000100:00100000:2.0:1787857625.414493:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171502336:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857625.414511:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857625.414533:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7c81858/0xd3f183cab4a7a8fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31b0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857625.414560:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 158, mtime: 0x6a908ad7, atime: 0x0, ctime: 0x6a908ad7, blocks: 0x1 00010000:00010000:2.0:1787857625.414581:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787857625.414585:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857625.414594:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c81858/0xd3f183cab4a7a8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b0 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.414612:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7c81858/0xd3f183cab4a7a8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b0 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.414624:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1200, rc 0) 00000100:00100000:2.0:1787857625.414686:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171502336:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 195us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857625.414694:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 155 00000100:00100000:1.0:1787857625.421051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857625.421314:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171502592 00000100:00100000:0.0:1787857625.421324:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171502592 00000100:00100000:0.0:1787857625.421378:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 608 00000100:00100000:0.0:1787857625.421387:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:19312:x1874704171502592:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857625.421511:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:19312:x1874704171502592:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 124us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857625.421519:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 608 00000100:00100000:0.0:1787857625.427388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857625.432420:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171502720 00000100:00100000:2.0:1787857625.432436:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171502720 00002000:00100000:2.0:1787857625.432499:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe:0x0] (0->4095) req@ffff9998dabb3480 x1874704171502720/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:271/0 lens 488/0 e 0 to 0 dl 1787857636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857625.432512:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dabb3480 with x1874704171502720 ext(0->4095) 00002000:00010000:2.0:1787857625.432519:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998dabb3480 00000100:00100000:2.0:1787857625.432596:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:2.0:1787857625.432605:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171502720:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787857625.432841:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171502720:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 208us (5435us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857625.432851:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 54 00002000:00100000:2.0:1787857625.432859:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe:0x0] (0->4095) req@ffff9998dabb3480 x1874704171502720/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:271/0 lens 488/4536 e 0 to 0 dl 1787857636 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857625.432867:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dabb3480 with x1874704171502720 ext(0->4095) 00002000:00010000:2.0:1787857625.432870:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998dabb3480 00000100:00100000:3.0:1787857625.443535:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857625.443613:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171502848 00000100:00100000:2.0:1787857625.443622:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171502848 00000100:00100000:2.0:1787857625.443686:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 609 00000100:00100000:2.0:1787857625.443696:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:19312:x1874704171502848:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857625.443717:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857625.443809:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a902 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31b7 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.443913:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.443938:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.443951:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.444115:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7a902 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 33 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.444134:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 32 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.444142:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9998d8aeac00) 00010000:00010000:2.0:1787857625.444145:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857625.444149:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0600, rc 0) 00000100:00100000:2.0:1787857625.444666:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19312:x1874704171502848:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 969us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857625.444675:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 609 00000100:00100000:3.0:1787857625.453924:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857625.454174:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171502976 00000100:00100000:2.0:1787857625.454185:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171502976 00000100:00100000:2.0:1787857625.454258:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 610 00000100:00100000:2.0:1787857625.454269:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19312:x1874704171502976:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857625.454304:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xf:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857625.454424:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19312:x1874704171502976:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 157us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857625.454431:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 610 00000100:00100000:2.0:1787857625.457744:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857625.457809:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171503104 00000100:00100000:3.0:1787857625.457841:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171503104 00000100:00100000:3.0:1787857625.457948:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 156 00000100:00100000:3.0:1787857625.457961:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171503104:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857625.458010:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458030:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857625.458033:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857625.458047:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458062:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458097:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458107:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458115:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458123:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c70b2c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857625.458127:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458149:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458165:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.458174:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006630fdcd/0xd3f183cab4a7a910 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857625.458273:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171503104:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 314us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857625.458282:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 156 00000100:00100000:3.0:1787857625.460338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857625.460507:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171503360 00000100:00100000:2.0:1787857625.460517:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171503360 00000100:00100000:2.0:1787857625.460595:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 611 00000100:00100000:2.0:1787857625.460606:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19312:x1874704171503360:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857625.460683:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.460702:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 32 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.460711:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.460759:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 32 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.460773:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 32 pid: 7656 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857625.460788:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188167552:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857625.460887:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857625.464187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857625.464221:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171503488 00000100:00100000:2.0:1787857625.464229:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171503488 00010000:00010000:2.0:1787857625.464274:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 33 pid: 7656 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857625.464312:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 179 00000100:00100000:2.0:1787857625.464323:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d0398850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:2349:x1874704171503488:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857625.464351:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857625.464359:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 33 pid: 7656 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.464373:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 33 pid: 7656 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.464398:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9998d8aeac00) 00010000:00010000:2.0:1787857625.464404:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.464414:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.464423:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857625.464443:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857625.464506:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d0398850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:2349:x1874704171503488:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 185us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857625.464513:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 179 00010000:00010000:3.0:1787857625.464791:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a909 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31b7 expref: 32 pid: 7656 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857625.464809:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188167552:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857625.464846:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.464856:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.464862:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.465068:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.465077:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.465085:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.465093:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857625.465097:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.465114:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.465126:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9998d8aeac00) 00010000:00010000:3.0:1787857625.465129:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857625.465133:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857625.465140:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a917 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857625.465284:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19312:x1874704171503360:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 4679us (4953us total) trans 4294967712 rc 0/0 00000040:00080000:2.0:1787857625.465729:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857625.465735:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857625.466274:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857625.466283:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857625.467327:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 611 00000100:00100000:3.0:1787857625.469728:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857625.475382:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171503744 00000100:00100000:1.0:1787857625.475394:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171503744 00000100:00100000:1.0:1787857625.475461:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 128 00000100:00100000:1.0:1787857625.475483:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19312:x1874704171503744:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857625.476395:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:19312:x1874704171503744:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 911us (6672us total) trans 4294967713 rc 0/0 00000100:00100000:1.0:1787857625.476406:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 128 00010000:00010000:2.0:1787857625.839504:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857626.478428:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188167936:0@lo:400:kworker.0 00000100:00100000:2.0:1787857626.478521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857626.478813:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188167936 00000100:00100000:2.0:1787857626.478842:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188167936 00000100:00100000:2.0:1787857626.478900:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787857626.478921:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188167936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857626.478976:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188167936:12345-0@lo:400:kworker.0 Request processed in 68us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857626.478984:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787857626.479025:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188167936:0@lo:400:kworker.0 00000100:00100000:2.0:1787857626.479059:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857626.479065:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188168064:0@lo:400:kworker.0 00000100:00100000:2.0:1787857626.479092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857626.480007:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188167680:0@lo:400:kworker.0 00000100:00100000:0.0:1787857626.480052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857626.480079:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188168192:0@lo:400:kworker.0 00000100:00100000:0.0:1787857626.480103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857626.480126:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787857626.480133:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188167808:0@lo:400:kworker.0 00000100:00100000:0.0:1787857626.480225:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857626.480241:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188168320:0@lo:400:kworker.0 00000100:00100000:0.0:1787857626.480261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857626.480290:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188168192 00000100:00100000:0.0:1787857626.480295:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188168192 00000100:00100000:0.0:1787857626.480331:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188167808 00000100:00100000:0.0:1787857626.480333:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188167808 00000100:00100000:0.0:1787857626.480349:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787857626.480357:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188168192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787857626.481855:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857626.481878:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188168064 00000100:00100000:3.0:1787857626.481887:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188168064 00000100:00100000:3.0:1787857626.481956:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188168320 00000100:00100000:3.0:1787857626.481959:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188168320 00000100:00100000:3.0:1787857626.481987:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787857626.481998:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188168064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857626.482086:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787857626.482107:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188168320:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787857626.482305:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857626.482309:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857626.482339:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787857626.482347:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188167808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857626.482421:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188168192:12345-0@lo:400:kworker.0 Request processed in 2064us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857626.482429:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787857626.482501:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188168192:0@lo:400:kworker.0 00000100:00100000:0.0:1787857626.482632:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188167680 00000100:00100000:0.0:1787857626.482636:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188167680 00000100:00100000:0.0:1787857626.482663:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787857626.482670:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188167680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857626.483284:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188168320:12345-0@lo:400:kworker.0 Request processed in 1177us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857626.483293:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787857626.483334:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188168320:0@lo:400:kworker.0 00000100:00100000:3.0:1787857626.483420:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188168064:12345-0@lo:400:kworker.0 Request processed in 1423us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857626.483427:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787857626.483469:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188168064:0@lo:400:kworker.0 00000100:00100000:2.0:1787857626.485376:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188167808:12345-0@lo:400:kworker.0 Request processed in 3021us (5142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857626.485390:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787857626.485516:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188167808:0@lo:400:kworker.0 00000100:00100000:0.0:1787857626.486327:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188167680:12345-0@lo:400:kworker.0 Request processed in 3655us (6271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857626.486338:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787857626.486351:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188167680:0@lo:400:kworker.0 00000001:00080000:0.0:1787857626.544514:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967329 is committed 00000001:00080000:0.0:1787857626.595478:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967711 is committed 00000001:00080000:0.0:1787857626.595502:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967713 is committed 00000001:00080000:0.0:1787857626.595542:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967708 is committed 00010000:00010000:2.0:1787857626.863017:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857626.992159:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857626.992400:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188168448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857626.992484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857626.992580:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188168448 00000100:00100000:0.0:1787857626.992587:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188168448 00000100:00100000:0.0:1787857626.992640:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787857626.992648:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188168448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857626.992685:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857626.992740:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188168448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857626.992748:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787857626.992852:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188168448:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787857627.338947:0:16102:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857627.338958:0:16102:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857627.339091:0:16102:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 3 00000040:00080000:1.0:1787857627.339101:0:16102:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857627.421759:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857627.422308:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171503872 00000100:00100000:3.0:1787857627.422318:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171503872 00000100:00100000:3.0:1787857627.422389:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 157 00000100:00100000:3.0:1787857627.422397:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+8:2349:x1874704171503872:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857627.422415:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857627.422444:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d0939d2/0xd3f183cab4a7a91e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31be expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857627.422470:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787857627.422475:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857627.422484:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0939d2/0xd3f183cab4a7a91e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31be expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857627.422503:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d0939d2/0xd3f183cab4a7a91e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31be expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857627.422517:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c70b3a00, rc 0) 00000100:00100000:3.0:1787857627.422568:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171503872:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 172us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857627.422575:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 157 00000100:00080000:0.0:1787857627.424146:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857627.443600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857627.443679:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171504128 00000100:00100000:2.0:1787857627.443689:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171504128 00000100:00100000:2.0:1787857627.443778:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 612 00000100:00100000:2.0:1787857627.443789:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+62:19322:x1874704171504128:12345-192.168.204.36@tcp:58:lfs.0 00000100:00100000:2.0:1787857627.443943:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+62:19322:x1874704171504128:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 156us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857627.443951:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 612 00000100:00080000:3.0:1787857627.444411:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787857627.503023:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857627.503032:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857627.505588:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857627.505606:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857627.898236:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857628.240325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857628.240373:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857628.240428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857628.240442:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171504640 00000100:00100000:1.0:1787857628.240453:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171504640 00000100:00100000:3.0:1787857628.240463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857628.240488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857628.240519:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171504896 00000100:00100000:3.0:1787857628.240520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857628.240526:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171504896 00000100:00100000:3.0:1787857628.240556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857628.240560:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171504512 00000100:00100000:1.0:1787857628.240565:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171504512 00000100:00100000:3.0:1787857628.240576:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171505024 00000100:00100000:3.0:1787857628.240582:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171505024 00000100:00100000:1.0:1787857628.240593:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 224 00000100:00100000:1.0:1787857628.240605:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171504640:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857628.240615:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 225 00000100:00100000:3.0:1787857628.240626:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2349:x1874704171504896:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857628.240693:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171504640:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 90us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857628.240702:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 224 00000100:00100000:0.0:1787857628.240713:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171504384 00000100:00100000:0.0:1787857628.240718:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171504384 00000100:00100000:1.0:1787857628.240731:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 226 00000100:00100000:1.0:1787857628.240741:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2349:x1874704171504512:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857628.240755:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171504768 00000100:00100000:0.0:1787857628.240760:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171504768 00000100:00100000:0.0:1787857628.240785:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:0.0:1787857628.240793:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+62:2349:x1874704171504384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857628.242484:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2349:x1874704171504896:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1854us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857628.242495:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 225 00000100:00100000:3.0:1787857628.242524:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 227 00000100:00100000:3.0:1787857628.242536:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171505024:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857628.242575:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171505024:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 43us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857628.242582:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 227 00000100:00100000:3.0:1787857628.242609:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171504256 00000100:00100000:3.0:1787857628.242615:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171504256 00000100:00100000:3.0:1787857628.242667:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 344 00000100:00100000:3.0:1787857628.242674:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171504256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857628.242701:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171504256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857628.242707:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 344 00000100:00100000:3.0:1787857628.243033:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 271 00000100:00100000:3.0:1787857628.243042:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:2349:x1874704171504768:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857628.243078:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:2349:x1874704171504768:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857628.243092:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 271 00000100:00080000:3.0:1787857628.243113:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857628.243120:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857628.243123:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857628.243547:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2349:x1874704171504512:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 2741us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857628.243558:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 226 00000100:00100000:0.0:1787857628.244611:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+62:2349:x1874704171504384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 3812us (4290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857628.244623:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 270 00000040:00080000:1.0:1787857628.355256:0:16153:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857628.355270:0:16153:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857628.355382:0:16153:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 3 00000040:00080000:1.0:1787857628.355391:0:16153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857628.913043:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857629.933981:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857630.062884:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188168576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857630.062971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857630.063017:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188168576 00000100:00100000:0.0:1787857630.063025:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188168576 00000100:00080000:3.0:1787857630.063104:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857630.063110:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787857630.063121:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188168576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857630.063172:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857630.063217:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188168576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857630.063224:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787857630.063307:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188168576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857630.960503:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857631.599423:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188168704:0@lo:400:kworker.0 00000100:00100000:2.0:1787857631.599526:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857631.599560:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188169088:0@lo:400:kworker.0 00000100:00100000:0.0:1787857631.599600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857631.599635:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188169088 00000100:00100000:0.0:1787857631.599646:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188169088 00000100:00100000:0.0:1787857631.599708:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787857631.599720:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188169088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857631.599795:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188169088:12345-0@lo:400:kworker.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857631.599803:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787857631.599916:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188168704 00000100:00100000:3.0:1787857631.599921:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188168704 00000100:00100000:3.0:1787857631.599961:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787857631.599969:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188168704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857631.600196:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188168704:12345-0@lo:400:kworker.0 Request processed in 227us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857631.600203:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787857631.600591:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188169088:0@lo:400:kworker.0 00000100:00100000:1.0:1787857631.600620:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857631.600628:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188168960:0@lo:400:kworker.0 00000100:00100000:1.0:1787857631.600664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857631.600853:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188168960 00000100:00100000:3.0:1787857631.600859:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188168960 00000100:00100000:3.0:1787857631.600919:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787857631.600928:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188168960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857631.600977:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188168960:12345-0@lo:400:kworker.0 Request processed in 50us (311us total) trans 0 rc 0/0 00000100:00080000:0.0:1787857631.601195:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857631.601407:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787857631.601455:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188168960:0@lo:400:kworker.0 00000100:00100000:2.0:1787857631.601583:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188168704:0@lo:400:kworker.0 00000100:00100000:2.0:1787857631.601606:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188169216:0@lo:400:kworker.0 00000100:00100000:2.0:1787857631.601686:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857631.601752:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857631.601760:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188168832:0@lo:400:kworker.0 00000100:00100000:2.0:1787857631.601797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857631.601863:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188169344:0@lo:400:kworker.0 00000100:00100000:1.0:1787857631.601893:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188169216 00000100:00100000:2.0:1787857631.601896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857631.601903:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188169216 00000100:00100000:1.0:1787857631.601970:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188168832 00000100:00100000:1.0:1787857631.601974:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188168832 00000100:00100000:0.0:1787857631.602192:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787857631.602205:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188169216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857631.602299:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188169216:12345-0@lo:400:kworker.0 Request processed in 98us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857631.602306:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:0.0:1787857631.602326:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857631.602369:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188169216:0@lo:400:kworker.0 00000100:00100000:3.0:1787857631.602902:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188169344 00000100:00100000:3.0:1787857631.602909:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188169344 00000100:00100000:3.0:1787857631.602955:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787857631.602963:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188169344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857631.603492:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787857631.603502:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188168832:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787857631.603690:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857631.604097:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188168832:12345-0@lo:400:kworker.0 Request processed in 595us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857631.604105:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787857631.604106:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188168832:0@lo:400:kworker.0 00000100:00100000:0.0:1787857631.604122:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188169344:0@lo:400:kworker.0 00000100:00100000:3.0:1787857631.604374:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188169344:12345-0@lo:400:kworker.0 Request processed in 1411us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857631.604383:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00010000:00010000:2.0:1787857631.983233:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857632.120885:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857632.120917:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188169472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857632.121030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857632.122774:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188169472 00000100:00100000:1.0:1787857632.122791:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188169472 00000100:00100000:1.0:1787857632.122920:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787857632.122932:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188169472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857632.123001:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857632.123312:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188169472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 382us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857632.123322:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787857632.123464:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188169472:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857633.006333:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857633.133416:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857633.134040:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171505152 00000100:00100000:0.0:1787857633.134054:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171505152 00000100:00100000:0.0:1787857633.134212:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 613 00000100:00100000:0.0:1787857633.134225:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:19295:x1874704171505152:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787857633.134395:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:19295:x1874704171505152:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 172us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857633.134403:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 613 00000100:00080000:1.0:1787857633.134455:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857633.138454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857633.138596:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171505408 00000100:00100000:0.0:1787857633.138609:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171505408 00000100:00100000:0.0:1787857633.138682:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 129 00000100:00100000:0.0:1787857633.138693:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+26:19295:x1874704171505408:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857633.139400:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19295:x1874704171505408:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 704us (958us total) trans 4294967714 rc 0/0 00000100:00100000:0.0:1787857633.139411:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 129 00000100:00100000:3.0:1787857633.360010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857633.360073:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857633.360094:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857633.360217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857633.360249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857633.360386:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171505536 00000100:00100000:1.0:1787857633.360401:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171505536 00000100:00100000:1.0:1787857633.360473:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 346 00000100:00100000:1.0:1787857633.360485:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171505536:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857633.360607:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171505536:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 123us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857633.360616:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 346 00000100:00100000:3.0:1787857633.362953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857633.363589:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171505792 00000100:00100000:2.0:1787857633.363605:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171505792 00000100:00100000:2.0:1787857633.363697:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171506048 00000100:00100000:2.0:1787857633.363701:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171506048 00000100:00100000:2.0:1787857633.363729:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171505920 00000100:00100000:2.0:1787857633.363732:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171505920 00000100:00100000:2.0:1787857633.363757:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 230 00000100:00100000:2.0:1787857633.363768:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171505792:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857633.363885:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171505792:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 119us (3811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857633.363915:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 230 00000100:00100000:2.0:1787857633.364227:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 231 00000100:00100000:2.0:1787857633.364238:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2347:x1874704171506048:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857633.364485:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2347:x1874704171506048:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857633.364494:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 231 00000100:00100000:2.0:1787857633.364514:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00100000:2.0:1787857633.364522:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171505920:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857633.364554:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171505920:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 34us (4304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857633.364561:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00080000:2.0:1787857633.364594:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857633.364600:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857633.364852:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171505664 00000100:00100000:2.0:1787857633.364859:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171505664 00000100:00100000:2.0:1787857633.364908:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 275 00000100:00100000:2.0:1787857633.364915:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+62:2347:x1874704171505664:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857633.364956:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+62:2347:x1874704171505664:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (4739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857633.364963:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 275 00000100:00080000:2.0:1787857633.364978:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857633.365636:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171506176 00000100:00100000:2.0:1787857633.365642:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171506176 00000100:00100000:2.0:1787857633.365694:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:2.0:1787857633.365701:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171506176:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857633.365758:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171506176:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 57us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857633.365766:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00080000:3.0:1787857633.366003:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787857633.646944:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857633.646962:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857633.647384:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 2 00000040:00080000:0.0:1787857633.647395:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857634.030752:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857634.748092:0:16350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10c: Check forbidden archive ========== 15:07:12 (1787857632) 00000100:00100000:3.0:1787857634.972344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857634.972608:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171506432 00000100:00100000:1.0:1787857634.972621:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171506432 00000100:00100000:1.0:1787857634.972708:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 614 00000100:00100000:1.0:1787857634.972721:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19933:x1874704171506432:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857634.972757:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857634.972785:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a925 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31c5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.972941:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.972962:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.972981:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.973019:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.973027:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.973034:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.974133:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a93a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.974155:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a93a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.974165:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a93a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857634.974181:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787857634.976565:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976586:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976595:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976601:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857634.976606:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976635:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976667:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:1.0:1787857634.976671:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857634.976677:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976684:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a92c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976703:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976709:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976715:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976720:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857634.976722:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976728:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976736:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9998c53ae800) 00010000:00010000:1.0:1787857634.976738:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857634.976741:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.976756:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a933 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.979459:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7a925 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31c5 expref: 30 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.979501:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a93a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31c5 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857634.979512:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857634.979515:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857634.979519:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00100000:1.0:1787857634.979630:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19933:x1874704171506432:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6910us (7300us total) trans 4294967715 rc 0/0 00000100:00100000:1.0:1787857634.979651:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 614 00000100:00100000:2.0:1787857634.989930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857634.990683:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171506560 00000100:00100000:1.0:1787857634.990698:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171506560 00000100:00100000:1.0:1787857634.990781:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 615 00000100:00100000:1.0:1787857634.990794:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19933:x1874704171506560:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787857634.990969:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19933:x1874704171506560:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 176us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857634.990980:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 615 00000100:00100000:3.0:1787857634.991224:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857634.991946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171506688 00000100:00100000:1.0:1787857634.991956:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171506688 00000100:00100000:1.0:1787857634.992144:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:1.0:1787857634.993875:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2349:x1874704171506688:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857634.994007:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857634.994051:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7a93a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31c5 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857634.994077:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:0.0:1787857634.994083:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857634.994343:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:2349:x1874704171506688:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2188us (3362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857634.994375:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:3.0:1787857634.994532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857634.995461:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171506944 00000100:00100000:0.0:1787857634.995475:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171506944 00000100:00100000:0.0:1787857634.995545:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 616 00000100:00100000:0.0:1787857634.995556:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+62:19934:x1874704171506944:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:0.0:1787857634.995630:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857634.995721:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a7c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3139 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857634.995746:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aea800) 00010000:00010000:0.0:1787857634.995751:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857634.996115:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857634.996131:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 27 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857634.996712:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857634.996764:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 27 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857634.996781:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 27 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857634.996798:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188169600:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857634.996960:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0ec8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857635.007923:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188169600:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857635.007966:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857635.008229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.008335:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171507072 00000100:00100000:0.0:1787857635.008345:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171507072 00010000:00010000:0.0:1787857635.008426:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 28 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787857635.008427:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857635.008479:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 180 00000100:00100000:0.0:1787857635.008491:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:2350:x1874704171507072:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857635.008512:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857635.008520:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 28 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.008534:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 28 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.008567:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7a7ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd314e expref: 28 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.008588:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aea800) 00010000:00010000:0.0:1787857635.008594:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.008605:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.008636:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.008679:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857635.008753:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:2350:x1874704171507072:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 264us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857635.008763:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 180 00010000:00010000:2.0:1787857635.009021:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.009030:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.009063:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.009074:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.009083:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857635.011910:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 512 00010000:00010000:2.0:1787857635.011934:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.011948:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.011957:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.011964:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857635.011989:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.011999:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.012020:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aea800) 00010000:00010000:2.0:1787857635.012024:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.012030:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.012037:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a948 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857635.012062:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006851bdff reply state 00000000e69b1878 transno 4294967716 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857635.012071:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857635.012220:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+63:19934:x1874704171506944:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 16657us (17681us total) trans 4294967716 rc 0/0 00000100:00100000:2.0:1787857635.012231:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 616 00010000:00010000:0.0:1787857635.015665:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.015688:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.015698:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.015705:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857635.015711:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.015720:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.015743:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843a253e (ffff9998d8aeab00) 00010000:00010000:0.0:1787857635.015747:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.015754:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.015761:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7a94f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857635.020736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.020894:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171507200 00000100:00100000:0.0:1787857635.020908:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171507200 00000100:00100000:0.0:1787857635.021022:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 617 00000100:00100000:0.0:1787857635.021035:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+62:19935:x1874704171507200:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857635.021080:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857635.021113:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31cc expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.021217:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7a95d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.021235:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7a95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.021251:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7a95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857635.021351:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857635.021356:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000100:00080000:3.0:1787857635.021571:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1787857635.021746:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7a95d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.021779:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31cc expref: 64 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.021801:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7a95d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31cc expref: 63 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.021810:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:0.0:1787857635.021877:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857635.021882:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090a00, rc 0) 00000100:00100000:0.0:1787857635.021967:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+63:19935:x1874704171507200:12345-192.168.204.36@tcp:101:bash.0 Request processed in 933us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857635.022445:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 617 00000100:00100000:2.0:1787857635.025668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857635.025754:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171507328 00000100:00100000:1.0:1787857635.025768:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171507328 00000100:00100000:1.0:1787857635.025877:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 618 00000100:00100000:1.0:1787857635.025891:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+63:19935:x1874704171507328:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857635.025931:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857635.025961:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31d3 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026051:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026069:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026084:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026103:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026111:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026118:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026577:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a979 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026588:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026617:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857635.026675:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 512 00000004:00200000:1.0:1787857635.026680:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857635.026709:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026723:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026730:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026738:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026746:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857635.026750:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026759:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026774:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:1.0:1787857635.026777:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857635.026783:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026790:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a96b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026873:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026881:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026888:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026893:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857635.026896:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026903:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026972:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843a253e (ffff9998c53ae800) 00010000:00010000:1.0:1787857635.026976:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857635.026980:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.026987:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a972 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.027030:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31d3 expref: 65 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.027045:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707600/0xd3f183cab4a7a979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31d3 expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.027066:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:1.0:1787857635.027068:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857635.027071:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707600, rc 0) 00000100:00100000:1.0:1787857635.027388:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+64:19935:x1874704171507328:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1498us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857635.027397:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 618 00000100:00100000:3.0:1787857635.031677:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857635.036293:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171507456 00000100:00100000:2.0:1787857635.036314:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171507456 00000100:00100000:2.0:1787857635.036465:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 619 00000100:00100000:2.0:1787857635.036479:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+64:19935:x1874704171507456:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857635.036511:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857635.036543:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a980 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31da expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.036855:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.036874:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.036889:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.036909:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.036923:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.036930:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037124:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037134:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037141:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037148:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857635.037152:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037172:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037313:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:2.0:1787857635.037317:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.037324:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037331:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037348:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037354:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037360:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037366:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857635.037369:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037375:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037383:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff9998d8aea800) 00010000:00010000:2.0:1787857635.037386:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.037389:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037406:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a98e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037454:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a980 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31da expref: 65 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037466:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:2.0:1787857635.037469:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.037473:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31da expref: 65 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.037483:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0e00, rc 0) 00000100:00100000:2.0:1787857635.037709:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+64:19935:x1874704171507456:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1232us (6045us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857635.037718:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 619 00010000:00010000:2.0:1787857635.054148:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857635.054767:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857635.054925:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171507584 00000100:00100000:2.0:1787857635.054938:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171507584 00000100:00100000:2.0:1787857635.055017:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 620 00000100:00100000:2.0:1787857635.055028:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19936:x1874704171507584:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857635.055052:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857635.055077:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31e1 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.055170:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.055209:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.055224:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857635.055329:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857635.055334:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857635.055365:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.055396:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.055421:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 28 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.055431:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:2.0:1787857635.055434:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857635.055439:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1600, rc 0) 00000100:00100000:2.0:1787857635.056061:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:19936:x1874704171507584:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1029us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857635.056072:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 620 00000100:00100000:0.0:1787857635.061628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857635.061757:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171507712 00000100:00100000:2.0:1787857635.061771:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171507712 00000100:00100000:2.0:1787857635.061880:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 621 00000100:00100000:2.0:1787857635.061893:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:19936:x1874704171507712:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857635.061933:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857635.061977:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a9a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31e8 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062064:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062083:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062098:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062116:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062124:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062131:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062463:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a9b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062474:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062481:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857635.062593:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 512 00000004:00200000:2.0:1787857635.062599:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857635.062628:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062721:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062728:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062735:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062741:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857635.062745:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062754:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062771:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:2.0:1787857635.062774:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.062779:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062786:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062803:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062810:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062886:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062898:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857635.062902:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062908:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062917:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843a253e (ffff9998d8aea800) 00010000:00010000:2.0:1787857635.062920:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.062922:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062928:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062977:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a9a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e8 expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.062995:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1a00/0xd3f183cab4a7a9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e8 expref: 29 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.063004:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:2.0:1787857635.063006:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857635.063009:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1a00, rc 0) 00000100:00100000:2.0:1787857635.063104:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19936:x1874704171507712:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1213us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857635.063113:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 621 00000100:00100000:3.0:1787857635.067582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857635.072463:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171507840 00000100:00100000:1.0:1787857635.072491:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171507840 00000100:00100000:1.0:1787857635.072614:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 622 00000100:00100000:1.0:1787857635.072630:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19936:x1874704171507840:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857635.072665:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857635.072715:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a9bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31ef expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.072838:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.072858:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.072876:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.072897:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.072906:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.072948:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.073041:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.074868:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.074899:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.074910:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857635.074917:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.074929:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.074957:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:1.0:1787857635.074960:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857635.074966:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.074975:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7a9c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.075005:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.075014:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.075046:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.075556:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857635.075560:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.075569:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.075581:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff9998c53ae800) 00010000:00010000:1.0:1787857635.075584:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857635.075755:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.075763:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7a9cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.076305:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a9bf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31ef expref: 30 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.076321:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:1.0:1787857635.076324:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857635.076327:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7a9bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31ef expref: 30 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.076340:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706600, rc 0) 00000100:00100000:1.0:1787857635.076470:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19936:x1874704171507840:12345-192.168.204.36@tcp:101:rm.0 Request processed in 3841us (8969us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857635.076501:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 622 00000100:00100000:3.0:1787857635.081898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.081954:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171507968 00000100:00100000:0.0:1787857635.081969:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171507968 00000100:00100000:0.0:1787857635.082060:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 623 00000100:00100000:0.0:1787857635.082074:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19936:x1874704171507968:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857635.082108:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857635.082142:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7a9d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31f6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082250:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082271:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082301:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082321:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082330:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082336:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082472:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082480:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082487:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082493:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857635.082497:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082506:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082520:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:0.0:1787857635.082523:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.082530:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082536:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7a9db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082554:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082560:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082566:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082578:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857635.082582:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082602:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082612:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff9998d5316d00) 00010000:00010000:0.0:1787857635.082614:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.082617:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082624:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7a9e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082667:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7a9d4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31f6 expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082694:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:0.0:1787857635.082696:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.082700:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7a9d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31f6 expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.082710:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091400, rc 0) 00000100:00100000:0.0:1787857635.082801:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19936:x1874704171507968:12345-192.168.204.36@tcp:101:rm.0 Request processed in 730us (916us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857635.082810:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 623 00000100:00100000:0.0:1787857635.100105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857635.100551:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171508096 00000100:00100000:2.0:1787857635.100573:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171508096 00000100:00100000:2.0:1787857635.100716:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 624 00000100:00100000:2.0:1787857635.100730:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19937:x1874704171508096:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857635.100758:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857635.100784:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a9e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd31fd expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.100959:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.100979:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.100996:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101015:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101022:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101028:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101136:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101145:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101153:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101168:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857635.101174:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101181:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101197:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:2.0:1787857635.101201:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.101206:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101213:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7a9f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101230:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101236:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101243:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101248:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857635.101251:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101258:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101286:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff9998d8aea800) 00010000:00010000:2.0:1787857635.101290:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.101293:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101300:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1c00/0xd3f183cab4a7a9f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101342:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a9e9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31fd expref: 30 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101354:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:2.0:1787857635.101356:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.101359:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7a9e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31fd expref: 30 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.101370:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0e00, rc 0) 00000100:00100000:2.0:1787857635.101490:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19937:x1874704171508096:12345-192.168.204.36@tcp:101:cp.0 Request processed in 763us (1454us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857635.101498:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 624 00000100:00100000:3.0:1787857635.106682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.106937:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171508224 00000100:00100000:0.0:1787857635.106954:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171508224 00000100:00100000:0.0:1787857635.107159:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 625 00000100:00100000:0.0:1787857635.107173:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19937:x1874704171508224:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857635.107204:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857635.107236:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7a9fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3204 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107353:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107373:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107388:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107405:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107414:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107420:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107530:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107539:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107573:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107581:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857635.107600:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107610:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107628:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:0.0:1787857635.107631:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.107639:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107646:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107665:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107672:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107679:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107685:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857635.107687:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107705:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107714:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff9998d5316d00) 00010000:00010000:0.0:1787857635.107716:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.107719:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107725:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107766:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7a9fe lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3204 expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107777:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:0.0:1787857635.107779:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.107783:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7a9fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3204 expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.107792:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091400, rc 0) 00000100:00100000:0.0:1787857635.107919:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19937:x1874704171508224:12345-192.168.204.36@tcp:101:cp.0 Request processed in 749us (1255us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857635.107929:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 625 00000100:00100000:3.0:1787857635.118205:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857635.119175:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171508480 00000100:00100000:1.0:1787857635.119190:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171508480 00000100:00100000:1.0:1787857635.119292:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 626 00000100:00100000:1.0:1787857635.119307:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:19937:x1874704171508480:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857635.119344:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857635.119378:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aa13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd320b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.119571:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.121248:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.121290:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.121334:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.121344:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.121351:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857635.129905:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd:0x0], index 0: 0 00010000:00010000:1.0:1787857635.130374:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.130415:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.130433:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.130576:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.131239:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.131253:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.131262:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857635.131269:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.131288:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.131309:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:1.0:1787857635.131313:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857635.131319:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.131325:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aa1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857635.131347:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8019df6 reply state 00000000ab70320b transno 4294967717 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857635.131373:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857635.131435:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aa13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.131467:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 31 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.131476:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9998c53aea00) 00010000:00010000:1.0:1787857635.131479:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857635.131482:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00100000:1.0:1787857635.131672:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19937:x1874704171508480:12345-192.168.204.36@tcp:101:cp.0 Request processed in 12367us (13482us total) trans 4294967717 rc 0/0 00000100:00100000:1.0:1787857635.131684:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 626 00010000:00010000:2.0:1787857635.134261:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.134295:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.134303:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.134336:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857635.134342:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.134351:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.134379:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff9998c53ae800) 00010000:00010000:2.0:1787857635.134383:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857635.134389:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.134397:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7aa21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857635.136297:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857635.136472:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171508608 00000100:00100000:2.0:1787857635.136487:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171508608 00000100:00100000:2.0:1787857635.136593:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:2.0:1787857635.136608:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+7:2347:x1874704171508608:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857635.136635:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857635.136668:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3212 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787857635.136691:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1787857635.136703:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857635.136730:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787857635.136736:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857635.136749:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 8 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.136786:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 8 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.136804:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0e00, rc 0) 00000100:00100000:2.0:1787857635.136925:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171508608:12345-192.168.204.36@tcp:101:cp.0 Request processed in 321us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857635.136934:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:1.0:1787857635.147870:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857635.148232:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171508736 00000100:00100000:2.0:1787857635.148246:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171508736 00000100:00100000:2.0:1787857635.148333:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:2.0:1787857635.148344:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:19937:x1874704171508736:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857635.148368:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857635.148393:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000636e0a9e/0xd3f183cab4a7aa3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3219 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.148437:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.148449:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857635.148454:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857635.148461:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000636e0a9e/0xd3f183cab4a7aa3d lrc: 4/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3219 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.148513:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.148552:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 9 pid: 6714 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857635.148572:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188169728:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857635.148711:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857635.152456:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188169728:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857635.152514:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000636e0a9e/0xd3f183cab4a7aa3d lrc: 3/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3219 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.152543:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1c00, rc 0) 00000100:00100000:2.0:1787857635.152637:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:19937:x1874704171508736:12345-192.168.204.36@tcp:101:cp.0 Request processed in 4293us (4837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857635.152649:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:3.0:1787857635.153881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857635.153969:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171508864 00000100:00100000:2.0:1787857635.153988:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171508864 00010000:00010000:2.0:1787857635.154039:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 9 pid: 6714 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857635.154087:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 181 00000100:00100000:2.0:1787857635.154100:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171508864:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857635.154119:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857635.154153:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 9 pid: 6714 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.154211:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 9 pid: 6714 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.154243:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c43b6f7/0xd3f183cab4a7aa36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3212 expref: 9 pid: 6714 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.154264:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857635.154269:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857635.154289:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000636e0a9e/0xd3f183cab4a7aa3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3219 expref: 8 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.154303:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000636e0a9e/0xd3f183cab4a7aa3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3219 expref: 8 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857635.154355:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000636e0a9e/0xd3f183cab4a7aa3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3219 expref: 8 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857635.154374:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188169856:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857635.154491:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857635.167897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.168347:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171509120 00000100:00100000:0.0:1787857635.168362:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171509120 00000100:00100000:0.0:1787857635.168441:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 130 00000100:00100000:0.0:1787857635.168455:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:19937:x1874704171509120:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:2.0:1787857635.169167:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188169856:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857635.169197:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857635.169299:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171508864:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 15201us (15426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857635.169311:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 181 00000100:00100000:0.0:1787857635.170500:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:19937:x1874704171509120:12345-192.168.204.36@tcp:35:cp.0 Request processed in 2039us (2619us total) trans 4294967718 rc 0/0 00000100:00100000:0.0:1787857635.170515:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 130 00000100:00100000:2.0:1787857635.184593:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857635.184629:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188169984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857635.184744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857635.184886:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188169984 00000100:00100000:0.0:1787857635.184897:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188169984 00000100:00100000:0.0:1787857635.185011:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787857635.185023:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188169984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857635.185454:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857635.185533:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188169984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 512us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857635.185542:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787857635.185653:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188169984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787857635.185801:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857635.232568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857635.233874:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171509376 00000100:00100000:2.0:1787857635.233894:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171509376 00000100:00100000:3.0:1787857635.235266:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 627 00000100:00100000:3.0:1787857635.235299:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+64:19940:x1874704171509376:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857635.235335:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857635.235368:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7aa44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3220 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.235555:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.235576:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.235592:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.235615:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.235623:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.235630:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.235882:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.235914:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.236755:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857635.236777:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 158 00010000:00010000:3.0:1787857635.237166:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237177:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237184:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237191:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c70b2c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857635.237195:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237516:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237542:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:3.0:1787857635.237546:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857635.237552:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237559:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aa4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237581:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237604:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237610:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237616:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c1e45c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857635.237620:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237626:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237634:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff9998d1291d00) 00010000:00010000:3.0:1787857635.237637:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857635.237640:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237645:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237717:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7aa44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 67 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237736:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 66 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.237744:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9998c53aea00) 00010000:00010000:3.0:1787857635.237747:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857635.237758:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c0030200, rc 0) 00000100:00100000:3.0:1787857635.238226:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+66:19940:x1874704171509376:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2944us (5670us total) trans 4294967719 rc 0/0 00000100:00100000:3.0:1787857635.238238:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 627 00000100:00100000:1.0:1787857635.251637:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.256902:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171509632 00000100:00100000:0.0:1787857635.256925:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171509632 00000100:00100000:0.0:1787857635.259380:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 628 00000100:00100000:0.0:1787857635.259404:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+66:19940:x1874704171509632:12345-192.168.204.36@tcp:55:lfs.0 00010000:00010000:0.0:1787857635.260588:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.260619:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 31 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.260628:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 66 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.260638:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.260714:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 66 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.260732:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 66 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857635.260748:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188170112:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857635.261099:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 31 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.261109:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 31 pid: 5857 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857635.261119:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188170240:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857635.261716:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0ec8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857635.264673:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188170112:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857635.266467:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857635.266562:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171509760 00000100:00100000:1.0:1787857635.266574:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171509760 00010000:00010000:1.0:1787857635.266643:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 67 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857635.266705:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:1.0:1787857635.266718:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+67:2349:x1874704171509760:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857635.266739:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857635.266748:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 67 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.266790:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 67 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.266861:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7aa59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3220 expref: 67 pid: 7656 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.266886:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9998c53aea00) 00010000:00010000:1.0:1787857635.266892:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.266904:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.266912:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857635.266980:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+66:2349:x1874704171509760:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 264us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857635.266989:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:0.0:1787857635.267405:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188170240:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857635.267442:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857635.279534:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.279654:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171509888 00000100:00100000:0.0:1787857635.279667:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171509888 00010000:00010000:0.0:1787857635.279724:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 32 pid: 5857 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857635.279771:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 183 00000100:00100000:0.0:1787857635.279800:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:2350:x1874704171509888:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857635.279860:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857635.279869:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 32 pid: 5857 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.279884:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 32 pid: 5857 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.280072:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aa28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd320b expref: 32 pid: 5857 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.280095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9998c53aea00) 00010000:00010000:0.0:1787857635.280102:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.280113:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.280122:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857635.284189:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857635.284303:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2350:x1874704171509888:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 4494us (4775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857635.284318:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 183 00010000:00010000:0.0:1787857635.287224:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.287250:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.290159:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.290206:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.290215:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.290223:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857635.290229:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.290238:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.290263:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9998c53aea00) 00010000:00010000:0.0:1787857635.290266:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787857635.290284:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.290292:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857635.291206:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+66:19940:x1874704171509632:12345-192.168.204.36@tcp:55:lfs.0 Request processed in 31795us (39572us total) trans 4294967720 rc 0/0 00000100:00100000:0.0:1787857635.291222:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 628 00000100:00100000:3.0:1787857635.299616:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.308608:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171510144 00000100:00100000:0.0:1787857635.308631:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171510144 00000100:00100000:1.0:1787857635.308882:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 131 00000100:00100000:1.0:1787857635.308897:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c5af1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+66:19940:x1874704171510144:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1787857635.315579:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c5af1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+67:19940:x1874704171510144:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 6666us (15958us total) trans 4294967721 rc 0/0 00000100:00100000:1.0:1787857635.315599:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 131 00000100:00100000:1.0:1787857635.358097:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.358231:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171510272 00000100:00100000:0.0:1787857635.358243:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171510272 00000100:00100000:0.0:1787857635.358456:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 629 00000100:00100000:0.0:1787857635.358470:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+67:19941:x1874704171510272:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857635.358524:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857635.358553:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3227 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.358655:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.358676:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.358691:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.358708:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.358715:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.358721:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359440:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7aa83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359456:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7aa83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359465:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7aa83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857635.359512:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 158 00000004:00200000:0.0:1787857635.359530:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857635.359558:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7aa83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359573:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7aa83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359584:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359591:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359599:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359606:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857635.359610:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359618:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359633:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:0.0:1787857635.359637:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.359642:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359649:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aa75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359668:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359686:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359692:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359697:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857635.359701:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359707:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359716:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff9998d5316d00) 00010000:00010000:0.0:1787857635.359718:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857635.359721:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.359728:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7aa7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.361314:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7aa6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3227 expref: 69 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.361351:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090600/0xd3f183cab4a7aa83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3227 expref: 68 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.361361:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9998d5316800) 00010000:00010000:0.0:1787857635.361364:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857635.361389:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090600, rc 0) 00000100:00100000:1.0:1787857635.362536:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+68:19941:x1874704171510272:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4053us (4578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857635.362553:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 629 00000100:00100000:3.0:1787857635.366948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.367446:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171510400 00000100:00100000:0.0:1787857635.367461:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171510400 00000100:00100000:0.0:1787857635.367620:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 160 00000100:00100000:0.0:1787857635.367633:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2349:x1874704171510400:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857635.367658:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857635.367682:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7aa8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd322e expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857635.367779:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188170368:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857635.367934:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0ec8cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1787857635.375834:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787857635.387862:0:6713:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787857635.387877:0:6713:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime: 0 -> 1787857634 00002000:00010000:0.0:1787857635.387880:0:6713:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb atime: 0 -> 1787857634 00002000:00010000:0.0:1787857635.387882:0:6713:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime: 0 -> 1787857634 00000100:00100000:0.0:1787857635.387921:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188170368:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857635.387993:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7aa8a lrc: 1/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd322e expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.388253:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c6b6b7/0xd3f183cab4a7aa8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd322e expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.388282:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090400, rc 0) 00000100:00100000:0.0:1787857635.388382:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2349:x1874704171510400:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 20751us (21457us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857635.388394:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 160 00000100:00100000:1.0:1787857635.394314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857635.394632:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171510528 00000100:00100000:3.0:1787857635.394647:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171510528 00000100:00100000:3.0:1787857635.394728:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 630 00000100:00100000:3.0:1787857635.394741:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+68:19941:x1874704171510528:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857635.394778:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857635.394804:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3235 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.394924:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7aa98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.395257:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.395285:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857635.395385:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 512 00000004:00200000:3.0:1787857635.395388:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857635.395414:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.395481:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aa91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3235 expref: 70 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.395506:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2200/0xd3f183cab4a7aa98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3235 expref: 69 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857635.395516:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9998c53aeb00) 00010000:00010000:3.0:1787857635.395519:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857635.395524:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c70b2200, rc 0) 00000100:00100000:3.0:1787857635.395624:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+69:19941:x1874704171510528:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 885us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857635.395634:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 630 00000100:00100000:3.0:1787857635.400723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857635.400906:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171510656 00000100:00100000:0.0:1787857635.400919:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171510656 00000100:00100000:0.0:1787857635.400998:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:0.0:1787857635.401012:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171510656:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857635.401047:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857635.401071:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e800fca1/0xd3f183cab4a7aa9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd323c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857635.401149:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188170496:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857635.401263:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0ec8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857635.405455:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188170496:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857635.405515:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e800fca1/0xd3f183cab4a7aa9f lrc: 1/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd323c expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.405549:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e800fca1/0xd3f183cab4a7aa9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd323c expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857635.405575:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091400, rc 0) 00000100:00100000:0.0:1787857635.405661:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171510656:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4650us (4953us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857635.405672:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:2.0:1787857635.412672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857635.412913:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171510912 00000100:00100000:3.0:1787857635.412928:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171510912 00000100:00100000:3.0:1787857635.413234:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 631 00000100:00100000:3.0:1787857635.413247:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+69:19941:x1874704171510912:12345-192.168.204.36@tcp:58:lfs.0 00000100:00100000:3.0:1787857635.413736:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+69:19941:x1874704171510912:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 489us (1077us total) trans 0 rc -1/-1 00000100:00100000:3.0:1787857635.413745:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 631 00000040:00080000:0.0:1787857635.695183:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857635.695195:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857635.695237:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 2 00000040:00080000:0.0:1787857635.695244:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857636.079021:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857636.721635:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188170752:0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.721710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857636.721761:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188171264:0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.721789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857636.721839:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188170624:0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.721843:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188170880:0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.721869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857636.721876:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857636.721892:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857636.721894:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188171136:0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.721897:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188171008:0@lo:400:kworker.0 00000100:00100000:2.0:1787857636.721915:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857636.721915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857636.722260:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188170624 00000100:00100000:1.0:1787857636.722267:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188170752 00000100:00100000:1.0:1787857636.722273:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188170752 00000100:00100000:0.0:1787857636.722273:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188170624 00000100:00100000:1.0:1787857636.722309:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188170880 00000100:00100000:1.0:1787857636.722312:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188170880 00000100:00100000:0.0:1787857636.722313:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787857636.722335:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188171136 00000100:00100000:1.0:1787857636.722338:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188171136 00000100:00100000:1.0:1787857636.722354:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787857636.722360:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188170752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.722411:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188170752:12345-0@lo:400:kworker.0 Request processed in 51us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857636.722419:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787857636.722435:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787857636.722441:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188170880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.722480:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188170880:12345-0@lo:400:kworker.0 Request processed in 39us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857636.722487:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787857636.722501:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787857636.722507:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188171136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.722547:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188171136:12345-0@lo:400:kworker.0 Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857636.722552:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787857636.722572:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188171264 00000100:00100000:1.0:1787857636.722576:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188171264 00000100:00100000:1.0:1787857636.722601:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188171008 00000100:00100000:1.0:1787857636.722604:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188171008 00000100:00100000:1.0:1787857636.722621:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787857636.722628:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188171264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.722659:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188171264:12345-0@lo:400:kworker.0 Request processed in 32us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857636.722665:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787857636.722676:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787857636.722682:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188171008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.722709:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188171008:12345-0@lo:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857636.722715:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787857636.722956:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188171136:0@lo:400:kworker.0 00000100:00100000:0.0:1787857636.723023:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188170624:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787857636.723050:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857636.723056:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857636.723310:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188171008:0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.723321:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188170880:0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.723387:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188170752:0@lo:400:kworker.0 00000100:00100000:1.0:1787857636.723398:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188171264:0@lo:400:kworker.0 00000100:00100000:0.0:1787857636.725181:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188170624:12345-0@lo:400:kworker.0 Request processed in 2151us (3292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857636.725196:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787857636.726029:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188170624:0@lo:400:kworker.0 00000001:00080000:1.0:1787857636.812043:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967720 is committed 00000001:00080000:1.0:1787857636.812063:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967718 is committed 00000001:00080000:1.0:1787857636.812074:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967721 is committed 00010000:00010000:0.0:1787857637.104900:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857637.230059:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857637.230084:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188171392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857637.230158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857637.231738:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188171392 00000100:00100000:1.0:1787857637.231749:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188171392 00000100:00100000:1.0:1787857637.231811:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787857637.231841:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188171392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857637.231879:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857637.231973:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188171392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857637.231981:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787857637.232748:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188171392:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857638.129646:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857638.483460:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857638.483508:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857638.483535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857638.483562:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857638.483580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857638.483598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857638.483623:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857638.483650:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171511296 00000100:00100000:2.0:1787857638.483659:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171511296 00000100:00100000:2.0:1787857638.483715:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171511808 00000100:00100000:2.0:1787857638.483718:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171511808 00000100:00100000:2.0:1787857638.483748:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171511424 00000100:00100000:2.0:1787857638.483751:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171511424 00000100:00100000:2.0:1787857638.483762:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171511680 00000100:00100000:2.0:1787857638.483764:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171511680 00000100:00100000:2.0:1787857638.483777:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:2.0:1787857638.483787:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171511296:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857638.483883:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171511296:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 95us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857638.483891:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:2.0:1787857638.483907:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:2.0:1787857638.483914:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171511808:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857638.483939:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171511808:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857638.483944:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:2.0:1787857638.483954:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00100000:2.0:1787857638.483959:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171511424:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857638.483978:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171511424:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 19us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857638.483985:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00100000:2.0:1787857638.483995:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:2.0:1787857638.484001:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171511680:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857638.484022:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171511680:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857638.484028:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:2.0:1787857638.484045:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171511552 00000100:00100000:2.0:1787857638.484055:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171511552 00000100:00100000:2.0:1787857638.484085:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171511168 00000100:00100000:2.0:1787857638.484088:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171511168 00000100:00100000:2.0:1787857638.484111:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00100000:2.0:1787857638.484118:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:2347:x1874704171511552:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857638.484150:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:2347:x1874704171511552:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857638.484155:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00100000:1.0:1787857638.484474:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171511040 00000100:00100000:1.0:1787857638.484480:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171511040 00000100:00100000:1.0:1787857638.484512:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 348 00000100:00100000:1.0:1787857638.484520:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171511040:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857638.484549:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171511040:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857638.484556:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 348 00000100:00100000:2.0:1787857638.484627:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 280 00000100:00100000:2.0:1787857638.484635:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+65:2347:x1874704171511168:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857638.484668:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+65:2347:x1874704171511168:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 34us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857638.484674:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 280 00000100:00080000:2.0:1787857638.484706:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857638.484711:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857638.484712:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857639.153952:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857639.997030:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857639.997100:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171511936 00000100:00100000:1.0:1787857639.997110:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171511936 00000100:00100000:1.0:1787857639.997172:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 632 00000100:00100000:1.0:1787857639.997193:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19933:x1874704171511936:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787857639.997293:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19933:x1874704171511936:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857639.997317:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 632 00000100:00100000:2.0:1787857640.002263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857640.002555:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171512192 00000100:00100000:0.0:1787857640.002566:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171512192 00000100:00080000:2.0:1787857640.002689:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857640.003250:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 132 00000100:00100000:0.0:1787857640.003267:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:19933:x1874704171512192:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857640.004332:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:19933:x1874704171512192:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1066us (2074us total) trans 4294967722 rc 0/0 00000100:00100000:0.0:1787857640.004343:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 132 00010000:00010000:0.0:1787857640.178614:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857640.302412:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857640.302503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857640.304602:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188171520 00000100:00100000:1.0:1787857640.304617:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188171520 00000100:00100000:1.0:1787857640.304712:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787857640.304722:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188171520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857640.304760:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787857640.304892:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857640.308045:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188171520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3315us (5532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857640.308061:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787857640.308203:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188171520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857641.202623:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787857641.607639:0:16545:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 15:07:19 (1787857639) 00000100:00100000:1.0:1787857641.838251:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188171648:0@lo:400:kworker.0 00000100:00100000:1.0:1787857641.838334:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857641.838392:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188172160:0@lo:400:kworker.0 00000100:00100000:1.0:1787857641.838420:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857641.838476:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787857641.838482:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188171776:0@lo:400:kworker.0 00000100:00100000:1.0:1787857641.838506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857641.838536:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188172288:0@lo:400:kworker.0 00000100:00100000:1.0:1787857641.838560:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857641.838596:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188172160 00000100:00100000:1.0:1787857641.838602:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188172160 00000100:00100000:0.0:1787857641.838749:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188171648 00000100:00100000:0.0:1787857641.838754:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188171648 00000100:00100000:0.0:1787857641.838790:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787857641.838800:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188171648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.838979:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188172032:0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.839014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857641.839049:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857641.839054:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188171904:0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.839076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857641.839349:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188172288 00000100:00100000:3.0:1787857641.839354:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188172288 00000100:00100000:3.0:1787857641.839386:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188172032 00000100:00100000:3.0:1787857641.839389:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188172032 00000100:00100000:3.0:1787857641.839406:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787857641.839413:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188172288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.839459:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188172288:12345-0@lo:400:kworker.0 Request processed in 46us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857641.839466:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787857641.839482:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787857641.839488:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188172032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.839515:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188172032:12345-0@lo:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857641.839521:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787857641.839538:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188171776 00000100:00100000:3.0:1787857641.839541:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188171776 00000100:00100000:3.0:1787857641.839554:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188171904 00000100:00100000:3.0:1787857641.839557:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188171904 00000100:00100000:3.0:1787857641.839568:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787857641.839573:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188172160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.839599:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188172160:12345-0@lo:400:kworker.0 Request processed in 25us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857641.839616:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787857641.839629:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787857641.839633:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188171776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.839672:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188171776:12345-0@lo:400:kworker.0 Request processed in 39us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857641.839677:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787857641.839687:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787857641.839692:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188171904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.839712:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188171904:12345-0@lo:400:kworker.0 Request processed in 21us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857641.839717:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787857641.839753:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188171904:0@lo:400:kworker.0 00000100:00100000:3.0:1787857641.839764:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188172032:0@lo:400:kworker.0 00000100:00080000:1.0:1787857641.840767:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857641.840774:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857641.840833:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188171776:0@lo:400:kworker.0 00000100:00100000:1.0:1787857641.840849:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188172288:0@lo:400:kworker.0 00000100:00100000:1.0:1787857641.840861:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188172160:0@lo:400:kworker.0 00000100:00100000:0.0:1787857641.841522:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188171648:12345-0@lo:400:kworker.0 Request processed in 2718us (3184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857641.841542:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787857641.845201:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188171648:0@lo:400:kworker.0 00000001:00080000:2.0:1787857641.868303:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967722 is committed 00000100:00100000:2.0:1787857642.183468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.183607:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171512448 00000100:00100000:3.0:1787857642.183619:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171512448 00000100:00100000:3.0:1787857642.183708:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 633 00000100:00100000:3.0:1787857642.183718:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:20544:x1874704171512448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857642.183746:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857642.183870:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aaa6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3243 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.183955:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.183999:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.184014:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787857642.188294:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857642.192599:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.192627:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.192640:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199037:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aabb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199067:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aabb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199079:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aabb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857642.199100:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787857642.199444:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199453:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199459:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199473:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c1e45c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857642.199478:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199486:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199501:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:3.0:1787857642.199504:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857642.199510:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199517:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7aaad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199532:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199538:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199544:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199549:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d0400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857642.199551:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199558:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199575:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9998d1291000) 00010000:00010000:3.0:1787857642.199577:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857642.199580:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.199586:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aab4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.200010:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7aaa6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3243 expref: 30 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.200027:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aabb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3243 expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.200034:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857642.200036:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857642.200039:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999009d1000, rc 0) 00000100:00100000:3.0:1787857642.216531:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20544:x1874704171512448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 32800us (33071us total) trans 4294967723 rc 0/0 00000100:00100000:3.0:1787857642.216545:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 633 00000100:00100000:2.0:1787857642.222799:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857642.224367:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171512576 00000100:00100000:1.0:1787857642.224381:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171512576 00000100:00100000:1.0:1787857642.224468:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 634 00000100:00100000:1.0:1787857642.224480:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+65:20545:x1874704171512576:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857642.224504:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857642.224546:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd324a expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.224611:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.224627:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.224639:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.224778:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.224787:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.224794:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226377:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226395:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226410:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226416:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857642.226420:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226428:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226445:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:1.0:1787857642.226448:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857642.226453:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226458:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226471:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226477:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226482:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226487:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857642.226489:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226504:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226512:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff9998c3984e00) 00010000:00010000:1.0:1787857642.226514:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857642.226517:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226522:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aad7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226566:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aac9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd324a expref: 66 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226575:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:1.0:1787857642.226577:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857642.226580:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd324a expref: 66 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.226588:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00080000:2.0:1787857642.227484:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857642.229948:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+65:20545:x1874704171512576:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5454us (7146us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857642.229962:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 634 00010000:00010000:3.0:1787857642.235124:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857642.249446:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.249848:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171512704 00000100:00100000:2.0:1787857642.249859:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171512704 00000100:00100000:2.0:1787857642.249926:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 635 00000100:00100000:2.0:1787857642.249936:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20544:x1874704171512704:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787857642.250072:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20544:x1874704171512704:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 137us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857642.250081:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 635 00000100:00100000:0.0:1787857642.255106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.255314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171512832 00000100:00100000:3.0:1787857642.255325:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171512832 00000100:00100000:3.0:1787857642.255399:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:3.0:1787857642.255470:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2347:x1874704171512832:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857642.255488:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857642.255515:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aabb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3243 expref: 29 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.255546:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857642.255553:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857642.255617:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:2347:x1874704171512832:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 209us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857642.255625:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:0.0:1787857642.263319:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.263403:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171513088 00000100:00100000:3.0:1787857642.263417:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171513088 00000100:00100000:3.0:1787857642.263485:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 636 00000100:00100000:3.0:1787857642.263495:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+65:20545:x1874704171513088:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:3.0:1787857642.263556:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857642.263583:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7a95d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31cc expref: 65 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.263602:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:3.0:1787857642.263607:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857642.263930:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.263945:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 27 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.263955:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.263988:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 27 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.264016:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 27 pid: 5856 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857642.264032:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188172416:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857642.264119:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857642.276092:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188172416:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857642.276136:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857642.282000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857642.282475:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171513216 00000100:00100000:1.0:1787857642.282493:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171513216 00010000:00010000:1.0:1787857642.282557:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 28 pid: 5856 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857642.282639:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 184 00000100:00100000:1.0:1787857642.282651:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d0398c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:2349:x1874704171513216:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857642.282675:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857642.282684:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 28 pid: 5856 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.282701:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 28 pid: 5856 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.282733:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7a99c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd31e1 expref: 28 pid: 5856 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.282755:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:1.0:1787857642.282763:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.282774:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.282783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.282874:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857642.282960:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d0398c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:2349:x1874704171513216:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 310us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857642.282969:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 184 00010000:00010000:3.0:1787857642.283763:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.283777:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.283887:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.283903:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.283915:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857642.297074:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00010000:00010000:2.0:1787857642.297111:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.297128:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.297149:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.297157:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d0400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.297163:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.297173:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.297197:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:2.0:1787857642.297201:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.297207:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.297215:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7aade lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857642.297694:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c470bcf reply state 00000000444b944d transno 4294967724 ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857642.297731:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857642.298751:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+66:20545:x1874704171513088:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 35243us (35428us total) trans 4294967724 rc 0/0 00000100:00100000:2.0:1787857642.298765:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 636 00010000:00010000:3.0:1787857642.318956:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.318976:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.319351:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.319357:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d1000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857642.319362:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.319370:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.319388:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff9998d1291000) 00010000:00010000:3.0:1787857642.319391:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857642.319395:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.319402:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aae5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857642.335300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.335607:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171513344 00000100:00100000:2.0:1787857642.335618:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171513344 00000100:00100000:2.0:1787857642.335690:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 637 00000100:00100000:2.0:1787857642.335701:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+65:20546:x1874704171513344:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857642.335737:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.335780:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7aaec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3251 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.336183:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7aaf3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.336200:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7aaf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.336214:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7aaf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857642.336294:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857642.336298:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857642.336550:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7aaf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.336578:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7aaec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3251 expref: 67 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.336616:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7aaf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3251 expref: 66 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.336625:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:2.0:1787857642.336627:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857642.336630:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1400, rc 0) 00000100:00100000:2.0:1787857642.336700:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+66:20546:x1874704171513344:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1001us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857642.336708:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 637 00000100:00100000:1.0:1787857642.341358:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.341584:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171513472 00000100:00100000:2.0:1787857642.341596:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171513472 00000100:00100000:2.0:1787857642.341747:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 638 00000100:00100000:2.0:1787857642.341760:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+66:20546:x1874704171513472:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857642.341792:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.341854:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7aafa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3258 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.341930:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.341946:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.341960:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.341977:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.341992:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.341998:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342305:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7ab0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342315:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7ab0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342379:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7ab0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857642.342421:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:2.0:1787857642.342425:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857642.342452:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7ab0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342464:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342471:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342478:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342484:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.342489:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342563:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342577:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:2.0:1787857642.342580:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.342586:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342591:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342607:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342612:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342617:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342623:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.342626:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342632:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342639:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff9998d8aea200) 00010000:00010000:2.0:1787857642.342641:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.342644:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342660:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.342698:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7aafa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3258 expref: 68 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.343001:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0a00/0xd3f183cab4a7ab0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3258 expref: 67 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.343010:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.343012:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857642.343015:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0a00, rc 0) 00000100:00100000:2.0:1787857642.343087:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+67:20546:x1874704171513472:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1330us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857642.343096:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 638 00000100:00100000:3.0:1787857642.350697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.351098:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188172544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857642.351176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857642.351338:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188172544 00000100:00100000:1.0:1787857642.351346:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188172544 00000100:00100000:1.0:1787857642.351452:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787857642.351462:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188172544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857642.351528:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857642.351583:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188172544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857642.351591:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787857642.351641:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188172544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857642.352557:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171513600 00000100:00100000:2.0:1787857642.352565:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171513600 00000100:00100000:2.0:1787857642.352665:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 639 00000100:00100000:2.0:1787857642.352675:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+67:20546:x1874704171513600:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857642.352692:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.352725:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd325f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.352799:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.352843:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.352871:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.352913:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.352921:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.352928:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353002:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353010:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353017:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353023:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.353028:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353036:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353047:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.353050:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.353054:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353067:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353081:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353087:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353094:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353098:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.353101:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353106:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353113:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff9998d8aea200) 00010000:00010000:2.0:1787857642.353116:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.353118:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353124:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353308:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab16 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd325f expref: 68 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353332:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.353335:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.353338:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd325f expref: 68 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.353348:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1600, rc 0) 00000100:00100000:2.0:1787857642.353401:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+67:20546:x1874704171513600:12345-192.168.204.36@tcp:101:bash.0 Request processed in 728us (2718us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857642.353408:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 639 00000100:00100000:0.0:1787857642.380907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857642.381003:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171513728 00000100:00100000:1.0:1787857642.381014:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171513728 00000100:00100000:1.0:1787857642.381077:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 640 00000100:00100000:1.0:1787857642.381088:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+27:20547:x1874704171513728:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857642.381110:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857642.381159:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ab2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3266 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.381235:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.381252:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.381266:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857642.381343:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857642.381348:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857642.381374:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.381417:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ab2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.381439:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 28 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.381449:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:1.0:1787857642.381452:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857642.381456:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707c00, rc 0) 00000100:00100000:1.0:1787857642.381916:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:20547:x1874704171513728:12345-192.168.204.36@tcp:101:rm.0 Request processed in 828us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857642.381924:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 640 00000100:00100000:1.0:1787857642.385866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857642.385951:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171513856 00000100:00100000:0.0:1787857642.385961:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171513856 00000100:00100000:0.0:1787857642.386022:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 641 00000100:00100000:0.0:1787857642.386033:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:20547:x1874704171513856:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857642.386056:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857642.386078:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ab39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd326d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386172:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386188:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386201:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386216:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386225:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386231:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386370:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090400/0xd3f183cab4a7ab4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386379:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090400/0xd3f183cab4a7ab4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386387:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090400/0xd3f183cab4a7ab4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857642.386417:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:0.0:1787857642.386421:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857642.386455:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090400/0xd3f183cab4a7ab4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386467:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386474:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386481:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386487:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857642.386608:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386617:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386631:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857642.386639:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857642.386645:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386651:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ab40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386665:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386672:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386678:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386683:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857642.386686:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386692:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386699:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff9998d5316200) 00010000:00010000:0.0:1787857642.386702:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857642.386705:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386711:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ab47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386741:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ab39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd326d expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386769:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090400/0xd3f183cab4a7ab4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd326d expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.386777:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:0.0:1787857642.386780:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857642.386782:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090400, rc 0) 00000100:00100000:0.0:1787857642.386888:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20547:x1874704171513856:12345-192.168.204.36@tcp:101:rm.0 Request processed in 856us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857642.386896:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 641 00000100:00100000:3.0:1787857642.390567:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.391054:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171513984 00000100:00100000:2.0:1787857642.391066:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171513984 00000100:00100000:2.0:1787857642.391161:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 642 00000100:00100000:2.0:1787857642.391173:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20547:x1874704171513984:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857642.391195:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.391219:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3274 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391296:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391312:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391323:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391338:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391360:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391367:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391432:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391440:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391447:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391453:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.391457:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391465:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391477:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.391480:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.391486:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391604:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391619:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391631:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391638:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391643:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.391647:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391653:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391661:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff9998d8aea200) 00010000:00010000:2.0:1787857642.391664:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.391668:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391674:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391708:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab55 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3274 expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391718:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.391720:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.391724:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3274 expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.391744:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1600, rc 0) 00000100:00100000:2.0:1787857642.391813:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20547:x1874704171513984:12345-192.168.204.36@tcp:101:rm.0 Request processed in 642us (1258us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857642.391853:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 642 00000100:00100000:1.0:1787857642.395951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857642.396600:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171514112 00000100:00100000:0.0:1787857642.396611:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171514112 00000100:00100000:0.0:1787857642.397468:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 643 00000100:00100000:0.0:1787857642.397483:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20547:x1874704171514112:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857642.397516:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857642.397537:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7ab6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd327b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397607:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397621:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397633:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397650:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397675:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397683:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397750:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397757:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397764:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397771:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857642.397776:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397784:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397797:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:0.0:1787857642.397800:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857642.397805:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397811:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ab71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397843:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397855:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397862:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397867:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999014e3e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857642.397871:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397877:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397885:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff9998d5316300) 00010000:00010000:0.0:1787857642.397888:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857642.397891:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397897:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ab78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397931:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7ab6a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd327b expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397942:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:0.0:1787857642.397944:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857642.397948:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7ab6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd327b expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.397969:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091400, rc 0) 00000100:00100000:0.0:1787857642.398057:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20547:x1874704171514112:12345-192.168.204.36@tcp:101:rm.0 Request processed in 578us (2115us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857642.398065:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 643 00000100:00100000:0.0:1787857642.428417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.428961:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171514240 00000100:00100000:2.0:1787857642.428974:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171514240 00000100:00100000:2.0:1787857642.429129:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 644 00000100:00100000:2.0:1787857642.429153:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20548:x1874704171514240:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857642.429178:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.429200:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3282 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429288:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429303:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429317:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429333:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429341:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429347:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429956:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429967:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429974:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429980:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.429984:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.429992:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430005:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.430008:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.430014:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430020:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ab86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430033:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430038:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430044:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430057:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.430060:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430066:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430074:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff9998d8aea200) 00010000:00010000:2.0:1787857642.430076:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.430080:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430086:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430142:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab7f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3282 expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430153:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.430155:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.430159:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3282 expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.430168:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1600, rc 0) 00000100:00100000:2.0:1787857642.430242:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20548:x1874704171514240:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1092us (1838us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857642.430250:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 644 00000100:00100000:3.0:1787857642.437747:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.440263:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171514368 00000100:00100000:2.0:1787857642.440301:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171514368 00000100:00100000:2.0:1787857642.440763:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 645 00000100:00100000:2.0:1787857642.440966:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20548:x1874704171514368:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857642.440991:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.441013:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3289 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441084:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441100:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441113:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441127:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441148:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441156:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441223:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441231:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441237:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441251:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.441256:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441263:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.441277:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.441280:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.441284:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443175:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ab9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443196:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443202:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443209:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443216:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.443220:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443228:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443264:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff9998d8aea200) 00010000:00010000:2.0:1787857642.443267:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.443272:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443278:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7aba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443329:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab94 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3289 expref: 30 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443339:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.443342:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.443345:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1600/0xd3f183cab4a7ab94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3289 expref: 30 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.443353:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1600, rc 0) 00000100:00100000:2.0:1787857642.444657:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20548:x1874704171514368:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3691us (6913us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857642.444669:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 645 00000100:00100000:1.0:1787857642.451194:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.452036:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171514624 00000100:00100000:3.0:1787857642.452050:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171514624 00000100:00100000:3.0:1787857642.452150:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 646 00000100:00100000:3.0:1787857642.452163:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20548:x1874704171514624:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857642.452187:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857642.452236:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aba9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3290 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.452436:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.452456:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.452470:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.452490:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.452498:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.452504:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857642.453681:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf:0x0], index 1: 0 00010000:00010000:3.0:1787857642.453928:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7abbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.453941:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7abbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.453951:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7abbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.453989:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.454008:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.454014:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.454020:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d1e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857642.454024:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.454031:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.454044:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:3.0:1787857642.454048:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857642.454053:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.454059:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7abb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857642.454074:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ce6db02 reply state 0000000023e15779 transno 4294967725 ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857642.454083:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857642.454116:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7aba9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3290 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.454131:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2c00/0xd3f183cab4a7abbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3290 expref: 31 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.454163:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:3.0:1787857642.454165:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857642.454168:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c70b2c00, rc 0) 00000100:00100000:3.0:1787857642.454255:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:20548:x1874704171514624:12345-192.168.204.36@tcp:101:cp.0 Request processed in 2094us (3072us total) trans 4294967725 rc 0/0 00000100:00100000:3.0:1787857642.454264:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 646 00010000:00010000:2.0:1787857642.458873:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.458893:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.458902:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.458930:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d0400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857642.458936:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.458944:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.458965:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff9998d1291000) 00010000:00010000:2.0:1787857642.458968:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857642.458973:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.458979:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7abb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857642.459339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.459689:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171514752 00000100:00100000:2.0:1787857642.459699:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171514752 00000100:00100000:2.0:1787857642.459780:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00100000:2.0:1787857642.459791:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171514752:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857642.459808:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.459870:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3297 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857642.459901:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857642.459923:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787857642.459928:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857642.459938:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.459977:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.459992:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0600, rc 0) 00000100:00100000:2.0:1787857642.460057:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171514752:12345-192.168.204.36@tcp:101:cp.0 Request processed in 269us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857642.460065:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00080000:1.0:1787857642.461386:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857642.464694:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.465180:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171514880 00000100:00100000:3.0:1787857642.465191:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171514880 00000100:00100000:3.0:1787857642.465243:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:3.0:1787857642.465254:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:20548:x1874704171514880:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857642.465272:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857642.465293:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd329e expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.465331:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.465341:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857642.465345:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857642.465351:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.465386:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.465419:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 10 pid: 8490 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857642.465448:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188172672:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857642.466800:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857642.470295:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188172672:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857642.470332:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.470353:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c1e45c00, rc 0) 00000100:00100000:3.0:1787857642.470416:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:20548:x1874704171514880:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5164us (5729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857642.470425:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:1.0:1787857642.473043:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.473617:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171515008 00000100:00100000:3.0:1787857642.473631:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171515008 00010000:00010000:3.0:1787857642.473676:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 10 pid: 8490 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857642.473770:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 185 00000100:00100000:3.0:1787857642.473781:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171515008:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857642.473798:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857642.473867:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 10 pid: 8490 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.473903:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 10 pid: 8490 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.473929:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c04ca0e1/0xd3f183cab4a7abcc lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3297 expref: 10 pid: 8490 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.473946:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857642.473950:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857642.473959:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.473969:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.474007:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857642.474021:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188172800:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857642.474115:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857642.477552:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857642.477720:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171515264 00000100:00100000:0.0:1787857642.477730:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171515264 00000100:00100000:0.0:1787857642.477792:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 133 00000100:00100000:0.0:1787857642.477802:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:20548:x1874704171515264:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:0.0:1787857642.478255:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:20548:x1874704171515264:12345-192.168.204.36@tcp:35:cp.0 Request processed in 453us (714us total) trans 4294967726 rc 0/0 00000100:00100000:0.0:1787857642.478264:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 133 00000100:00100000:3.0:1787857642.481154:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188172800:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857642.481189:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857642.481290:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171515008:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 7510us (8258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857642.481301:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 185 00000100:00100000:1.0:1787857642.529945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857642.530096:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171515392 00000100:00100000:0.0:1787857642.530107:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171515392 00000100:00100000:0.0:1787857642.530186:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 647 00000100:00100000:0.0:1787857642.530199:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+67:20551:x1874704171515392:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857642.530224:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857642.530247:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2800/0xd3f183cab4a7abda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32a5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530328:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530345:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530375:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530392:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530400:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530406:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530647:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7abef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530656:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7abef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530663:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7abef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857642.530699:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00000004:00200000:0.0:1787857642.530703:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857642.530720:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7abef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530732:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7abef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530740:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530759:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530766:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530773:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999014e3a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857642.530778:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530787:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.530801:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:0.0:1787857642.530804:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857642.530809:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.531245:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7abe1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.531266:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.531273:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.531280:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.531285:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999014e3e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857642.532011:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.532020:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.532035:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff9998d5316300) 00010000:00010000:0.0:1787857642.532038:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857642.532042:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.532048:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7abe8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.532101:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2800/0xd3f183cab4a7abda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32a5 expref: 69 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.532119:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091400/0xd3f183cab4a7abef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32a5 expref: 68 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.532126:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:0.0:1787857642.532129:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857642.532143:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091400, rc 0) 00000100:00100000:0.0:1787857642.533516:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+68:20551:x1874704171515392:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3308us (3571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857642.533529:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 647 00000100:00100000:1.0:1787857642.540153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.540266:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171515520 00000100:00100000:2.0:1787857642.540276:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171515520 00000100:00080000:1.0:1787857642.540350:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857642.540403:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 164 00000100:00100000:2.0:1787857642.540415:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2350:x1874704171515520:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857642.540435:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.540454:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a5172ee/0xd3f183cab4a7abf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32ac expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857642.540518:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d08f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188172928:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857642.540615:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1787857642.542709:0:6713:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857642.542720:0:6713:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb mtime: 0 -> 1787857642 00002000:00010000:2.0:1787857642.542722:0:6713:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb atime: 0 -> 1787857642 00002000:00010000:2.0:1787857642.542724:0:6713:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb ctime: 0 -> 1787857642 00000100:00100000:2.0:1787857642.542748:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d08f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188172928:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857642.542957:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a5172ee/0xd3f183cab4a7abf6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32ac expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.543095:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5172ee/0xd3f183cab4a7abf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32ac expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.543112:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0200, rc 0) 00000100:00100000:2.0:1787857642.543200:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2350:x1874704171515520:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2788us (3149us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857642.543209:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 164 00000100:00100000:1.0:1787857642.554562:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.554691:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171515648 00000100:00100000:2.0:1787857642.554702:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171515648 00000100:00100000:2.0:1787857642.554873:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 648 00000100:00100000:2.0:1787857642.554892:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+68:20551:x1874704171515648:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857642.554918:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.554947:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7abfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32b3 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.555648:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7ac04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.555664:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7ac04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.555676:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7ac04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857642.555842:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:2.0:1787857642.555847:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857642.555908:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7ac04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.555936:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7abfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32b3 expref: 70 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.555955:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0800/0xd3f183cab4a7ac04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32b3 expref: 69 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.555963:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9998d8aea300) 00010000:00010000:2.0:1787857642.555966:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857642.555969:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0800, rc 0) 00000100:00100000:2.0:1787857642.556156:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+69:20551:x1874704171515648:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1267us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857642.556165:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 648 00000100:00100000:1.0:1787857642.564545:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.564652:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171515776 00000100:00100000:3.0:1787857642.564663:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171515776 00000100:00100000:3.0:1787857642.564735:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 165 00000100:00100000:3.0:1787857642.564745:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171515776:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857642.564765:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857642.564787:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f8bce8/0xd3f183cab4a7ac0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32ba expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857642.564901:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188173056:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857642.564982:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857642.571019:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188173056:192.168.204.36@tcp:106: 00010000:00010000:3.0:1787857642.571066:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096f8bce8/0xd3f183cab4a7ac0b lrc: 1/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32ba expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.571093:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f8bce8/0xd3f183cab4a7ac0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32ba expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.571108:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:3.0:1787857642.571192:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171515776:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 6448us (6661us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857642.571201:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 165 00000100:00100000:0.0:1787857642.576607:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.576693:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171516032 00000100:00100000:2.0:1787857642.576706:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171516032 00000100:00100000:2.0:1787857642.576774:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 649 00000100:00100000:2.0:1787857642.576784:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+69:20551:x1874704171516032:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:2.0:1787857642.577150:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 136 off10232 00000100:00100000:2.0:1787857642.577250:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+69:20551:x1874704171516032:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 466us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857642.577260:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 649 00000040:00080000:1.0:1787857642.864100:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857642.864110:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857642.864170:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 3 00000040:00080000:1.0:1787857642.864180:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857642.864453:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f03c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188173184:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857642.864556:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857642.877939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.878101:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171516160 00000100:00100000:3.0:1787857642.878111:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171516160 00000100:00100000:3.0:1787857642.878180:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 650 00000100:00100000:3.0:1787857642.878189:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:20561:x1874704171516160:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857642.878307:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x11:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857642.878418:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:20561:x1874704171516160:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 229us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857642.878426:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 650 00000100:00100000:1.0:1787857642.880017:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f03c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188173184:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857642.901851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.901925:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171516416 00000100:00100000:3.0:1787857642.901936:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171516416 00000100:00100000:3.0:1787857642.901995:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 651 00000100:00100000:3.0:1787857642.902006:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:20561:x1874704171516416:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857642.902028:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857642.902048:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32c1 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.902182:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7ac19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.902199:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.902211:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857642.902223:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00010000:00010000:3.0:1787857642.902353:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32c1 expref: 35 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.902372:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7ac19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32c1 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857642.902393:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:3.0:1787857642.902397:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857642.902400:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6c00, rc 0) 00000100:00100000:3.0:1787857642.904066:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:20561:x1874704171516416:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2052us (2246us total) trans 4294967727 rc 0/0 00000100:00100000:3.0:1787857642.904078:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 651 00000100:00100000:1.0:1787857642.910960:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.911088:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171516544 00000100:00100000:2.0:1787857642.911098:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171516544 00000100:00100000:2.0:1787857642.911174:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:2.0:1787857642.911184:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:2350:x1874704171516544:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857642.911216:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857642.911242:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7ac19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32c1 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.911262:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:2.0:1787857642.911267:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857642.911318:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:2350:x1874704171516544:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 136us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857642.911326:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:1.0:1787857642.923025:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857642.923216:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171516672 00000100:00100000:0.0:1787857642.923227:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171516672 00000100:00100000:0.0:1787857642.923302:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 166 00000100:00100000:0.0:1787857642.923312:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171516672:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857642.923360:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.923382:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.923391:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857642.923396:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857642.923401:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.923436:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.923452:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 9 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857642.923467:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188173312:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857642.923544:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0ec8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857642.942055:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857642.942100:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188173312:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857642.942140:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857642.942262:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171516800 00000100:00100000:1.0:1787857642.942269:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171516800 00002000:00100000:1.0:1787857642.942317:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xf:0x0] (0->157) req@ffff999900d4d680 x1874704171516800/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:288/0 lens 648/0 e 0 to 0 dl 1787857653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857642.942328:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999900d4d680 with x1874704171516800 ext(0->157) 00010000:00010000:1.0:1787857642.942335:0:6718:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 10 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.942350:0:6718:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 10 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857642.942357:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff999900d4d680 00000100:00100000:1.0:1787857642.942389:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:1.0:1787857642.942400:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171516800:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857642.942969:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2347:x1874704171516800:12345-192.168.204.36@tcp:4:cp.0 Request processed in 569us (923us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787857642.942977:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00002000:00100000:1.0:1787857642.942984:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xf:0x0] (0->157) req@ffff999900d4d680 x1874704171516800/t4294967330(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:288/0 lens 648/448 e 0 to 0 dl 1787857653 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857642.942998:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999900d4d680 with x1874704171516800 ext(0->157) 00010000:00010000:1.0:1787857642.943005:0:6718:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 12 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857642.943017:0:6718:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 12 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857642.943023:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff999900d4d680 00000100:00100000:1.0:1787857642.947235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.947343:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171516928 00000100:00100000:2.0:1787857642.947353:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171516928 00010000:00010000:2.0:1787857642.947396:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 12 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857642.947441:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 186 00000100:00100000:2.0:1787857642.947452:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2347:x1874704171516928:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857642.947469:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857642.947496:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 12 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.947512:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 12 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.947540:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008337f03a/0xd3f183cab4a7abd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd329e expref: 12 pid: 6711 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.947591:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857642.947596:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857642.947606:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.947617:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.947652:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857642.947724:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171516928:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 274us (500us total) trans 0 rc 0/0 00010000:00010000:0.0:1787857642.947728:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857642.947732:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 186 00010000:00010000:0.0:1787857642.947745:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.947770:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.947779:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.947787:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.947794:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857642.947798:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.947807:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.947915:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.947924:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e18ad1ae/0xd3f183cab4a7ac27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857642.947999:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171516672:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 24687us (24983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857642.948007:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 166 00000100:00100000:1.0:1787857642.954076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.954165:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171517184 00000100:00100000:3.0:1787857642.954176:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171517184 00000100:00100000:3.0:1787857642.954314:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 652 00000100:00100000:3.0:1787857642.954326:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:20561:x1874704171517184:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857642.954449:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:20561:x1874704171517184:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 125us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857642.954457:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 652 00000100:00100000:1.0:1787857642.958898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857642.959071:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171517312 00000100:00100000:2.0:1787857642.959083:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171517312 00000100:00100000:2.0:1787857642.959152:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 167 00000100:00100000:2.0:1787857642.959163:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171517312:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857642.959186:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857642.959218:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1955c67/0xd3f183cab4a7ac2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32c8 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857642.959251:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 158, mtime: 0x6a908aea, atime: 0x0, ctime: 0x6a908aea, blocks: 0x1 00010000:00010000:2.0:1787857642.959274:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1787857642.959279:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857642.959297:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1955c67/0xd3f183cab4a7ac2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32c8 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.959341:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1955c67/0xd3f183cab4a7ac2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32c8 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857642.959355:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1600, rc 0) 00000100:00100000:2.0:1787857642.959462:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171517312:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 300us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857642.959469:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 167 00000100:00100000:1.0:1787857642.966270:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857642.966357:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171517568 00000100:00100000:0.0:1787857642.966367:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171517568 00000100:00100000:0.0:1787857642.966426:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 653 00000100:00100000:0.0:1787857642.966437:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:20561:x1874704171517568:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857642.966582:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:20561:x1874704171517568:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 145us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857642.966589:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 653 00000100:00100000:3.0:1787857642.981453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857642.981536:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171517696 00000100:00100000:1.0:1787857642.981555:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171517696 00002000:00100000:1.0:1787857642.981608:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->4095) req@ffff999900d4e1c0 x1874704171517696/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:288/0 lens 488/0 e 0 to 0 dl 1787857653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857642.981621:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999900d4e1c0 with x1874704171517696 ext(0->4095) 00002000:00010000:1.0:1787857642.981626:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999900d4e1c0 00000100:00100000:1.0:1787857642.981660:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:1.0:1787857642.981670:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171517696:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857642.981943:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171517696:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 273us (501us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857642.981952:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 55 00002000:00100000:1.0:1787857642.981959:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->4095) req@ffff999900d4e1c0 x1874704171517696/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:288/0 lens 488/4536 e 0 to 0 dl 1787857653 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857642.981978:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999900d4e1c0 with x1874704171517696 ext(0->4095) 00002000:00010000:1.0:1787857642.981981:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999900d4e1c0 00000100:00100000:3.0:1787857642.987472:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857642.988153:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171517824 00000100:00100000:0.0:1787857642.988164:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171517824 00000100:00100000:0.0:1787857642.988231:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 654 00000100:00100000:0.0:1787857642.988242:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:20561:x1874704171517824:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857642.988264:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857642.988284:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32cf expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.988320:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.988335:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.988349:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.988486:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 35 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.988508:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 34 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857642.988516:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:0.0:1787857642.988520:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857642.988523:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090200, rc 0) 00000100:00100000:0.0:1787857642.988602:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:20561:x1874704171517824:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 362us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857642.988609:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 654 00000100:00100000:1.0:1787857642.995468:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857642.995559:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171517952 00000100:00100000:3.0:1787857642.995569:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171517952 00000100:00100000:3.0:1787857642.995634:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 655 00000100:00100000:3.0:1787857642.995646:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:20561:x1874704171517952:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857642.995683:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x11:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857642.995803:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:20561:x1874704171517952:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 158us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857642.995811:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 655 00000100:00100000:3.0:1787857643.000476:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857643.000717:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171518080 00000100:00100000:2.0:1787857643.000727:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171518080 00000100:00100000:2.0:1787857643.000793:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 168 00000100:00100000:2.0:1787857643.000804:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171518080:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857643.000885:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.000903:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857643.000907:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857643.000914:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.000930:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.000964:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.000992:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.001001:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.001009:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857643.001013:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.001023:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.001040:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.001049:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7ac43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857643.001135:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171518080:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 320us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857643.001142:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 168 00000100:00100000:0.0:1787857643.021401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857643.021455:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171518336 00000100:00100000:0.0:1787857643.021464:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171518336 00000100:00100000:0.0:1787857643.021526:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 656 00000100:00100000:0.0:1787857643.021536:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:20561:x1874704171518336:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857643.021625:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857643.021645:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 34 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857643.021656:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857643.021691:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 34 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857643.021716:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 34 pid: 7656 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857643.021732:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188173440:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857643.022069:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0ec8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857643.032792:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188173440:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857643.032858:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857643.035312:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857643.035702:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171518464 00000100:00100000:2.0:1787857643.035711:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171518464 00010000:00010000:2.0:1787857643.035758:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 35 pid: 7656 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857643.035805:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 187 00000100:00100000:2.0:1787857643.035846:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2350:x1874704171518464:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857643.035863:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857643.035871:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 35 pid: 7656 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.035886:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 35 pid: 7656 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.035908:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ac3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32cf expref: 35 pid: 7656 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.035923:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:2.0:1787857643.035929:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.035938:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.035946:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.035976:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857643.036024:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:2350:x1874704171518464:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 210us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857643.036032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 187 00010000:00010000:3.0:1787857643.036101:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.036110:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.036322:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.036330:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.036336:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.036342:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857643.036347:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.036354:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.036364:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:3.0:1787857643.036367:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857643.036371:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.036378:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ac4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857643.036509:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:20561:x1874704171518336:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 14974us (15115us total) trans 4294967728 rc 0/0 00000100:00100000:3.0:1787857643.036529:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 656 00000040:00080000:2.0:1787857643.037237:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857643.037250:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857643.037371:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:2.0:1787857643.037379:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857643.051057:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857643.051570:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171518720 00000100:00100000:0.0:1787857643.051583:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171518720 00000100:00100000:0.0:1787857643.051690:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 134 00000100:00100000:0.0:1787857643.051703:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:20561:x1874704171518720:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857643.052031:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:20561:x1874704171518720:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 330us (987us total) trans 4294967729 rc 0/0 00000100:00100000:0.0:1787857643.052040:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 134 00010000:00010000:0.0:1787857643.246155:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857643.450512:0:16596:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857643.450522:0:16596:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857643.450563:0:16596:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:0.0:1787857643.450569:0:16596:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857643.512397:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857643.512472:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171518976 00000100:00100000:1.0:1787857643.512482:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171518976 00000100:00100000:1.0:1787857643.512549:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 657 00000100:00100000:1.0:1787857643.512560:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+69:20564:x1874704171518976:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857643.512591:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857643.512612:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ac51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32d6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857643.512730:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ac58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857643.512745:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ac58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857643.512758:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ac58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857643.512769:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00010000:00010000:1.0:1787857643.512948:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ac51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32d6 expref: 72 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857643.512967:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ac58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32d6 expref: 71 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857643.512976:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:1.0:1787857643.512992:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857643.512997:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706600, rc 0) 00000100:00100000:1.0:1787857643.513063:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+71:20564:x1874704171518976:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 505us (677us total) trans 4294967730 rc 0/0 00000100:00100000:1.0:1787857643.513071:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 657 00000100:00100000:3.0:1787857643.517951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857643.517999:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171519104 00000100:00100000:3.0:1787857643.518010:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171519104 00000100:00100000:3.0:1787857643.518075:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 658 00000100:00100000:3.0:1787857643.518086:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+71:20564:x1874704171519104:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:3.0:1787857643.518188:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518209:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518220:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518250:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518257:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518264:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518270:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857643.518274:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518292:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518307:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:3.0:1787857643.518310:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857643.518315:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857643.518321:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857643.518408:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+71:20564:x1874704171519104:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 323us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857643.518417:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 658 00000100:00100000:3.0:1787857643.522040:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857643.522078:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171519232 00000100:00100000:2.0:1787857643.522088:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171519232 00000100:00100000:2.0:1787857643.522178:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:2.0:1787857643.522188:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+71:2349:x1874704171519232:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857643.522204:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857643.522231:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ac58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32d6 expref: 71 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857643.522252:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9998d1291300) 00010000:00010000:2.0:1787857643.522258:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857643.522338:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+70:2349:x1874704171519232:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 151us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857643.522347:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:2.0:1787857643.524936:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857643.525077:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171519488 00000100:00100000:3.0:1787857643.525086:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171519488 00000100:00100000:3.0:1787857643.525152:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 135 00000100:00100000:3.0:1787857643.525162:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+70:20564:x1874704171519488:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1787857643.525453:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+71:20564:x1874704171519488:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 286us (522us total) trans 4294967731 rc 0/0 00000100:00100000:3.0:1787857643.525462:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 135 00000100:00100000:2.0:1787857643.612605:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857643.612649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857643.612670:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171519616 00000100:00100000:1.0:1787857643.612681:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171519616 00000100:00100000:2.0:1787857643.612686:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857643.612721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857643.612741:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 350 00000100:00100000:2.0:1787857643.612749:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171519872 00000100:00100000:2.0:1787857643.612756:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171519872 00000100:00100000:1.0:1787857643.612756:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171519616:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857643.612789:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171519744 00000100:00100000:2.0:1787857643.612792:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171519744 00000100:00100000:2.0:1787857643.612846:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171520000 00000100:00100000:2.0:1787857643.612850:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171520000 00000100:00100000:1.0:1787857643.612862:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171519616:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857643.612870:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 242 00000100:00100000:1.0:1787857643.612874:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 350 00000100:00100000:2.0:1787857643.612881:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171519872:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857643.612929:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171519872:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857643.612931:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 243 00000100:00100000:2.0:1787857643.612945:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 242 00000100:00100000:1.0:1787857643.612946:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171519744:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857643.612965:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 244 00000100:00100000:2.0:1787857643.612974:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171520000:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857643.612982:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171519744:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857643.612990:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 243 00000100:00100000:2.0:1787857643.613007:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171520000:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (284us total) trans 0 rc 0/0 00000100:00080000:1.0:1787857643.613010:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857643.613016:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 244 00010000:00010000:3.0:1787857644.273015:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857645.294141:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857645.421988:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857645.422012:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188173568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857645.422095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857645.422205:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188173568 00000100:00100000:2.0:1787857645.422214:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188173568 00000100:00100000:2.0:1787857645.422279:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787857645.422291:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188173568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857645.422330:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857645.422390:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188173568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857645.422399:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1787857645.422424:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857645.422469:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188173568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857646.319464:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857646.959076:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188173824:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959157:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857646.959223:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188174336:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857646.959298:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787857646.959304:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188173696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857646.959360:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188174208:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857646.959414:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188173952:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857646.959458:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857646.959464:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188174080:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857646.959517:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188174336 00000100:00100000:0.0:1787857646.959525:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188174336 00000100:00100000:0.0:1787857646.959586:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188174080 00000100:00100000:0.0:1787857646.959589:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188174080 00000100:00100000:0.0:1787857646.959627:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787857646.959637:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188174336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959690:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188174336:12345-0@lo:400:kworker.0 Request processed in 55us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857646.959698:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787857646.959714:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787857646.959720:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188174080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959753:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188174080:12345-0@lo:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857646.959758:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787857646.959787:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188173696 00000100:00100000:0.0:1787857646.959790:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188173696 00000100:00100000:0.0:1787857646.959813:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787857646.959839:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188173696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959867:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188173696:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857646.959873:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787857646.959899:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188173824 00000100:00100000:0.0:1787857646.959903:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188173824 00000100:00100000:0.0:1787857646.959928:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188174208 00000100:00100000:0.0:1787857646.959931:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188174208 00000100:00100000:0.0:1787857646.959945:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188173952 00000100:00100000:0.0:1787857646.959947:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188173952 00000100:00100000:0.0:1787857646.959960:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787857646.959966:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188173824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.959992:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188173824:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857646.959998:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787857646.960010:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787857646.960015:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188174208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.960040:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188174208:12345-0@lo:400:kworker.0 Request processed in 25us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857646.960058:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787857646.960070:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787857646.960076:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188173952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.960101:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188173952:12345-0@lo:400:kworker.0 Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857646.960117:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1787857646.960137:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857646.960141:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857646.960180:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188174080:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.960190:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188173952:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.960221:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188173696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.960231:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188174208:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.960240:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188173824:0@lo:400:kworker.0 00000100:00100000:0.0:1787857646.960249:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188174336:0@lo:400:kworker.0 00000001:00080000:0.0:1787857647.093253:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00000001:00080000:2.0:1787857647.103163:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967729 is committed 00000001:00080000:2.0:1787857647.103182:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967724 is committed 00000001:00080000:2.0:1787857647.103188:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967730 is committed 00000001:00080000:2.0:1787857647.103201:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967731 is committed 00010000:00010000:3.0:1787857647.343965:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857647.471064:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857647.471087:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188174464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857647.471212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857647.471279:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188174464 00000100:00100000:3.0:1787857647.471288:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188174464 00000100:00100000:3.0:1787857647.471336:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787857647.471345:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188174464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857647.471399:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857647.471447:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188174464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857647.471455:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787857647.471504:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188174464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787857648.366811:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857648.720128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857648.720221:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857648.720323:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171520256 00000100:00100000:2.0:1787857648.720324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857648.720342:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171520256 00000100:00100000:2.0:1787857648.720375:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171520384 00000100:00100000:2.0:1787857648.720387:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171520384 00000100:00100000:3.0:1787857648.720453:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 287 00000100:00100000:3.0:1787857648.720468:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+68:2348:x1874704171520256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857648.720606:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+68:2348:x1874704171520256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 141us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857648.720611:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171520128 00000100:00100000:3.0:1787857648.720618:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 287 00000100:00100000:1.0:1787857648.720620:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171520128 00000100:00080000:3.0:1787857648.720654:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857648.720661:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857648.720678:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 352 00000100:00100000:1.0:1787857648.720690:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171520128:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857648.720771:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171520128:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 83us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857648.720780:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 352 00000100:00100000:2.0:1787857648.721931:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 247 00000100:00100000:2.0:1787857648.721952:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171520384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857648.722025:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171520384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 70us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857648.722033:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 247 00000100:00100000:2.0:1787857648.723526:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857648.723571:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857648.723590:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857648.723619:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857648.723645:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171520512 00000100:00100000:2.0:1787857648.723653:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171520512 00000100:00100000:2.0:1787857648.723702:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171520896 00000100:00100000:2.0:1787857648.723705:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171520896 00000100:00100000:2.0:1787857648.723724:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171520768 00000100:00100000:2.0:1787857648.723726:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171520768 00000100:00100000:2.0:1787857648.723744:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 248 00000100:00100000:2.0:1787857648.723752:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2348:x1874704171520512:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857648.723808:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+9:2348:x1874704171520512:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 56us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857648.723845:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 248 00000100:00100000:2.0:1787857648.723861:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 249 00000100:00100000:2.0:1787857648.723867:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171520896:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857648.723944:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171520896:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 77us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857648.723955:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 249 00000100:00100000:2.0:1787857648.723973:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 250 00000100:00100000:2.0:1787857648.723981:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171520768:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857648.724004:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171520768:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857648.724010:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 250 00000100:00080000:2.0:1787857648.724050:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857648.724054:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857648.724209:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171520640 00000100:00100000:3.0:1787857648.724213:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171520640 00000100:00100000:3.0:1787857648.724298:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 288 00000100:00100000:3.0:1787857648.724308:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2347:x1874704171520640:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857648.724362:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2347:x1874704171520640:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 55us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857648.724381:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 288 00000100:00080000:2.0:1787857648.724444:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857649.390069:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857649.818166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857649.818399:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171521024 00000100:00100000:3.0:1787857649.818414:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171521024 00000100:00100000:3.0:1787857649.818504:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 659 00000100:00100000:3.0:1787857649.818516:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20544:x1874704171521024:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787857649.818663:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20544:x1874704171521024:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 148us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857649.818672:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 659 00000100:00100000:1.0:1787857649.825176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857649.825335:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171521280 00000100:00100000:0.0:1787857649.825344:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171521280 00000100:00100000:0.0:1787857649.825410:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 136 00000100:00100000:0.0:1787857649.825420:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:20544:x1874704171521280:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857649.827298:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:20544:x1874704171521280:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1871us (2122us total) trans 4294967732 rc 0/0 00000100:00100000:0.0:1787857649.827310:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 136 00010000:00010000:3.0:1787857650.414718:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857650.546281:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857650.546324:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188174592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857650.546443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857650.547027:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188174592 00000100:00100000:2.0:1787857650.547038:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188174592 00000100:00080000:0.0:1787857650.547193:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857650.550585:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787857650.550621:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188174592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857650.551022:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857650.551693:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188174592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1088us (5245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857650.551704:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787857650.557042:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188174592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857651.438027:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787857651.439359:0:16844:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11a: Import a file ==================== 15:07:29 (1787857649) 00000100:00100000:2.0:1787857651.646149:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857651.646353:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171521408 00000100:00100000:1.0:1787857651.646366:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171521408 00000100:00080000:0.0:1787857651.647082:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857651.647290:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 660 00000100:00100000:3.0:1787857651.647314:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+68:21144:x1874704171521408:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857651.647342:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857651.647471:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32dd expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647552:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647566:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647577:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647611:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647635:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647642:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647945:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647953:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647970:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647976:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857651.647981:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.647988:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648000:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:3.0:1787857651.648003:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857651.648007:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648013:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648025:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648036:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648041:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648046:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857651.648048:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648054:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648060:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff9998d1291200) 00010000:00010000:3.0:1787857651.648063:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857651.648065:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648165:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648197:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32dd expref: 69 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648207:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:3.0:1787857651.648209:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857651.648213:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32dd expref: 69 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.648220:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:3.0:1787857651.648301:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+68:21144:x1874704171521408:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 997us (2166us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857651.648310:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 660 00000100:00100000:2.0:1787857651.656699:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857651.656897:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171521664 00000100:00100000:3.0:1787857651.656908:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171521664 00000100:00100000:3.0:1787857651.657064:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 661 00000100:00100000:3.0:1787857651.657075:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+68:21144:x1874704171521664:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:3.0:1787857651.657130:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857651.657155:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7aaf3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3251 expref: 68 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.657174:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:3.0:1787857651.657178:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857651.657431:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.657444:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.657453:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.657483:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 29 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857651.657496:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 29 pid: 5857 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857651.657509:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a22580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188174720:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857651.657618:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5383600 going to sleep for 11 seconds 00000100:00100000:3.0:1787857651.666473:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a22580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188174720:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857651.666532:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857651.666606:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857651.666682:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171521792 00000100:00100000:1.0:1787857651.666692:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171521792 00000100:00080000:2.0:1787857651.666757:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857651.666762:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 30 pid: 5857 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857651.666802:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 188 00000100:00100000:1.0:1787857651.666811:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:2350:x1874704171521792:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857651.666855:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857651.666863:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 30 pid: 5857 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857651.666887:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 30 pid: 5857 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857651.666941:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ab32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3266 expref: 30 pid: 5857 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857651.666974:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:1.0:1787857651.666980:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857651.666989:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857651.666998:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857651.667040:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857651.667099:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2350:x1874704171521792:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 287us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857651.667111:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 188 00010000:00010000:2.0:1787857651.667162:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.667169:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.667190:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.667197:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.667221:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857651.668414:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 512 00010000:00010000:2.0:1787857651.668428:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.668436:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.668443:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.668450:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857651.668454:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.668462:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.668475:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:2.0:1787857651.668477:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857651.668481:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857651.668485:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ac82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857651.668503:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ffae4ab reply state 00000000dff23c59 transno 4294967733 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857651.668522:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857651.668597:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+69:21144:x1874704171521664:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 11521us (11905us total) trans 4294967733 rc 0/0 00000100:00100000:2.0:1787857651.668605:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 661 00010000:00010000:0.0:1787857651.681924:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857651.681986:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857651.681995:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857651.682002:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857651.682008:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857651.682016:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857651.682129:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857651.682133:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857651.682139:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857651.682146:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7ac89 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857652.080604:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188174848:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.080715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857652.080785:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188175360:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.080842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857652.080910:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857652.080917:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188174976:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.080944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857652.080978:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188175488:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081006:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857652.081049:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188174848 00000100:00100000:2.0:1787857652.081059:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188174848 00000100:00100000:2.0:1787857652.081116:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787857652.081126:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188174848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081192:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188174848:12345-0@lo:400:kworker.0 Request processed in 66us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857652.081200:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787857652.081241:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188175488 00000100:00100000:2.0:1787857652.081245:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188175488 00000100:00100000:2.0:1787857652.081290:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787857652.081297:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188175488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081330:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188175488:12345-0@lo:400:kworker.0 Request processed in 35us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857652.081357:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:2.0:1787857652.081383:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857652.081419:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188175488:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081429:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188174848:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081488:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188175104:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857652.081540:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857652.081546:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188175232:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857652.081597:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188175232 00000100:00100000:2.0:1787857652.081601:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188175232 00000100:00100000:2.0:1787857652.081634:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787857652.081640:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188175232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081675:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188175232:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857652.081682:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:2.0:1787857652.081698:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857652.081714:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188175232:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.081877:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188175360 00000100:00100000:2.0:1787857652.081881:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188175360 00000100:00100000:2.0:1787857652.081916:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188174976 00000100:00100000:2.0:1787857652.081919:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188174976 00000100:00100000:2.0:1787857652.081932:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188175104 00000100:00100000:2.0:1787857652.081934:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188175104 00000100:00100000:2.0:1787857652.081962:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787857652.081969:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188175360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.082017:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188175360:12345-0@lo:400:kworker.0 Request processed in 49us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857652.082023:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787857652.082035:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787857652.082041:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188174976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.082068:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188174976:12345-0@lo:400:kworker.0 Request processed in 27us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857652.082074:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787857652.082085:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787857652.082091:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188175104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.082120:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188175104:12345-0@lo:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857652.082125:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:2.0:1787857652.082138:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857652.082153:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188175104:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.082176:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188174976:0@lo:400:kworker.0 00000100:00100000:2.0:1787857652.082185:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188175360:0@lo:400:kworker.0 00000100:00100000:0.0:1787857652.102961:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.103312:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171521920 00000100:00100000:3.0:1787857652.103321:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171521920 00000100:00100000:3.0:1787857652.103392:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 662 00000100:00100000:3.0:1787857652.103401:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+68:21191:x1874704171521920:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:3.0:1787857652.103424:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857652.103449:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32e4 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.103512:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.103526:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.103539:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857652.104331:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857652.104337:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857652.104478:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.104508:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ac90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32e4 expref: 70 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.104538:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32e4 expref: 69 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.104548:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:3.0:1787857652.104551:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857652.104554:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7200, rc 0) 00000100:00100000:3.0:1787857652.104633:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+69:21191:x1874704171521920:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 1231us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857652.104641:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 662 00000100:00100000:2.0:1787857652.110663:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.120067:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171522176 00000100:00100000:3.0:1787857652.120084:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171522176 00000100:00100000:3.0:1787857652.120152:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 663 00000100:00100000:3.0:1787857652.120162:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+69:21191:x1874704171522176:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:3.0:1787857652.120237:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857652.120267:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ac97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32e4 expref: 69 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.120290:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:3.0:1787857652.120301:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857652.121248:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+68:21191:x1874704171522176:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 1083us (10589us total) trans 0 rc -17/-17 00000100:00100000:3.0:1787857652.121257:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 663 00000100:00100000:2.0:1787857652.124390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857652.124466:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171522304 00000100:00100000:1.0:1787857652.124478:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171522304 00000100:00100000:1.0:1787857652.124554:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 664 00000100:00100000:1.0:1787857652.124565:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+68:21191:x1874704171522304:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:1.0:1787857652.124587:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857652.124612:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ac9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32eb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.124690:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7aca5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.124722:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7aca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.124733:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7aca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857652.124995:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857652.125000:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857652.125083:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7aca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.125109:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ac9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32eb expref: 70 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.125125:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7aca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32eb expref: 69 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.125134:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857652.125136:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857652.125140:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706600, rc 0) 00000100:00100000:1.0:1787857652.125199:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+69:21191:x1874704171522304:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 636us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857652.125208:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 664 00000100:00100000:3.0:1787857652.128897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857652.129000:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171522432 00000100:00100000:2.0:1787857652.129010:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171522432 00000100:00100000:2.0:1787857652.129070:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 665 00000100:00100000:2.0:1787857652.129080:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+69:21191:x1874704171522432:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:2.0:1787857652.129098:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857652.129132:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7acac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32f2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129199:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129213:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129226:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129241:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129249:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129254:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129640:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7acc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129649:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7acc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129656:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7acc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857652.129749:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 7680 00000004:00200000:2.0:1787857652.129753:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857652.129869:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7acc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129888:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129895:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129902:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129907:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857652.129912:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129919:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129931:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:2.0:1787857652.129934:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857652.129939:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129945:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7acb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129969:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129975:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129981:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.129992:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857652.129995:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.130002:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.130010:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff9998d8aea600) 00010000:00010000:2.0:1787857652.130012:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857652.130014:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.130020:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7acba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.130050:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7acac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f2 expref: 71 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.130062:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7acc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f2 expref: 70 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.130069:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9998d8aea200) 00010000:00010000:2.0:1787857652.130072:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857652.130074:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0600, rc 0) 00000100:00100000:2.0:1787857652.130137:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+70:21191:x1874704171522432:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 1058us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857652.130144:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 665 00000001:00080000:1.0:1787857652.155454:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967732 is committed 00000001:00080000:1.0:1787857652.155473:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967733 is committed 00000100:00100000:2.0:1787857652.193618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857652.193849:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171522560 00000100:00100000:1.0:1787857652.193861:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171522560 00000100:00100000:1.0:1787857652.193988:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 666 00000100:00100000:1.0:1787857652.193998:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+28:21197:x1874704171522560:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857652.194029:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857652.194049:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7acc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd32f9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.194125:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.194139:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.194152:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857652.194360:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857652.194364:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857652.194458:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.194484:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7acc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.194501:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.194510:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857652.194512:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857652.194516:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00100000:1.0:1787857652.194585:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:21197:x1874704171522560:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 588us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857652.194591:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 666 00000100:00100000:2.0:1787857652.205142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.206379:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171522816 00000100:00100000:3.0:1787857652.206391:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171522816 00000100:00100000:3.0:1787857652.206772:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 667 00000100:00100000:3.0:1787857652.206786:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+69:21197:x1874704171522816:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857652.206808:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857652.206811:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787857652.206864:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7acc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f2 expref: 69 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.206883:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9998d8aea200) 00010000:00010000:3.0:1787857652.206892:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857652.206907:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7acd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3300 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.207405:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.207420:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.207561:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.207620:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.207627:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.207634:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210360:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210388:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210401:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857652.210413:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 0 00010000:00010000:3.0:1787857652.210442:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210448:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210454:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210460:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857652.210464:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210471:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210542:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9998d1291200) 00010000:00010000:3.0:1787857652.210546:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857652.210552:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210558:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7000/0xd3f183cab4a7acdd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857652.210573:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000888dc9d6 reply state 00000000df8b7b0d transno 4294967734 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857652.210587:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857652.210626:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7acd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 71 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210747:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 70 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.210755:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d1291500) 00010000:00010000:3.0:1787857652.210757:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857652.210759:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6200, rc 0) 00000100:00100000:3.0:1787857652.211187:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+71:21197:x1874704171522816:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 4403us (6052us total) trans 4294967734 rc 0/0 00000100:00100000:3.0:1787857652.211196:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 667 00000100:00100000:0.0:1787857652.214378:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.215929:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171523072 00000100:00100000:3.0:1787857652.215964:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171523072 00000100:00100000:3.0:1787857652.216026:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 668 00000100:00100000:3.0:1787857652.216036:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+71:21197:x1874704171523072:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857652.216061:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857652.216084:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7acf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3307 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.216186:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.216201:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 72 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.216231:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.216264:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 72 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.216279:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 72 pid: 5857 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857652.216293:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188175616:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857652.216396:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c53839c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787857652.219408:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.219426:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.219434:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.219440:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857652.219444:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.219452:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.219469:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x4a4b4929 (ffff9998d1291800) 00010000:00010000:1.0:1787857652.219472:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857652.219476:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.219595:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7ace4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857652.220348:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188175616:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857652.220379:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857652.223965:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.224055:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171523200 00000100:00100000:3.0:1787857652.224064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171523200 00010000:00010000:3.0:1787857652.224106:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 72 pid: 5857 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857652.224145:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 189 00000100:00100000:3.0:1787857652.224157:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d039a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+72:2349:x1874704171523200:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857652.224172:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857652.224179:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 72 pid: 5857 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.224211:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 72 pid: 5857 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.224235:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7aceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3300 expref: 72 pid: 5857 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.224252:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d1291500) 00010000:00010000:3.0:1787857652.224257:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.224266:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.224274:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.224300:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857652.224359:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d039a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+71:2349:x1874704171523200:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 205us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857652.224367:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 189 00010000:00010000:0.0:1787857652.224851:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.224861:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857652.224881:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 0 00010000:00010000:0.0:1787857652.225180:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225189:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225195:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225201:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857652.225206:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225213:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225224:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d1291500) 00010000:00010000:0.0:1787857652.225227:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857652.225231:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225237:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7ad00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225292:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7acf9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3307 expref: 71 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225302:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857652.225304:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857652.225308:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7acf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3307 expref: 71 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.225331:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00100000:0.0:1787857652.225370:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+70:21197:x1874704171523072:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 9335us (11003us total) trans 4294967735 rc 301/301 00000100:00100000:0.0:1787857652.225378:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 668 00000100:00100000:2.0:1787857652.229953:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.230297:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171523456 00000100:00100000:3.0:1787857652.230308:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171523456 00000100:00100000:3.0:1787857652.230367:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 137 00000100:00100000:3.0:1787857652.230376:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c5af3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+70:21197:x1874704171523456:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857652.232171:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c5af3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+71:21197:x1874704171523456:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1788us (2239us total) trans 4294967736 rc 0/0 00000100:00100000:2.0:1787857652.232183:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 137 00000100:00100000:3.0:1787857652.238379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857652.238455:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171523584 00000100:00100000:2.0:1787857652.238465:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171523584 00000100:00100000:2.0:1787857652.239273:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 669 00000100:00100000:2.0:1787857652.239287:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+71:21197:x1874704171523584:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857652.239312:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857652.239334:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7ad0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd330e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.239397:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7ad0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd330e expref: 72 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.239411:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45c00/0xd3f183cab4a7ad0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd330e expref: 72 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.239430:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d8aea600) 00010000:00010000:2.0:1787857652.239433:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857652.239437:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c1e45c00, rc 0) 00000100:00100000:2.0:1787857652.239501:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+72:21197:x1874704171523584:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 218us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857652.239508:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 669 00000100:00100000:1.0:1787857652.252253:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857652.252332:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171523840 00000100:00100000:0.0:1787857652.252342:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171523840 00000100:00100000:0.0:1787857652.252404:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 670 00000100:00100000:0.0:1787857652.252414:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+72:21197:x1874704171523840:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787857652.252475:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.252493:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.252505:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.253024:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.253034:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.253041:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.253046:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857652.253050:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.253072:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.253085:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d8aea600) 00010000:00010000:0.0:1787857652.253087:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787857652.253092:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.253098:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857652.253174:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+73:21197:x1874704171523840:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 760us (929us total) trans 4294967737 rc 0/0 00000100:00100000:0.0:1787857652.253183:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 670 00000100:00100000:0.0:1787857652.259198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.259436:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171524096 00000100:00100000:3.0:1787857652.259446:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171524096 00000100:00100000:3.0:1787857652.259521:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 671 00000100:00100000:3.0:1787857652.259531:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+73:21197:x1874704171524096:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857652.261446:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.261470:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.261600:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857652.261711:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967738 00000004:00010000:3.0:1787857652.261776:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008efb8afa reply state 000000007734c207 transno 4294967739 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857652.261787:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857652.262050:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+76:21197:x1874704171524096:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 2516us (2858us total) trans 4294967739 rc 0/0 00000100:00100000:3.0:1787857652.262775:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 671 00000020:00080000:3.0:1787857652.262786:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787857652.272395:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.272414:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.272421:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.272445:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857652.272450:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.272458:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.272476:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d8aea600) 00010000:00010000:1.0:1787857652.272479:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857652.272484:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.272490:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7ad1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857652.280098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857652.280198:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171524352 00000100:00100000:2.0:1787857652.280222:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171524352 00000100:00100000:2.0:1787857652.280751:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 138 00000100:00100000:2.0:1787857652.280764:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:21197:x1874704171524352:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857652.282175:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+76:21197:x1874704171524352:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1409us (2082us total) trans 4294967740 rc 0/0 00000100:00100000:2.0:1787857652.282186:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 138 00000100:00100000:3.0:1787857652.357182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857652.357424:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171524480 00000100:00100000:0.0:1787857652.357434:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171524480 00000100:00100000:0.0:1787857652.357498:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 672 00000100:00100000:0.0:1787857652.357508:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+76:21201:x1874704171524480:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857652.357532:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857652.357552:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3315 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.357616:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.357630:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.357670:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.357685:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.357692:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.357698:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358101:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ad38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358110:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ad38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358117:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ad38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857652.358146:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 7680 00000004:00200000:0.0:1787857652.358150:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857652.358170:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ad38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358182:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358187:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358204:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358210:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857652.358214:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358222:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358234:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857652.358237:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857652.358242:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358248:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ad2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358260:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358267:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358272:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358277:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857652.358280:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358301:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358309:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff9998d5316300) 00010000:00010000:0.0:1787857652.358312:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857652.358314:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358321:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ad31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358350:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3315 expref: 78 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358362:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090000/0xd3f183cab4a7ad38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3315 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.358369:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9998d5316200) 00010000:00010000:0.0:1787857652.358371:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857652.358374:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090000, rc 0) 00000100:00100000:0.0:1787857652.358433:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+77:21201:x1874704171524480:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 925us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857652.358441:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 672 00000100:00100000:2.0:1787857652.369864:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.369955:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171524736 00000100:00100000:3.0:1787857652.369968:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171524736 00000100:00100000:2.0:1787857652.370068:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 673 00000100:00100000:2.0:1787857652.370078:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+77:21201:x1874704171524736:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857652.370098:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857652.370117:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7ad3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd331c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370305:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370320:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370331:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370344:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370351:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370358:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370516:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7ad54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370525:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7ad54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.370926:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7ad54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857652.370938:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 158 00010000:00010000:2.0:1787857652.371071:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.371079:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.371085:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.371091:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857652.371096:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.371102:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.371115:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9998d5316200) 00010000:00010000:2.0:1787857652.371119:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857652.371123:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.371141:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7ad46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.371156:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374071:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374083:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374090:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857652.374095:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374104:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374562:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x4a4b4929 (ffff9998d8aead00) 00010000:00010000:2.0:1787857652.374572:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857652.374578:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374666:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7ad4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374776:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7ad3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd331c expref: 80 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374864:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1000/0xd3f183cab4a7ad54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd331c expref: 79 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857652.374873:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d8aea600) 00010000:00010000:2.0:1787857652.374875:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857652.374877:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999009d1000, rc 0) 00000100:00100000:2.0:1787857652.375303:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+79:21201:x1874704171524736:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5224us (5494us total) trans 4294967741 rc 0/0 00000100:00100000:2.0:1787857652.375313:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 673 00000100:00100000:3.0:1787857652.381795:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857652.382661:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171524864 00000100:00100000:0.0:1787857652.382672:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171524864 00000100:00100000:0.0:1787857652.382739:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 674 00000100:00100000:0.0:1787857652.382749:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+79:21201:x1874704171524864:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:0.0:1787857652.382869:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.382897:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.382909:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.382936:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.383105:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.383113:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.383119:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857652.383122:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.383129:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.383151:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d8aea600) 00010000:00010000:0.0:1787857652.383154:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857652.383159:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857652.383164:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ad62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857652.383252:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+79:21201:x1874704171524864:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 504us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857652.383261:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 674 00000100:00100000:3.0:1787857652.389911:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857652.392233:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171525120 00000100:00100000:0.0:1787857652.392258:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171525120 00000100:00100000:0.0:1787857652.392360:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 139 00000100:00100000:0.0:1787857652.392374:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+79:21201:x1874704171525120:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1787857652.393230:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:21201:x1874704171525120:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 851us (3329us total) trans 4294967742 rc 0/0 00000100:00100000:0.0:1787857652.393242:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 139 00010000:00010000:0.0:1787857652.462106:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857652.590644:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857652.590669:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188175744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857652.590757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857652.592658:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188175744 00000100:00100000:1.0:1787857652.592673:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188175744 00000100:00100000:1.0:1787857652.592759:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787857652.592770:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188175744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857652.592812:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857652.592930:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188175744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857652.592951:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787857652.593054:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188175744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857652.603569:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857652.603666:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171525376 00000100:00100000:3.0:1787857652.603677:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171525376 00000100:00100000:3.0:1787857652.604217:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 675 00000100:00100000:3.0:1787857652.604230:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:21220:x1874704171525376:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857652.604330:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857652.604369:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ad69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3323 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857652.604797:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 7680 00010000:00010000:3.0:1787857652.604977:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ad69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3323 expref: 82 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.604991:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:3.0:1787857652.604994:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857652.605000:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7ad69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3323 expref: 82 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857652.605016:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7200, rc 0) 00000100:00100000:3.0:1787857652.605170:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+81:21220:x1874704171525376:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 943us (1613us total) trans 4294967743 rc 301/301 00000100:00100000:3.0:1787857652.605178:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 675 00000100:00100000:2.0:1787857652.619056:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857652.619300:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171525504 00000100:00100000:1.0:1787857652.619311:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171525504 00000100:00100000:1.0:1787857652.619421:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 676 00000100:00100000:1.0:1787857652.619431:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+81:21220:x1874704171525504:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:1.0:1787857652.619506:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619534:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619546:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619561:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619569:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619575:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619677:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619698:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619706:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857652.619742:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 158 00000004:00200000:1.0:1787857652.619746:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857652.619759:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619772:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619790:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619797:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619804:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857652.619808:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619845:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619858:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9998d5316200) 00010000:00010000:1.0:1787857652.619862:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857652.619868:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619874:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619889:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619895:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619902:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619907:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857652.619916:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619923:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619932:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x4a4b4929 (ffff9998c3984d00) 00010000:00010000:1.0:1787857652.619935:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857652.619949:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.619956:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.620022:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.620029:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.620036:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.620041:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857652.620044:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.620050:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.620057:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9998d8aea600) 00010000:00010000:1.0:1787857652.620060:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857652.620070:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857652.620076:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857652.620218:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+81:21220:x1874704171525504:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 787us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857652.620227:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 676 00000100:00100000:0.0:1787857652.624262:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857652.626985:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171525760 00000100:00100000:2.0:1787857652.627002:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171525760 00000100:00100000:2.0:1787857652.627085:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 140 00000100:00100000:2.0:1787857652.627097:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+81:21220:x1874704171525760:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1787857652.628833:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:21220:x1874704171525760:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 1711us (4552us total) trans 4294967744 rc 0/0 00000100:00100000:2.0:1787857652.628847:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 140 00000040:00080000:2.0:1787857653.295045:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857653.295063:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857653.295116:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:2.0:1787857653.295124:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857653.486083:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857653.843309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857653.843360:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857653.843369:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171525888 00000100:00100000:0.0:1787857653.843382:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171525888 00000100:00100000:1.0:1787857653.843393:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857653.843417:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857653.843444:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857653.843444:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 354 00000100:00100000:0.0:1787857653.843455:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171525888:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857653.843468:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171526144 00000100:00100000:1.0:1787857653.843471:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171526144 00000100:00100000:1.0:1787857653.843513:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171526272 00000100:00100000:1.0:1787857653.843517:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171526272 00000100:00100000:1.0:1787857653.843539:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 253 00000100:00100000:1.0:1787857653.843546:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2349:x1874704171526144:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857653.843550:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171525888:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 97us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857653.843558:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 354 00000100:00100000:1.0:1787857653.843574:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2349:x1874704171526144:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857653.843581:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 253 00000100:00100000:1.0:1787857653.843592:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 254 00000100:00100000:1.0:1787857653.843598:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171526272:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857653.843631:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+9:2349:x1874704171526272:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857653.843637:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 254 00000100:00100000:1.0:1787857653.843671:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171526016 00000100:00100000:1.0:1787857653.843675:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171526016 00000100:00100000:1.0:1787857653.843704:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171526400 00000100:00100000:1.0:1787857653.843707:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171526400 00000100:00100000:0.0:1787857653.843719:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 292 00000100:00100000:0.0:1787857653.843733:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+82:2349:x1874704171526016:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857653.843773:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+82:2349:x1874704171526016:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857653.847460:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 293 00000100:00100000:1.0:1787857653.847495:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2350:x1874704171526400:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857653.847602:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2350:x1874704171526400:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 126us (4156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857653.848145:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 293 00000100:00080000:1.0:1787857653.848198:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857653.848206:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857653.848210:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857653.852085:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 292 00000100:00100000:1.0:1787857653.852197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857653.859757:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171526656 00000100:00100000:0.0:1787857653.859776:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171526656 00000100:00100000:0.0:1787857653.859879:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 255 00000100:00100000:0.0:1787857653.859891:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171526656:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857653.860087:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171526656:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 197us (7890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857653.860094:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 255 00000100:00080000:0.0:1787857653.860120:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857653.860183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857653.861430:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171526528 00000100:00100000:0.0:1787857653.861442:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171526528 00000100:00100000:0.0:1787857653.861518:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 256 00000100:00100000:0.0:1787857653.861528:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171526528:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857653.861591:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171526528:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 65us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857653.861598:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 256 00000100:00080000:0.0:1787857653.861674:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787857654.511092:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857655.535145:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857655.662116:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188175872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857655.662442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857655.662929:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188175872 00000100:00100000:0.0:1787857655.662938:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188175872 00000100:00100000:0.0:1787857655.663114:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787857655.663126:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188175872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857655.663183:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857655.663249:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188175872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857655.663256:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787857655.663278:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188175872:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857655.663978:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787857656.558396:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857657.201384:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188176000:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.201466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857657.201521:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188176512:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.201553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857657.201580:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857657.201586:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188176128:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.201606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857657.201620:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188176640:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.201642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857657.201687:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188176256:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.201711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857657.201732:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857657.201737:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188176384:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.201760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857657.201792:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188176000 00000100:00100000:2.0:1787857657.201799:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188176000 00000100:00100000:2.0:1787857657.201959:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787857657.201968:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188176000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202017:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188176000:12345-0@lo:400:kworker.0 Request processed in 51us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857657.202024:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787857657.202054:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188176512 00000100:00100000:2.0:1787857657.202058:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188176512 00000100:00100000:2.0:1787857657.202093:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188176128 00000100:00100000:2.0:1787857657.202108:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188176128 00000100:00100000:2.0:1787857657.202124:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188176256 00000100:00100000:2.0:1787857657.202126:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188176256 00000100:00100000:2.0:1787857657.202141:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787857657.202146:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188176512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202179:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188176512:12345-0@lo:400:kworker.0 Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857657.202185:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787857657.202197:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787857657.202204:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188176128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202229:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188176128:12345-0@lo:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857657.202235:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787857657.202246:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787857657.202252:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188176256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202284:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188176256:12345-0@lo:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857657.202289:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787857657.202309:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188176640 00000100:00100000:2.0:1787857657.202312:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188176640 00000100:00100000:2.0:1787857657.202341:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188176384 00000100:00100000:2.0:1787857657.202344:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188176384 00000100:00100000:2.0:1787857657.202365:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787857657.202372:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188176640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202401:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188176640:12345-0@lo:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857657.202406:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787857657.202425:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787857657.202431:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188176384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202459:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188176384:12345-0@lo:400:kworker.0 Request processed in 29us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857657.202465:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:2.0:1787857657.202648:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857657.202652:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857657.202655:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857657.202699:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188176128:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202711:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188176640:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202720:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188176000:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202729:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188176512:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202763:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188176384:0@lo:400:kworker.0 00000100:00100000:2.0:1787857657.202772:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188176256:0@lo:400:kworker.0 00000001:00080000:2.0:1787857657.245927:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967742 is committed 00000001:00080000:2.0:1787857657.246181:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967744 is committed 00010000:00010000:3.0:1787857657.582466:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857657.710226:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188176768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857657.710301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857657.710383:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188176768 00000100:00100000:2.0:1787857657.710391:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188176768 00000100:00100000:2.0:1787857657.710443:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787857657.710453:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188176768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857657.710499:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857657.710546:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188176768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857657.710567:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787857657.710618:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188176768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857658.606715:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857658.974777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857658.974863:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857658.974952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857658.975046:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171526912 00000100:00100000:1.0:1787857658.975056:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171526912 00000100:00100000:1.0:1787857658.975130:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00100000:1.0:1787857658.975141:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+71:2347:x1874704171526912:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857658.975214:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+71:2347:x1874704171526912:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857658.975221:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00080000:0.0:1787857658.975481:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857658.975577:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171527040 00000100:00100000:3.0:1787857658.975582:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171527040 00000100:00100000:3.0:1787857658.975630:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 259 00000100:00100000:3.0:1787857658.975639:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171527040:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857658.975679:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171527040:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 42us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857658.975686:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 259 00000100:00080000:0.0:1787857658.975766:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857658.975788:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171526784 00000100:00100000:2.0:1787857658.975795:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171526784 00000100:00100000:2.0:1787857658.975889:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 356 00000100:00100000:2.0:1787857658.975898:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171526784:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857658.975945:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171526784:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 49us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857658.975953:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 356 00000100:00100000:1.0:1787857658.977726:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857658.977769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857658.977805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857658.978436:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171527168 00000100:00100000:2.0:1787857658.978444:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171527168 00000100:00100000:2.0:1787857658.978512:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171527424 00000100:00100000:2.0:1787857658.978515:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171527424 00000100:00100000:2.0:1787857658.978542:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00100000:2.0:1787857658.978550:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171527168:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857658.978608:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+9:2347:x1874704171527168:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 58us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857658.978616:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00100000:2.0:1787857658.978632:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 261 00000100:00100000:2.0:1787857658.978638:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171527424:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857658.978663:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171527424:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857658.978669:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 261 00000100:00080000:1.0:1787857658.978869:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857658.978873:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857658.978922:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171527296 00000100:00100000:3.0:1787857658.978927:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171527296 00000100:00100000:3.0:1787857658.978975:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 298 00000100:00100000:3.0:1787857658.978995:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2348:x1874704171527296:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857658.979023:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:2348:x1874704171527296:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857658.979029:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 298 00000100:00080000:1.0:1787857658.979187:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857658.991106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857658.991194:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171527552 00000100:00100000:1.0:1787857658.991216:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171527552 00000100:00100000:1.0:1787857658.991301:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00100000:1.0:1787857658.991312:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171527552:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857658.991412:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171527552:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857658.991420:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00080000:0.0:1787857658.992181:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857659.630185:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857660.257508:0:17044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 15:07:37 (1787857657) 00010000:00010000:3.0:1787857660.654194:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857660.730923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857660.738393:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171527808 00000100:00100000:1.0:1787857660.738409:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171527808 00000100:00100000:1.0:1787857660.738876:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 677 00000100:00100000:1.0:1787857660.738902:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:21840:x1874704171527808:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857660.738929:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857660.738949:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd332a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739021:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739046:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739059:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739125:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739133:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739140:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739619:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ada1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739630:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ada1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.739638:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ada1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857660.739647:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787857660.742803:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743176:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743188:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743194:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.743293:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743302:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743318:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:1.0:1787857660.743320:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.743325:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743346:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7ad93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743360:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743366:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743372:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743377:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.743380:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743385:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743392:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9998c3984800) 00010000:00010000:1.0:1787857660.743394:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.743397:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.743402:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ad9a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787857660.744379:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857660.745303:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ad8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd332a expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.745324:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ada1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd332a expref: 31 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.745340:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857660.745343:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.745346:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c0030200, rc 0) 00000100:00100000:1.0:1787857660.745409:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21840:x1874704171527808:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6515us (14505us total) trans 4294967745 rc 0/0 00000100:00100000:1.0:1787857660.745418:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 677 00000100:00100000:3.0:1787857660.750622:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857660.750924:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171527936 00000100:00100000:0.0:1787857660.750936:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171527936 00000100:00100000:0.0:1787857660.751002:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 678 00000100:00100000:0.0:1787857660.751012:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21840:x1874704171527936:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857660.751221:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21840:x1874704171527936:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 210us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857660.751229:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 678 00000100:00100000:3.0:1787857660.754255:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857660.754812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857660.754864:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171528192 00000100:00100000:3.0:1787857660.754874:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171528192 00000100:00100000:3.0:1787857660.754932:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:3.0:1787857660.754941:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2347:x1874704171528192:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857660.754956:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857660.754982:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ada1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd332a expref: 31 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857660.755002:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857660.755007:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857660.755054:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:2347:x1874704171528192:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857660.755062:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:1.0:1787857660.757048:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171528064 00000100:00100000:1.0:1787857660.757061:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171528064 00000100:00100000:0.0:1787857660.757288:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 679 00000100:00100000:0.0:1787857660.757297:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+71:21841:x1874704171528064:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857660.757316:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857660.757335:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3331 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757422:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757451:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757462:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757479:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757486:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757493:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757759:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757768:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757775:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757791:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.757795:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757804:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757845:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857660.757853:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.757867:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757874:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7adb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757893:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757899:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757905:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757909:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.757912:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757919:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757925:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff9998d5316300) 00010000:00010000:0.0:1787857660.757928:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.757931:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757937:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7adbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757964:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3331 expref: 72 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.757984:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857660.757987:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.757991:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3331 expref: 72 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.758000:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090a00, rc 0) 00000100:00100000:0.0:1787857660.758128:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+71:21841:x1874704171528064:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 832us (3888us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857660.758136:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 679 00000100:00080000:1.0:1787857660.760063:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857660.767364:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857660.767452:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171528448 00000100:00100000:2.0:1787857660.767462:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171528448 00000100:00100000:2.0:1787857660.768240:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 680 00000100:00100000:2.0:1787857660.768251:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+71:21841:x1874704171528448:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:2.0:1787857660.768314:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857660.768343:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7aca5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32eb expref: 71 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.768363:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:2.0:1787857660.768369:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857660.768742:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.768758:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.768767:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.768897:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.768913:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 29 pid: 5858 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857660.768928:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188176896:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857660.769098:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857660.772899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857660.773211:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171528576 00000100:00100000:1.0:1787857660.773221:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171528576 00010000:00010000:1.0:1787857660.773262:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 30 pid: 5858 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857660.773307:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 190 00000100:00100000:1.0:1787857660.773317:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:2350:x1874704171528576:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857660.773333:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857660.773340:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 30 pid: 5858 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.773353:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 30 pid: 5858 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.773383:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857660.773389:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.773425:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.773434:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.773453:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857660.773520:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:2350:x1874704171528576:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 205us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857660.773528:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 190 00010000:00010000:2.0:1787857660.774113:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7accf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd32f9 expref: 29 pid: 5858 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857660.774134:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188176896:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857660.774159:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.774168:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.774176:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.774200:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.774210:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.774218:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857660.777193:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00010000:00010000:2.0:1787857660.777211:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.777222:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.777229:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.777246:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d0400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857660.777251:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.777258:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.777276:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984400) 00010000:00010000:2.0:1787857660.777279:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857660.777283:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.777290:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7adc4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857660.777311:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6eace49 reply state 000000007d47cefa transno 4294967746 ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857660.777319:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857660.777607:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+72:21841:x1874704171528448:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 9353us (10247us total) trans 4294967746 rc 0/0 00000100:00100000:2.0:1787857660.777617:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 680 00000100:00100000:1.0:1787857660.782205:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857660.782233:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188177024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857660.782321:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857660.782489:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188177024 00000100:00100000:2.0:1787857660.782499:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188177024 00000100:00100000:2.0:1787857660.782575:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787857660.782586:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188177024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857660.782627:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787857660.782844:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857660.782928:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188177024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 343us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857660.782951:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787857660.783038:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188177024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857660.785723:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.785742:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.785750:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.785756:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999009d1e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.785761:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.785769:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.785841:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff9998d8aeae00) 00010000:00010000:1.0:1787857660.785845:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.785851:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.785858:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7adcb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857660.795282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857660.796207:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171528704 00000100:00100000:2.0:1787857660.796220:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171528704 00000100:00100000:2.0:1787857660.796290:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 681 00000100:00100000:2.0:1787857660.796301:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+71:21842:x1874704171528704:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857660.796326:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857660.796351:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7add2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3338 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.796422:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7add9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.796437:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7add9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.796448:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7add9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857660.796527:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857660.796532:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857660.796554:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7add9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.796577:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7add2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3338 expref: 73 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.796606:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7add9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3338 expref: 72 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.796635:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:2.0:1787857660.796638:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857660.796642:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999009d1e00, rc 0) 00000100:00100000:2.0:1787857660.796982:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+72:21842:x1874704171528704:12345-192.168.204.36@tcp:101:bash.0 Request processed in 425us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857660.796993:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 681 00000100:00100000:3.0:1787857660.800742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857660.800870:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171528832 00000100:00100000:0.0:1787857660.800879:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171528832 00000100:00100000:0.0:1787857660.800936:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 682 00000100:00100000:0.0:1787857660.800946:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+72:21842:x1874704171528832:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857660.800966:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857660.800987:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ade0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd333f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.801090:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.801104:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.801116:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.802959:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.802975:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.802988:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.803120:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2800/0xd3f183cab4a7adf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.803129:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2800/0xd3f183cab4a7adf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.803136:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2800/0xd3f183cab4a7adf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857660.804283:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:0.0:1787857660.804287:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857660.804313:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2800/0xd3f183cab4a7adf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804327:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804333:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804340:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804367:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.804372:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804380:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804395:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:0.0:1787857660.804398:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.804404:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804410:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ade7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804425:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804431:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804436:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804441:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.804444:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804450:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804467:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff9998d5316300) 00010000:00010000:0.0:1787857660.804469:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.804473:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804478:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7adee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.804998:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ade0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd333f expref: 74 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.805019:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2800/0xd3f183cab4a7adf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd333f expref: 73 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.805026:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857660.805029:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857660.805032:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999014e2800, rc 0) 00000100:00100000:0.0:1787857660.805121:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+73:21842:x1874704171528832:12345-192.168.204.36@tcp:101:bash.0 Request processed in 4174us (4386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857660.805130:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 682 00000100:00100000:0.0:1787857660.810283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857660.810423:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171528960 00000100:00100000:1.0:1787857660.810433:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171528960 00000100:00100000:1.0:1787857660.810504:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 683 00000100:00100000:1.0:1787857660.810514:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+73:21842:x1874704171528960:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857660.810538:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857660.810937:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7adfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3346 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811011:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811026:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811037:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811070:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811077:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811094:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811168:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811175:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811181:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811186:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.811190:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811197:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811209:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:1.0:1787857660.811212:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.811216:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811223:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811234:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811240:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811251:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811257:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.811259:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811266:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811273:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998c3984800) 00010000:00010000:1.0:1787857660.811275:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.811278:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811284:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811316:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7adfc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3346 expref: 74 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811326:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:1.0:1787857660.811328:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.811331:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7adfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3346 expref: 74 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.811341:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c0030200, rc 0) 00000100:00100000:1.0:1787857660.811398:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+73:21842:x1874704171528960:12345-192.168.204.36@tcp:101:bash.0 Request processed in 886us (1130us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857660.811412:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 683 00000100:00100000:3.0:1787857660.829389:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857660.831274:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171529088 00000100:00100000:2.0:1787857660.831289:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171529088 00000100:00100000:2.0:1787857660.831426:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 684 00000100:00100000:2.0:1787857660.831438:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+29:21843:x1874704171529088:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857660.831461:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857660.831494:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7ae11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd334d expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.831586:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.831601:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.831614:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857660.831686:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857660.831689:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857660.831712:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.831764:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0400/0xd3f183cab4a7ae11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 31 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.831812:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.831877:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:2.0:1787857660.831881:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857660.831884:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52200, rc 0) 00000100:00100000:2.0:1787857660.831969:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:21843:x1874704171529088:12345-192.168.204.36@tcp:101:rm.0 Request processed in 533us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857660.831977:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 684 00000100:00100000:3.0:1787857660.851913:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857660.852123:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171529216 00000100:00100000:1.0:1787857660.852132:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171529216 00000100:00100000:1.0:1787857660.852190:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 685 00000100:00100000:1.0:1787857660.852199:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:21843:x1874704171529216:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857660.852221:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857660.852241:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3354 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852312:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852327:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852340:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852366:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852374:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852380:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852487:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ae34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852516:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ae34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852524:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ae34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857660.852565:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:1.0:1787857660.852569:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857660.852589:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ae34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852600:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852606:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852614:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852620:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.852623:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852630:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852642:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:1.0:1787857660.852645:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.852649:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852664:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852679:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852685:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852691:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852695:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.852698:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852705:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852712:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff9998c3984800) 00010000:00010000:1.0:1787857660.852714:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.852716:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852721:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.852755:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3354 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.853069:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707800/0xd3f183cab4a7ae34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3354 expref: 31 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.853089:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:1.0:1787857660.853091:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857660.853093:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707800, rc 0) 00000100:00100000:1.0:1787857660.853257:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21843:x1874704171529216:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1057us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857660.853265:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 685 00000100:00100000:3.0:1787857660.857378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857660.859530:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171529344 00000100:00100000:0.0:1787857660.859543:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171529344 00000100:00100000:0.0:1787857660.859601:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 686 00000100:00100000:0.0:1787857660.859610:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21843:x1874704171529344:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857660.859630:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857660.859650:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ae3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd335b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859731:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859746:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859757:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859794:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859802:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859809:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859896:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859904:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859910:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859916:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999014e3a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.859921:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859939:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859951:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857660.859954:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.859959:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859965:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7ae42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859980:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859986:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859992:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.859997:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.860000:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.860005:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.860011:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998d5316300) 00010000:00010000:0.0:1787857660.860013:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.860016:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.860030:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.860061:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ae3b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd335b expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.860071:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857660.860084:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.860088:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7ae3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd335b expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.860097:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999014e3e00, rc 0) 00000100:00100000:0.0:1787857660.860175:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21843:x1874704171529344:12345-192.168.204.36@tcp:101:rm.0 Request processed in 565us (2805us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857660.860182:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 686 00000100:00100000:3.0:1787857660.864917:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857660.865031:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171529472 00000100:00100000:2.0:1787857660.865040:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171529472 00000100:00100000:2.0:1787857660.865220:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 687 00000100:00100000:2.0:1787857660.865230:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21843:x1874704171529472:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857660.865248:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857660.865269:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ae50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3362 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865334:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865348:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865358:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865389:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865396:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865416:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865491:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865498:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865505:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865511:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857660.865515:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865522:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865533:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:2.0:1787857660.865536:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857660.865541:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865548:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865566:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865572:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865579:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865584:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857660.865587:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865592:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865598:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998d8aea200) 00010000:00010000:2.0:1787857660.865600:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857660.865603:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865609:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865639:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ae50 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3362 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865649:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:2.0:1787857660.865651:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857660.865659:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ae50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3362 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.865669:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:2.0:1787857660.865729:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21843:x1874704171529472:12345-192.168.204.36@tcp:101:rm.0 Request processed in 501us (821us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857660.865737:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 687 00000100:00100000:3.0:1787857660.900492:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857660.900640:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171529600 00000100:00100000:0.0:1787857660.900650:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171529600 00000100:00100000:0.0:1787857660.900757:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 688 00000100:00100000:0.0:1787857660.900785:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21844:x1874704171529600:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857660.900806:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857660.900868:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3369 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.900942:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.900957:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.900982:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.900999:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901006:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901012:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901077:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901084:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901091:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901097:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.901102:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901120:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901132:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857660.901135:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.901139:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901151:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7ae6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901174:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901180:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901187:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901192:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.901195:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901200:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901208:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998d5316300) 00010000:00010000:0.0:1787857660.901210:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.901213:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901219:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ae73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901251:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae65 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3369 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901274:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857660.901277:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.901281:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ae65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3369 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.901300:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091a00, rc 0) 00000100:00100000:0.0:1787857660.901364:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21844:x1874704171529600:12345-192.168.204.36@tcp:101:cp.0 Request processed in 599us (881us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857660.901371:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 688 00000100:00100000:0.0:1787857660.913969:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857660.914194:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171529728 00000100:00100000:1.0:1787857660.914212:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171529728 00000100:00100000:1.0:1787857660.914273:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 689 00000100:00100000:1.0:1787857660.914283:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21844:x1874704171529728:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857660.914302:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857660.914320:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3370 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914380:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914393:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914405:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914418:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914425:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914448:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914531:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914538:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914545:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914551:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.914555:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914563:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914573:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:1.0:1787857660.914576:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.914580:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914586:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7ae81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914598:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914604:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914616:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914621:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857660.914624:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914630:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914638:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998c3984800) 00010000:00010000:1.0:1787857660.914640:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.914643:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914649:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7ae88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914678:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae7a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3370 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914688:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:1.0:1787857660.914690:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857660.914693:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7ae7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3370 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857660.914702:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706600, rc 0) 00000100:00100000:1.0:1787857660.914786:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21844:x1874704171529728:12345-192.168.204.36@tcp:101:cp.0 Request processed in 495us (818us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857660.914803:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 689 00000100:00100000:3.0:1787857660.931407:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857660.931487:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171529984 00000100:00100000:2.0:1787857660.931496:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171529984 00000100:00100000:2.0:1787857660.931559:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 690 00000100:00100000:2.0:1787857660.931568:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21844:x1874704171529984:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857660.931587:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857660.931605:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ae8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3377 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.931744:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.931759:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.931770:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.931799:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.931808:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.931814:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857660.934396:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe:0x0], index 0: 0 00010000:00010000:2.0:1787857660.934621:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934636:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934651:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934684:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934692:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934699:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934705:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857660.934709:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934717:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934739:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:2.0:1787857660.934742:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857660.934747:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934765:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7ae96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857660.934789:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce5bb9bb reply state 000000001bc81e76 transno 4294967747 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857660.934798:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857660.934875:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ae8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 34 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934958:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 33 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.934966:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:2.0:1787857660.934968:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857660.934971:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52600, rc 0) 00000100:00100000:2.0:1787857660.935036:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21844:x1874704171529984:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3468us (3639us total) trans 4294967747 rc 0/0 00000100:00100000:2.0:1787857660.935045:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 690 00010000:00010000:0.0:1787857660.939255:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.939272:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.939280:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.939287:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857660.939301:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.939308:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.939325:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998d8aea200) 00010000:00010000:0.0:1787857660.939328:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857660.939356:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.939363:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ae9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857660.943068:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857660.945505:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171530112 00000100:00100000:2.0:1787857660.945520:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171530112 00000100:00100000:2.0:1787857660.945682:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 169 00000100:00100000:2.0:1787857660.945694:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171530112:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857660.945715:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857660.945740:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd337e expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857660.945843:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857660.945868:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1787857660.945873:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857660.945883:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 9 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.945903:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 9 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.945917:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53c00, rc 0) 00000100:00100000:2.0:1787857660.945989:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171530112:12345-192.168.204.36@tcp:101:cp.0 Request processed in 297us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857660.945996:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 169 00000100:00080000:0.0:1787857660.953487:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857660.956331:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857660.956401:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171530240 00000100:00100000:0.0:1787857660.956411:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171530240 00000100:00100000:0.0:1787857660.961176:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 170 00000100:00100000:0.0:1787857660.961201:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:21844:x1874704171530240:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857660.961222:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857660.961242:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3385 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.961275:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.961285:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787857660.961289:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857660.961294:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.961341:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.961356:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 10 pid: 14028 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857660.961388:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188177152:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857660.961500:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857660.965467:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857660.965558:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171530368 00000100:00100000:2.0:1787857660.965567:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171530368 00010000:00010000:2.0:1787857660.965625:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 11 pid: 14028 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857660.965672:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00100000:2.0:1787857660.965682:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171530368:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857660.965696:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857660.965721:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 11 pid: 14028 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.965759:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 11 pid: 14028 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.965844:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857660.965850:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857660.965859:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.965871:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857660.965912:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857660.965928:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188177280:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857660.966011:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f72950c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787857660.967322:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8da7ff0/0xd3f183cab4a7aeb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd337e expref: 11 pid: 14028 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857660.967344:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188177152:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857660.967371:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857660.967384:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090200, rc 0) 00000100:00100000:0.0:1787857660.967446:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:21844:x1874704171530240:12345-192.168.204.36@tcp:101:cp.0 Request processed in 6259us (11137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857660.967455:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 170 00000100:00100000:2.0:1787857660.973743:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188177280:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857660.974546:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857660.974787:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171530368:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 9087us (9310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857660.974801:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00100000:3.0:1787857660.978337:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857660.978496:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171530624 00000100:00100000:2.0:1787857660.978505:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171530624 00000100:00100000:2.0:1787857660.978558:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 141 00000100:00100000:2.0:1787857660.978568:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:21844:x1874704171530624:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:2.0:1787857660.979020:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21844:x1874704171530624:12345-192.168.204.36@tcp:35:cp.0 Request processed in 451us (690us total) trans 4294967748 rc 0/0 00000100:00100000:2.0:1787857660.979045:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 141 00000100:00100000:0.0:1787857661.077224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857661.077420:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171530752 00000100:00100000:1.0:1787857661.077432:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171530752 00000100:00100000:1.0:1787857661.077505:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 691 00000100:00100000:1.0:1787857661.077515:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+73:21847:x1874704171530752:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857661.077541:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857661.077564:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7aec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd338c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077672:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077687:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077701:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077717:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077724:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077731:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077909:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aed5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077929:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.077937:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857661.077975:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00000004:00200000:1.0:1787857661.077980:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857661.077996:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078008:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078016:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078023:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078029:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078035:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857661.078039:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078046:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078058:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:1.0:1787857661.078068:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857661.078073:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078079:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7aec7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078093:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078100:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078105:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078110:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857661.078113:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078119:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078126:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998c3984800) 00010000:00010000:1.0:1787857661.078129:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857661.078131:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078137:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7aece lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078168:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7aec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd338c expref: 75 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078190:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd338c expref: 74 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.078197:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:1.0:1787857661.078199:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857661.078202:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707c00, rc 0) 00000100:00100000:1.0:1787857661.078273:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+74:21847:x1874704171530752:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 759us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857661.078281:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 691 00000100:00100000:3.0:1787857661.088138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857661.088240:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171530880 00000100:00100000:2.0:1787857661.088250:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171530880 00000100:00100000:2.0:1787857661.088343:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 171 00000100:00100000:2.0:1787857661.088355:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2349:x1874704171530880:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857661.088373:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857661.088391:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3465082/0xd3f183cab4a7aedc lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3393 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857661.088448:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188177408:192.168.204.36@tcp:106: 00000100:00080000:0.0:1787857661.088622:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857661.089553:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b7fa80 going to sleep for 11 seconds 00002000:00010000:2.0:1787857661.099156:0:6711:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857661.099166:0:6711:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime: 0 -> 1787857660 00002000:00010000:2.0:1787857661.099168:0:6711:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb atime: 0 -> 1787857660 00002000:00010000:2.0:1787857661.099171:0:6711:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime: 0 -> 1787857660 00000100:00100000:2.0:1787857661.099198:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188177408:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857661.099465:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3465082/0xd3f183cab4a7aedc lrc: 1/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3393 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.099494:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3465082/0xd3f183cab4a7aedc lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3393 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.099510:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:2.0:1787857661.099670:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2349:x1874704171530880:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 11317us (11539us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857661.099695:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 171 00000100:00100000:1.0:1787857661.111009:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857661.111097:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171531008 00000100:00100000:0.0:1787857661.111106:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171531008 00000100:00100000:0.0:1787857661.111169:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 692 00000100:00100000:0.0:1787857661.111179:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:21847:x1874704171531008:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857661.111201:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857661.111225:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7aee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd339a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.111294:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aeea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.111334:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aeea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.111347:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aeea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857661.111416:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:0.0:1787857661.111420:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857661.111443:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aeea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.111484:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7aee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd339a expref: 76 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.111503:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aeea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd339a expref: 75 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.111512:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857661.111516:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857661.111519:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091a00, rc 0) 00000100:00100000:0.0:1787857661.113908:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+75:21847:x1874704171531008:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2718us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857661.113920:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 692 00000100:00100000:3.0:1787857661.128223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857661.128369:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171531136 00000100:00100000:1.0:1787857661.128378:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171531136 00000100:00100000:1.0:1787857661.128439:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 172 00000100:00100000:1.0:1787857661.128451:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171531136:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857661.128469:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857661.128494:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7aef1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33a1 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857661.128550:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188177536:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857661.128634:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2a8b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857661.130903:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188177536:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857661.130939:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7aef1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33a1 expref: 11 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.130984:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7aef1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33a1 expref: 11 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.130997:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707400, rc 0) 00000100:00100000:1.0:1787857661.131050:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171531136:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2602us (2837us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857661.131058:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 172 00000100:00100000:0.0:1787857661.137265:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857661.137873:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171531392 00000100:00100000:1.0:1787857661.137883:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171531392 00000100:00100000:1.0:1787857661.137952:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 693 00000100:00100000:1.0:1787857661.137964:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:21847:x1874704171531392:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1787857661.138270:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 136 off10368 00000100:00100000:1.0:1787857661.138377:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:21847:x1874704171531392:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 415us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857661.138385:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 693 00000040:00080000:1.0:1787857661.487024:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857661.487034:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857661.487081:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 3 00000040:00080000:1.0:1787857661.487090:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857661.487353:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188177664:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857661.487452:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2a8bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857661.491162:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188177664:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857661.496133:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857661.501658:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171531520 00000100:00100000:0.0:1787857661.501673:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171531520 00000100:00100000:0.0:1787857661.501742:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 694 00000100:00100000:0.0:1787857661.501752:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21857:x1874704171531520:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857661.501841:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x12:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857661.501944:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21857:x1874704171531520:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 193us (5820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857661.501952:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 694 00000100:00100000:3.0:1787857661.522418:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857661.522577:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171531776 00000100:00100000:2.0:1787857661.522587:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171531776 00000100:00100000:2.0:1787857661.522650:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 695 00000100:00100000:2.0:1787857661.522661:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21857:x1874704171531776:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857661.522681:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857661.522698:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7aef8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33a8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.522966:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52000/0xd3f183cab4a7aeff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.522982:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52000/0xd3f183cab4a7aeff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.522994:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52000/0xd3f183cab4a7aeff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857661.523005:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00010000:00010000:2.0:1787857661.523123:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7aef8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33a8 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.523141:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52000/0xd3f183cab4a7aeff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33a8 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.523150:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:2.0:1787857661.523153:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857661.523156:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52000, rc 0) 00000100:00100000:2.0:1787857661.523330:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21857:x1874704171531776:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 671us (921us total) trans 4294967749 rc 0/0 00000100:00100000:2.0:1787857661.523339:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 695 00000100:00100000:1.0:1787857661.531904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857661.531954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857661.532085:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171531904 00000100:00100000:0.0:1787857661.532180:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171531904 00000100:00100000:0.0:1787857661.532240:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 173 00000100:00100000:0.0:1787857661.532255:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171531904:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857661.532305:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.532330:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.532339:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857661.532343:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857661.532348:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 4/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.532385:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.532398:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 9 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857661.532413:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188177792:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857661.532616:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787857661.532808:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171532032 00000100:00100000:2.0:1787857661.532813:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171532032 00000100:00100000:2.0:1787857661.532876:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00100000:2.0:1787857661.532884:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2348:x1874704171532032:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857661.532895:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857661.532918:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52000/0xd3f183cab4a7aeff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33a8 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.532935:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:2.0:1787857661.532940:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857661.532978:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2348:x1874704171532032:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 95us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857661.532986:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00100000:1.0:1787857661.549063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857661.549099:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171532160 00000100:00100000:1.0:1787857661.549107:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171532160 00002000:00100000:1.0:1787857661.549156:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->157) req@ffff9998ffa88f00 x1874704171532160/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:307/0 lens 648/0 e 0 to 0 dl 1787857672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857661.549168:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa88f00 with x1874704171532160 ext(0->157) 00010000:00010000:1.0:1787857661.549179:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 10 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.549258:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 10 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857661.549268:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998ffa88f00 00000100:00100000:1.0:1787857661.549306:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:1.0:1787857661.549316:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171532160:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:3.0:1787857661.549740:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188177792:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857661.549786:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857661.550912:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2347:x1874704171532160:12345-192.168.204.36@tcp:4:cp.0 Request processed in 1592us (1855us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787857661.551043:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00002000:00100000:1.0:1787857661.551055:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->157) req@ffff9998ffa88f00 x1874704171532160/t4294967325(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:307/0 lens 648/448 e 0 to 0 dl 1787857672 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857661.551066:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa88f00 with x1874704171532160 ext(0->157) 00010000:00010000:1.0:1787857661.551074:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 12 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.551090:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 12 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857661.551106:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998ffa88f00 00000100:00100000:1.0:1787857661.559029:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857661.559121:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171532288 00000100:00100000:2.0:1787857661.559130:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171532288 00010000:00010000:2.0:1787857661.559169:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 12 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857661.561219:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 192 00000100:00100000:2.0:1787857661.561243:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171532288:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857661.561262:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857661.561288:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 12 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561330:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 12 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561356:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dd41ce0/0xd3f183cab4a7aeb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3385 expref: 12 pid: 6713 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561374:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857661.561378:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857661.561385:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561397:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561425:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857661.561638:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171532288:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 406us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857661.561646:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 192 00010000:00010000:2.0:1787857661.561675:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561685:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561707:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561722:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561729:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561737:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857661.561742:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561750:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561761:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.561778:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7af0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857661.561852:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171531904:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 29603us (29896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857661.561860:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 173 00000100:00100000:1.0:1787857661.567383:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857661.567560:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171532544 00000100:00100000:0.0:1787857661.567569:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171532544 00000100:00100000:0.0:1787857661.567650:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 696 00000100:00100000:0.0:1787857661.567661:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:21857:x1874704171532544:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857661.567775:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:21857:x1874704171532544:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 116us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857661.567783:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 696 00000100:00100000:1.0:1787857661.571383:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857661.571559:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171532672 00000100:00100000:2.0:1787857661.571570:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171532672 00000100:00100000:2.0:1787857661.571655:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 174 00000100:00100000:2.0:1787857661.571678:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171532672:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857661.571694:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857661.571713:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33af expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857661.571737:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 158, mtime: 0x6a908afc, atime: 0x0, ctime: 0x6a908afc, blocks: 0x1 00010000:00010000:2.0:1787857661.571754:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1787857661.571758:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857661.571778:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.571796:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.571808:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52000, rc 0) 00000100:00100000:2.0:1787857661.571894:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171532672:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 217us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857661.571901:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 174 00000100:00100000:1.0:1787857661.575373:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857661.575449:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171532928 00000100:00100000:2.0:1787857661.575458:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171532928 00000100:00100000:2.0:1787857661.575525:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 697 00000100:00100000:2.0:1787857661.575535:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:21857:x1874704171532928:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857661.575635:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:21857:x1874704171532928:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857661.575642:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 697 00000100:00100000:3.0:1787857661.583130:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857661.583441:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171533056 00000100:00100000:2.0:1787857661.583451:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171533056 00002000:00100000:2.0:1787857661.583517:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff9998f7018000 x1874704171533056/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:307/0 lens 488/0 e 0 to 0 dl 1787857672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857661.583528:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7018000 with x1874704171533056 ext(0->4095) 00002000:00010000:2.0:1787857661.583534:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7018000 00000100:00100000:2.0:1787857661.583566:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:2.0:1787857661.583575:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171533056:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787857661.592791:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171533056:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 9206us (9660us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857661.593243:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00002000:00100000:2.0:1787857661.593255:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff9998f7018000 x1874704171533056/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:307/0 lens 488/4536 e 0 to 0 dl 1787857672 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857661.593267:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7018000 with x1874704171533056 ext(0->4095) 00002000:00010000:2.0:1787857661.593284:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7018000 00000100:00100000:1.0:1787857661.610494:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857661.610577:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171533184 00000100:00100000:2.0:1787857661.610587:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171533184 00000100:00100000:2.0:1787857661.610646:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 698 00000100:00100000:2.0:1787857661.610657:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:21857:x1874704171533184:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857661.610675:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857661.610695:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7af1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33b6 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.610726:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.610778:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.610791:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.610902:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7af1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 37 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.610918:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 36 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.610927:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:2.0:1787857661.610929:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857661.610933:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53000, rc 0) 00000100:00100000:2.0:1787857661.610996:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21857:x1874704171533184:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 341us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857661.611003:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 698 00000100:00100000:0.0:1787857661.632507:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857661.632655:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171533312 00000100:00100000:1.0:1787857661.632664:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171533312 00000100:00100000:1.0:1787857661.632723:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 699 00000100:00100000:1.0:1787857661.632733:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21857:x1874704171533312:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857661.632773:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x12:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857661.632902:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21857:x1874704171533312:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 170us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857661.632910:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 699 00000100:00100000:3.0:1787857661.641706:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857661.643477:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171533440 00000100:00100000:1.0:1787857661.643489:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171533440 00000100:00100000:1.0:1787857661.643550:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:1.0:1787857661.643561:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171533440:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857661.643615:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643633:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857661.643637:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857661.643643:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643675:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643705:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643714:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643722:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643729:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857661.643733:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643741:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643755:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.643775:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857661.643901:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171533440:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 341us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857661.643909:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:0.0:1787857661.651689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857661.651848:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171533696 00000100:00100000:1.0:1787857661.651856:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171533696 00000100:00100000:1.0:1787857661.651905:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 700 00000100:00100000:1.0:1787857661.651914:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21857:x1874704171533696:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787857661.651987:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.652004:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 36 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.652014:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.652057:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 36 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857661.652071:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 36 pid: 7656 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857661.652085:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188177920:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857661.652176:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2a8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857661.656054:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857661.656083:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171533824 00000100:00100000:2.0:1787857661.656090:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171533824 00010000:00010000:2.0:1787857661.656125:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 37 pid: 7656 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857661.656154:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00100000:2.0:1787857661.656162:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:2350:x1874704171533824:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857661.656175:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857661.656190:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 37 pid: 7656 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.656205:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 37 pid: 7656 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.656232:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:2.0:1787857661.656238:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.656247:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.656254:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857661.656273:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857661.656318:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:2350:x1874704171533824:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 156us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857661.656325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 193 00010000:00010000:0.0:1787857661.657421:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7af22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33b6 expref: 36 pid: 7656 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857661.657440:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188177920:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857661.657467:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657476:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657483:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657670:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657678:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657698:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657704:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857661.657708:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657717:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657728:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857661.657731:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857661.657735:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857661.657742:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7af30 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857661.658196:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21857:x1874704171533696:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 6280us (6512us total) trans 4294967750 rc 0/0 00000100:00100000:0.0:1787857661.658206:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 700 00000040:00080000:2.0:1787857661.658546:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857661.658551:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857661.659349:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857661.659360:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857661.667551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857661.667616:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171534080 00000100:00100000:3.0:1787857661.667625:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171534080 00000100:00100000:3.0:1787857661.667677:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 142 00000100:00100000:3.0:1787857661.667686:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21857:x1874704171534080:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857661.668087:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:21857:x1874704171534080:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 331us (475us total) trans 4294967751 rc 0/0 00000100:00100000:3.0:1787857661.668104:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 142 00010000:00010000:0.0:1787857661.679231:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857661.981258:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000040:00080000:3.0:1787857662.049167:0:17095:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857662.049176:0:17095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857662.049234:0:17095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 3 00000040:00080000:3.0:1787857662.049240:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857662.262064:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857662.262164:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171534336 00000100:00100000:2.0:1787857662.262173:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171534336 00000100:00100000:2.0:1787857662.262244:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 701 00000100:00100000:2.0:1787857662.262255:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+75:21858:x1874704171534336:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:2.0:1787857662.262275:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857662.262319:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53600/0xd3f183cab4a7af37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33bd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.262431:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7af3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.262446:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7af3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.262461:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7af3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857662.262471:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00010000:00010000:2.0:1787857662.262616:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53600/0xd3f183cab4a7af37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33bd expref: 78 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.262634:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7af3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33bd expref: 77 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.262642:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:2.0:1787857662.262645:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857662.262648:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52800, rc 0) 00000100:00100000:2.0:1787857662.262707:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+77:21858:x1874704171534336:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 454us (652us total) trans 4294967752 rc 0/0 00000100:00100000:2.0:1787857662.262714:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 701 00000100:00080000:3.0:1787857662.263009:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857662.266854:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.266895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.266932:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171534592 00000100:00100000:3.0:1787857662.266941:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171534592 00000100:00100000:3.0:1787857662.266989:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 176 00000100:00100000:3.0:1787857662.266998:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171534592:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:3.0:1787857662.267015:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857662.267033:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33c4 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.267058:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857662.267062:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857662.267071:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.267088:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.267101:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7000, rc 0) 00000100:00100000:3.0:1787857662.267165:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171534592:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 168us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857662.267172:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 176 00000100:00100000:1.0:1787857662.267394:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171534464 00000100:00100000:1.0:1787857662.267405:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171534464 00000100:00100000:1.0:1787857662.267444:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 29 00000100:00100000:1.0:1787857662.267451:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d0399850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+77:2348:x1874704171534464:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857662.267462:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857662.267482:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7af3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33bd expref: 77 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.267498:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:1.0:1787857662.267502:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857662.267530:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d0399850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+76:2348:x1874704171534464:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 79us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857662.267538:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 29 00000100:00100000:3.0:1787857662.275952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857662.276803:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171534720 00000100:00100000:1.0:1787857662.276828:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171534720 00002000:00100000:1.0:1787857662.276883:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff9998f7019680 x1874704171534720/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:308/0 lens 488/0 e 0 to 0 dl 1787857673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857662.276896:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7019680 with x1874704171534720 ext(0->4095) 00002000:00010000:1.0:1787857662.276901:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7019680 00000100:00100000:1.0:1787857662.276932:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:1.0:1787857662.276941:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171534720:12345-192.168.204.36@tcp:3:md5sum.0 00000100:00100000:1.0:1787857662.277160:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171534720:12345-192.168.204.36@tcp:3:md5sum.0 Request processed in 219us (1217us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857662.277168:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00002000:00100000:1.0:1787857662.277175:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff9998f7019680 x1874704171534720/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:308/0 lens 488/4536 e 0 to 0 dl 1787857673 ref 1 fl Complete:/600/0 rc 4096/4096 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857662.277204:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7019680 with x1874704171534720 ext(0->4095) 00002000:00010000:1.0:1787857662.277208:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7019680 00000100:00100000:2.0:1787857662.289857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.290165:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171534976 00000100:00100000:3.0:1787857662.290176:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171534976 00000100:00100000:3.0:1787857662.290261:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 143 00000100:00100000:3.0:1787857662.290272:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c5af1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+76:21858:x1874704171534976:12345-192.168.204.36@tcp:35:md5sum.0 00000100:00100000:3.0:1787857662.290502:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c5af1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+77:21858:x1874704171534976:12345-192.168.204.36@tcp:35:md5sum.0 Request processed in 231us (654us total) trans 4294967753 rc 0/0 00000100:00100000:3.0:1787857662.290511:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 143 00000100:00100000:3.0:1787857662.316309:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857662.316461:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171535232 00000100:00100000:2.0:1787857662.316471:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171535232 00000100:00100000:2.0:1787857662.316535:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 702 00000100:00100000:2.0:1787857662.316545:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+77:21859:x1874704171535232:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:2.0:1787857662.316613:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787857662.316641:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7aed5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd338c expref: 77 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.316658:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:2.0:1787857662.316669:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7aeea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd339a expref: 76 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.316691:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:2.0:1787857662.316695:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857662.316845:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.316858:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.316869:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.316886:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.316893:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.316899:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.317034:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.317056:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 36 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.317063:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.317094:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 36 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.317108:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 36 pid: 7656 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857662.317122:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188178048:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857662.317223:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7227d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857662.319964:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188178048:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857662.319991:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857662.320664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.321889:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188178176:0@lo:400:kworker.0 00000100:00100000:3.0:1787857662.321940:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857662.321984:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188178688:0@lo:400:kworker.0 00000100:00100000:3.0:1787857662.322007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857662.322052:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787857662.322058:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188178304:0@lo:400:kworker.0 00000100:00100000:3.0:1787857662.322078:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857662.322092:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188178816:0@lo:400:kworker.0 00000100:00100000:3.0:1787857662.322112:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857662.322984:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171535360 00000100:00100000:0.0:1787857662.322993:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171535360 00000100:00080000:3.0:1787857662.323067:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857662.323130:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 37 pid: 7656 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857662.323164:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:0.0:1787857662.323181:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:2349:x1874704171535360:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857662.323194:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857662.323201:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 37 pid: 7656 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.323214:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 37 pid: 7656 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.323237:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52600/0xd3f183cab4a7aea4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3377 expref: 37 pid: 7656 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.323252:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857662.323257:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.323265:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.323272:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.323294:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857662.323343:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2349:x1874704171535360:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 162us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857662.323350:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:0.0:1787857662.323387:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188178560:0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.323423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857662.323450:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857662.323465:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188178432:0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.323491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857662.323534:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188178688 00000100:00100000:0.0:1787857662.323539:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188178688 00000100:00100000:0.0:1787857662.323565:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188178304 00000100:00100000:0.0:1787857662.323568:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188178304 00000100:00100000:0.0:1787857662.323580:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188178432 00000100:00100000:0.0:1787857662.323582:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188178432 00000100:00100000:0.0:1787857662.323596:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787857662.323601:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188178688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.323643:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188178688:12345-0@lo:400:kworker.0 Request processed in 42us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857662.323650:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787857662.323664:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787857662.323669:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188178304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.323695:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188178304:12345-0@lo:400:kworker.0 Request processed in 26us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857662.323700:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787857662.323712:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787857662.323717:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188178432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.323757:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188178432:12345-0@lo:400:kworker.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857662.323764:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:0.0:1787857662.323777:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857662.323801:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188178432:0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.323939:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188178304:0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.323963:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188178688:0@lo:400:kworker.0 00010000:00010000:0.0:1787857662.323985:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.323993:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857662.324725:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1787857662.324737:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 486374918927ns, next at 487374916235ns, rc = 0 00010000:00010000:0.0:1787857662.324810:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324842:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324852:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324859:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324865:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324871:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324891:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857662.324910:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324916:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324927:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324933:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857662.324936:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324943:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324954:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857662.324957:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857662.324961:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324967:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7af61 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324984:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324990:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.324996:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325002:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857662.325004:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325019:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325027:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857662.325029:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857662.325032:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325037:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7200/0xd3f183cab4a7af53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857662.325046:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a29c1473 reply state 000000001d51734e transno 4294967754 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857662.325055:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857662.325123:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+77:21859:x1874704171535232:12345-192.168.204.36@tcp:36:rm.0 Request processed in 8579us (8834us total) trans 4294967754 rc 0/0 00000100:00100000:0.0:1787857662.325131:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 702 00010000:00010000:0.0:1787857662.325156:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857662.325160:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325166:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857662.325169:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325175:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325183:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857662.325190:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857662.325193:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325199:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7af68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.325213:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857662.325215:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857662.325217:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857662.326298:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188178176 00000100:00100000:2.0:1787857662.326307:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188178176 00000100:00100000:2.0:1787857662.326348:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787857662.326356:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188178176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857662.326425:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188178176:12345-0@lo:400:kworker.0 Request processed in 70us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857662.326432:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787857662.326485:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188178816 00000100:00100000:2.0:1787857662.326489:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188178816 00000100:00100000:2.0:1787857662.326521:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188178560 00000100:00100000:2.0:1787857662.326524:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188178560 00000100:00100000:2.0:1787857662.326543:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787857662.326550:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188178816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857662.327054:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188178816:12345-0@lo:400:kworker.0 Request processed in 502us (4939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857662.327061:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787857662.327073:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787857662.327088:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188178560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857662.327121:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188178560:12345-0@lo:400:kworker.0 Request processed in 34us (3698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857662.327126:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1787857662.331160:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857662.331170:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857662.331222:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188178560:0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.331266:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188178816:0@lo:400:kworker.0 00000100:00100000:0.0:1787857662.331278:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188178176:0@lo:400:kworker.0 00010000:00010000:0.0:1787857662.333537:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.333554:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.333562:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.333568:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857662.333572:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.333580:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.333611:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998d1291200) 00010000:00010000:0.0:1787857662.333614:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857662.333619:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.333625:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7af5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857662.436112:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967754 is committed 00000004:00080000:2.0:1787857662.436125:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:2.0:1787857662.436142:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967750 is committed 00000001:00080000:2.0:1787857662.436169:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967751 is committed 00000100:00100000:2.0:1787857662.436307:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857662.436328:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188178944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787857662.436400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857662.436467:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188178944 00000100:00100000:1.0:1787857662.436475:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188178944 00000100:00100000:1.0:1787857662.436524:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787857662.436535:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188178944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787857662.436565:0:6714:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:14 count 1 00010000:00010000:1.0:1787857662.436601:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.436624:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 8 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.436634:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.436643:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857662.436648:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857662.436653:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 5/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.436680:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.436696:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 10 pid: 6713 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857662.436723:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188179072:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857662.436882:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 8 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.436893:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 8 pid: 6711 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857662.436902:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188179200:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857662.436926:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857662.440930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.441662:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171535488 00000100:00100000:3.0:1787857662.441673:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171535488 00010000:00010000:3.0:1787857662.441715:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 11 pid: 6713 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857662.441770:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:3.0:1787857662.441781:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171535488:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857662.441796:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857662.441802:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 11 pid: 6713 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.441862:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 11 pid: 6713 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.441889:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857662.441951:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171535488:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 166us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857662.441958:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 195 00010000:00010000:1.0:1787857662.442209:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a65ab57/0xd3f183cab4a7af4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33c4 expref: 10 pid: 6713 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857662.442226:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188179072:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857662.442241:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188179200:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857662.442264:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857662.445189:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.445292:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171535616 00000100:00100000:0.0:1787857662.445302:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171535616 00010000:00010000:0.0:1787857662.445387:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 9 pid: 6711 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857662.445427:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:0.0:1787857662.445437:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171535616:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857662.445460:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857662.445467:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 9 pid: 6711 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.445480:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 9 pid: 6711 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.445503:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000195aaf0/0xd3f183cab4a7af14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33af expref: 9 pid: 6711 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.445538:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857662.445543:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857662.445549:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.445559:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.445603:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857662.445654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171535616:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 217us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857662.445661:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 196 00010000:00010000:3.0:1787857662.446023:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.446046:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.446055:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.446062:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.446084:0:6714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857662.446846:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857662.446855:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.446864:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857662.446869:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.446878:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.446894:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.446913:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d07c82/0xd3f183cab4a7af6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.446932:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857662.446934:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857662.446936:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857662.447516:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188178944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10980us (11113us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787857662.447526:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000004:00080000:0.0:1787857662.447680:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998ffa86580/2, rc 0, transno 4294967326 00000100:00100000:0.0:1787857662.447687:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188178944:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787857662.447777:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857662.538642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.538741:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171535744 00000100:00100000:0.0:1787857662.538762:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171535744 00000100:00100000:0.0:1787857662.538861:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 703 00000100:00100000:0.0:1787857662.539012:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+72:21875:x1874704171535744:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787857662.539037:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857662.539123:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7af76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33cb expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.539188:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7af7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.539519:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7af7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.539532:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7af7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857662.539760:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:0.0:1787857662.539765:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857662.541188:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7af7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.541251:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7af76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33cb expref: 74 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.541272:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7af7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33cb expref: 73 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.541281:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857662.541284:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857662.541287:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999014e3e00, rc 0) 00000100:00100000:0.0:1787857662.541377:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+73:21875:x1874704171535744:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 2506us (2744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857662.541386:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 703 00000100:00100000:0.0:1787857662.637281:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857662.637381:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171535872 00000100:00100000:2.0:1787857662.637391:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171535872 00000100:00100000:2.0:1787857662.637465:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 704 00000100:00100000:2.0:1787857662.637477:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:21882:x1874704171535872:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857662.637500:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857662.637520:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7af84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33d2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.637590:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.637603:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.637614:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.637643:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.637650:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.637657:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.639727:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6a00/0xd3f183cab4a7af99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.639758:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6a00/0xd3f183cab4a7af99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.639769:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6a00/0xd3f183cab4a7af99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857662.640019:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000004:00200000:3.0:1787857662.640023:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857662.640165:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6a00/0xd3f183cab4a7af99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640179:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640192:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640199:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640205:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857662.640210:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640218:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640230:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:3.0:1787857662.640234:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857662.640238:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640245:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7af8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640258:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640264:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640270:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640274:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857662.640283:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640361:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640371:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9998e18d9d00) 00010000:00010000:3.0:1787857662.640374:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857662.640377:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640383:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7af92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640427:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7af84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33d2 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640505:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6a00/0xd3f183cab4a7af99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33d2 expref: 31 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.640515:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857662.640517:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857662.640520:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6a00, rc 0) 00000100:00100000:3.0:1787857662.640657:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21882:x1874704171535872:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3181us (3384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857662.640667:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 704 00000100:00100000:2.0:1787857662.646739:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.647224:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171536000 00000100:00100000:3.0:1787857662.647234:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171536000 00000100:00100000:3.0:1787857662.647415:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 705 00000100:00100000:3.0:1787857662.647427:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21882:x1874704171536000:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857662.647567:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857662.647591:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7afa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33d9 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.648212:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7afa0 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33d9 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.648228:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857662.648231:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857662.648237:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7afa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33d9 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.648253:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7c00, rc 0) 00000100:00100000:3.0:1787857662.648392:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21882:x1874704171536000:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 967us (1662us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857662.648400:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 705 00000100:00100000:2.0:1787857662.653740:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.654281:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171536256 00000100:00100000:0.0:1787857662.654433:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171536256 00000100:00100000:0.0:1787857662.654590:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 706 00000100:00100000:0.0:1787857662.654601:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+73:21882:x1874704171536256:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857662.654625:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857662.654628:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787857662.654655:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7af7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33cb expref: 73 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.654673:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857662.654678:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857662.654693:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7afa7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33e0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.655259:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.655275:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.655284:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.655311:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.655318:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.655324:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.656811:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657216:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657227:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857662.657239:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00010000:00010000:0.0:1787857662.657267:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657287:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657399:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657405:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857662.657410:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657417:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657428:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857662.657431:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857662.657435:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657508:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857662.657523:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9187c1a reply state 00000000b2785f7c transno 4294967755 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857662.657533:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857662.657569:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7afa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 75 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657583:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 74 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.657602:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d5316400) 00010000:00010000:0.0:1787857662.657604:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857662.657607:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5800, rc 0) 00000100:00100000:0.0:1787857662.657764:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:21882:x1874704171536256:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3164us (4033us total) trans 4294967755 rc 0/0 00000100:00100000:0.0:1787857662.657773:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 706 00000100:00100000:0.0:1787857662.669247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.669369:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171536512 00000100:00100000:3.0:1787857662.669379:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171536512 00000100:00100000:3.0:1787857662.669450:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 707 00000100:00100000:3.0:1787857662.669463:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+75:21882:x1874704171536512:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857662.669491:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857662.669525:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7afca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33e7 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.669642:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.669679:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 76 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.669690:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.669727:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 76 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.669752:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 76 pid: 5856 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857662.669769:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188179328:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857662.670067:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7227900 going to sleep for 11 seconds 00010000:00010000:1.0:1787857662.673501:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.673527:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.673554:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.673560:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857662.673565:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.673573:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.673590:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998d5316b00) 00010000:00010000:1.0:1787857662.673594:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857662.673599:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.673606:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7afb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857662.673882:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188179328:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857662.673907:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857662.676389:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857662.676560:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171536640 00000100:00100000:2.0:1787857662.676568:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171536640 00010000:00010000:2.0:1787857662.676611:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 76 pid: 5856 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857662.676650:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 197 00000100:00100000:2.0:1787857662.676660:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+76:2349:x1874704171536640:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857662.676675:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857662.676682:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 76 pid: 5856 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.676695:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 76 pid: 5856 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.676716:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7afbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e0 expref: 76 pid: 5856 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.676763:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d5316400) 00010000:00010000:2.0:1787857662.676769:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.676778:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.676786:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857662.676853:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857662.676915:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:2349:x1874704171536640:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 256us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857662.676922:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 197 00010000:00010000:1.0:1787857662.677049:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677057:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857662.677074:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00010000:00010000:1.0:1787857662.677366:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677374:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677391:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677397:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857662.677401:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677408:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677416:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d5316400) 00010000:00010000:1.0:1787857662.677419:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857662.677422:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677428:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7afd1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677481:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7afca lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e7 expref: 75 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677490:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:1.0:1787857662.677493:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857662.677496:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7afca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33e7 expref: 75 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.677505:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7c00, rc 0) 00000100:00100000:1.0:1787857662.677535:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+74:21882:x1874704171536512:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 8076us (8298us total) trans 4294967756 rc 301/301 00000100:00100000:1.0:1787857662.677552:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 707 00000100:00100000:2.0:1787857662.683520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.683694:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171536896 00000100:00100000:0.0:1787857662.683704:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171536896 00000100:00100000:0.0:1787857662.683762:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 144 00000100:00100000:0.0:1787857662.683773:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+74:21882:x1874704171536896:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857662.684201:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:21882:x1874704171536896:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 429us (698us total) trans 4294967757 rc 0/0 00000100:00100000:0.0:1787857662.684209:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 144 00000100:00100000:2.0:1787857662.688401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.688861:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171537024 00000100:00100000:3.0:1787857662.688871:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171537024 00000100:00100000:3.0:1787857662.688930:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 708 00000100:00100000:3.0:1787857662.689126:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+75:21882:x1874704171537024:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857662.689151:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857662.689243:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7afdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33ee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.689335:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7afdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33ee expref: 76 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.689350:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7afdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33ee expref: 76 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.689367:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857662.689370:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857662.689374:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7800, rc 0) 00000100:00100000:3.0:1787857662.689485:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+76:21882:x1874704171537024:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 547us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857662.689492:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 708 00000100:00100000:2.0:1787857662.694526:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.694828:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171537280 00000100:00100000:0.0:1787857662.694837:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171537280 00000100:00100000:0.0:1787857662.694898:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 709 00000100:00100000:0.0:1787857662.694907:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+76:21882:x1874704171537280:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787857662.694985:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695001:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695013:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695277:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695284:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695290:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695294:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857662.695298:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695305:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695317:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:0.0:1787857662.695319:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787857662.695324:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.695330:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7afe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857662.695403:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+77:21882:x1874704171537280:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 497us (885us total) trans 4294967758 rc 0/0 00000100:00100000:0.0:1787857662.695411:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 709 00000100:00100000:2.0:1787857662.699986:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.700281:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171537536 00000100:00100000:0.0:1787857662.700292:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171537536 00000100:00100000:0.0:1787857662.700354:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 710 00000100:00100000:0.0:1787857662.700382:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+77:21882:x1874704171537536:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857662.701008:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.701027:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857662.701052:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857662.701121:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967759 00000004:00010000:1.0:1787857662.701163:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062053a60 reply state 00000000fa197df2 transno 4294967760 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857662.701405:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857662.701645:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+80:21882:x1874704171537536:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1262us (1666us total) trans 4294967760 rc 0/0 00000100:00100000:1.0:1787857662.701654:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 710 00000020:00080000:1.0:1787857662.701660:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857662.703293:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857662.706193:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.706210:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.706218:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.706225:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857662.706230:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.706238:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.706253:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:0.0:1787857662.706257:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787857662.706261:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.706268:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7afed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857662.708719:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.709399:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171537792 00000100:00100000:0.0:1787857662.709411:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171537792 00000100:00100000:0.0:1787857662.709482:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 145 00000100:00100000:0.0:1787857662.709492:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+79:21882:x1874704171537792:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857662.709761:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+80:21882:x1874704171537792:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 269us (1052us total) trans 4294967761 rc 0/0 00000100:00100000:0.0:1787857662.709770:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 145 00000100:00100000:2.0:1787857662.770628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.770866:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171538048 00000100:00100000:0.0:1787857662.770876:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171538048 00000100:00100000:0.0:1787857662.770947:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 711 00000100:00100000:0.0:1787857662.770958:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:21884:x1874704171538048:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:0.0:1787857662.770982:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857662.771002:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7aff4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33f5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771095:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771112:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771122:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771136:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771143:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771149:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771291:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771314:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771321:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857662.771332:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00010000:00010000:0.0:1787857662.771432:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771439:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771445:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771451:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857662.771455:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771462:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771474:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:0.0:1787857662.771476:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857662.771481:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771487:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7affb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771500:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771513:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771519:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771525:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857662.771528:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771535:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771543:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff9998d5316c00) 00010000:00010000:0.0:1787857662.771546:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857662.771549:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771555:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5400/0xd3f183cab4a7b002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771612:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7aff4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33f5 expref: 83 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771627:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33f5 expref: 82 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.771635:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:0.0:1787857662.771638:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857662.771647:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4c00, rc 0) 00000100:00100000:0.0:1787857662.771714:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:21884:x1874704171538048:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 757us (1094us total) trans 4294967762 rc 0/0 00000100:00100000:0.0:1787857662.771723:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 711 00000100:00100000:2.0:1787857662.779542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.779977:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171538304 00000100:00100000:0.0:1787857662.779987:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171538304 00000100:00100000:0.0:1787857662.780054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:0.0:1787857662.780064:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:21884:x1874704171538304:12345-192.168.204.36@tcp:103:md5sum.0 00010000:00010000:0.0:1787857662.780079:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787857662.780103:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b009 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33f5 expref: 82 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.780124:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7afdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33ee expref: 81 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.780135:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:0.0:1787857662.780145:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857662.780216:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:21884:x1874704171538304:12345-192.168.204.36@tcp:103:md5sum.0 Request processed in 152us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857662.780224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:2.0:1787857662.785621:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857662.785738:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171538432 00000100:00100000:3.0:1787857662.785756:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171538432 00000100:00100000:3.0:1787857662.785839:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 712 00000100:00100000:3.0:1787857662.785848:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+80:21884:x1874704171538432:12345-192.168.204.36@tcp:58:md5sum.0 00010000:00010000:3.0:1787857662.785978:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.785994:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857662.786006:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857662.786522:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 136 off10504 00000100:00100000:3.0:1787857662.786697:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+80:21884:x1874704171538432:12345-192.168.204.36@tcp:58:md5sum.0 Request processed in 849us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857662.786711:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 712 00000100:00100000:2.0:1787857662.790369:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857662.790709:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171538560 00000100:00100000:0.0:1787857662.790718:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171538560 00000100:00100000:0.0:1787857662.790796:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 713 00000100:00100000:0.0:1787857662.790805:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:21884:x1874704171538560:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:0.0:1787857662.790850:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857662.790880:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b01e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd33fc expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.791554:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.791569:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b01e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33fc expref: 81 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.791662:0:5857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.791679:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b01e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33fc expref: 81 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.791693:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291b00) 00010000:00010000:0.0:1787857662.791696:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857662.791700:0:5857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b01e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33fc expref: 81 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857662.791707:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4c00, rc 0) 00000100:00100000:0.0:1787857662.791770:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+81:21884:x1874704171538560:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 965us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857662.791777:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 713 00000100:00100000:1.0:1787857662.832459:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857662.832486:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188179456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857662.832563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857662.832772:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188179456 00000100:00100000:2.0:1787857662.832780:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188179456 00000100:00100000:2.0:1787857662.832868:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787857662.832878:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188179456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857662.832941:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857662.833002:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188179456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857662.833010:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787857662.833232:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188179456:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787857663.726292:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857663.726302:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857663.727682:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 18 count 3 00000040:00080000:3.0:1787857663.727694:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857663.727853:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa861c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188179584:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857663.727949:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7227d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787857663.736106:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857663.737782:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa861c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188179584:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857663.742964:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857663.743295:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171538688 00000100:00100000:1.0:1787857663.743305:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171538688 00000100:00100000:1.0:1787857663.743558:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 714 00000100:00100000:1.0:1787857663.743569:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21885:x1874704171538688:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857663.743602:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857663.743751:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21885:x1874704171538688:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 183us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857663.743759:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 714 00000100:00100000:2.0:1787857663.754063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857663.754257:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171538816 00000100:00100000:1.0:1787857663.754269:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171538816 00000100:00100000:1.0:1787857663.754345:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 715 00000100:00100000:1.0:1787857663.754355:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21885:x1874704171538816:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787857663.754446:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.754464:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.754477:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.754530:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.754539:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.754546:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.754570:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.754579:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.754586:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857663.754642:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00000004:00200000:1.0:1787857663.754647:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857663.755012:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755035:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755041:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755048:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755053:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857663.755057:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755064:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755077:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857663.755080:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857663.755084:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755090:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b025 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755102:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755118:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755123:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755128:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857663.755131:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755136:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755143:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x7d5aa0c7 (ffff9998c3984c00) 00010000:00010000:1.0:1787857663.755145:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857663.755147:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755153:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b02c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755165:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755171:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755176:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755181:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857663.755190:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755197:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755204:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291b00) 00010000:00010000:1.0:1787857663.755207:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857663.755209:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.755215:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857663.756554:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21885:x1874704171538816:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 2193us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857663.756566:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 715 00000100:00100000:2.0:1787857663.761984:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857663.762174:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171539072 00000100:00100000:3.0:1787857663.762184:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171539072 00000100:00100000:3.0:1787857663.762254:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 716 00000100:00100000:3.0:1787857663.762265:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21885:x1874704171539072:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857663.762285:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857663.762318:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b03a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3403 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762434:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762449:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762460:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857663.762471:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00010000:00010000:3.0:1787857663.762574:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762594:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762600:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762606:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857663.762610:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762617:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762628:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291b00) 00010000:00010000:3.0:1787857663.762631:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857663.762636:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762642:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762692:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b03a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3403 expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762702:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857663.762704:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857663.762708:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b03a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3403 expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.762718:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6000, rc 0) 00000100:00100000:3.0:1787857663.762799:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:21885:x1874704171539072:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 536us (825us total) trans 4294967763 rc 301/301 00000100:00100000:3.0:1787857663.762806:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 716 00000100:00100000:2.0:1787857663.772207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857663.772312:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171539200 00000100:00100000:0.0:1787857663.772323:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171539200 00000100:00100000:0.0:1787857663.772395:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 717 00000100:00100000:0.0:1787857663.772405:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:21885:x1874704171539200:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857663.772480:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857663.772586:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:21885:x1874704171539200:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 182us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857663.772594:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 717 00000100:00100000:2.0:1787857663.780149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857663.780252:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171539456 00000100:00100000:3.0:1787857663.780262:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171539456 00000100:00100000:3.0:1787857663.780332:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 718 00000100:00100000:3.0:1787857663.780343:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:21885:x1874704171539456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857663.780363:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857663.780383:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b04f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd340a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857663.781160:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10:0x0], index 1: 0 00010000:00010000:3.0:1787857663.781431:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.781447:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.781457:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.781506:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b04f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd340a expref: 35 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.781522:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd340a expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.781531:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291c00) 00010000:00010000:3.0:1787857663.781534:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857663.781559:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7800, rc 0) 00000100:00100000:3.0:1787857663.781619:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21885:x1874704171539456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1278us (1480us total) trans 4294967764 rc 0/0 00000100:00100000:3.0:1787857663.781635:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 718 00000100:00100000:2.0:1787857663.789972:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857663.790215:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171539712 00000100:00100000:1.0:1787857663.790230:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171539712 00000100:00100000:1.0:1787857663.790306:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 719 00000100:00100000:1.0:1787857663.790316:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21885:x1874704171539712:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857663.790380:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857663.790414:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7800/0xd3f183cab4a7b056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd340a expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790538:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291c00) 00010000:00010000:1.0:1787857663.790550:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857663.790573:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790605:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790616:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790670:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790679:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790685:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790782:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790789:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790796:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790801:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857663.790806:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.790813:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793298:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9998d5316500) 00010000:00010000:1.0:1787857663.793319:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857663.793328:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793337:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b064 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793359:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793367:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793373:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793378:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857663.793382:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793388:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793396:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xce85902f (ffff9998c3984c00) 00010000:00010000:1.0:1787857663.793399:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857663.793402:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.793407:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b06b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xce85902f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857663.794786:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:21885:x1874704171539712:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 4462us (4816us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857663.794799:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 719 00000100:00100000:2.0:1787857663.800613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857663.800746:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171539840 00000100:00100000:3.0:1787857663.800756:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171539840 00000100:00100000:3.0:1787857663.800863:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 720 00000100:00100000:3.0:1787857663.800872:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:21885:x1874704171539840:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857663.800893:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857663.800914:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b072 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3411 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.800950:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.800963:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.800974:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.801074:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b072 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 35 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.801091:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.801100:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:3.0:1787857663.801103:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857663.801111:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7e00, rc 0) 00000100:00100000:3.0:1787857663.801169:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21885:x1874704171539840:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 298us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857663.801176:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 720 00000100:00100000:2.0:1787857663.806130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857663.806226:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171540096 00000100:00100000:3.0:1787857663.806237:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171540096 00000100:00100000:3.0:1787857663.806331:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 721 00000100:00100000:3.0:1787857663.806341:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21885:x1874704171540096:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857663.806430:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.806447:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.806459:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857663.806900:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8752 00000004:00080000:3.0:1787857663.806912:0:7656:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 487857094377ns, next at 488857091415ns, rc = 0 00000004:00010000:3.0:1787857663.807014:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad4199b2 reply state 0000000049c1727c transno 4294967765 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857663.807029:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857663.807127:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21885:x1874704171540096:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 785us (1006us total) trans 4294967765 rc 0/0 00000100:00100000:3.0:1787857663.807135:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 721 00010000:00010000:1.0:1787857663.813180:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.813213:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.813221:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.813227:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857663.813231:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.813239:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.813256:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:1.0:1787857663.813259:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857663.813265:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.813271:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6000/0xd3f183cab4a7b080 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857663.813685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857663.813807:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171540224 00000100:00100000:1.0:1787857663.813855:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171540224 00000100:00100000:1.0:1787857663.813912:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 722 00000100:00100000:1.0:1787857663.813922:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:21885:x1874704171540224:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857663.813947:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857663.813964:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3418 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.814037:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.814050:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.814067:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:1.0:1787857663.814070:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857663.814072:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00100000:1.0:1787857663.814132:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21885:x1874704171540224:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 212us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857663.814139:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 722 00000100:00100000:2.0:1787857663.823226:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857663.823324:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171540352 00000100:00100000:3.0:1787857663.823335:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171540352 00000100:00100000:3.0:1787857663.823412:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 178 00000100:00100000:3.0:1787857663.823434:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171540352:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787857663.823844:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171540352:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 422us (630us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787857663.823852:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 178 00000100:00080000:2.0:1787857663.824552:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857663.828991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857663.829105:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171540608 00000100:00100000:0.0:1787857663.829115:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171540608 00000100:00100000:0.0:1787857663.829269:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 146 00000100:00100000:0.0:1787857663.829281:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:21885:x1874704171540608:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857663.829751:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:21885:x1874704171540608:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 471us (768us total) trans 4294967766 rc 0/0 00000100:00100000:0.0:1787857663.829761:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 146 00000100:00100000:1.0:1787857663.838804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857663.838942:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171540864 00000100:00100000:2.0:1787857663.838951:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171540864 00000100:00100000:2.0:1787857663.839015:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 723 00000100:00100000:2.0:1787857663.839027:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:21885:x1874704171540864:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857663.839140:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:21885:x1874704171540864:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857663.839213:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 723 00000100:00100000:2.0:1787857663.845174:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857663.845276:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171540992 00000100:00100000:1.0:1787857663.845287:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171540992 00000100:00100000:1.0:1787857663.845351:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 724 00000100:00100000:1.0:1787857663.845360:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:21885:x1874704171540992:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857663.845382:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857663.845403:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b08e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd341f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.845519:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b095 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.845534:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.845557:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857663.845594:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857663.845612:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b095 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.845651:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7b08e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd341f expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.845671:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b095 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd341f expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.845680:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:1.0:1787857663.845682:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787857663.845687:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706600, rc 0) 00000100:00100000:1.0:1787857663.845766:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:21885:x1874704171540992:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 407us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857663.845774:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 724 00000100:00100000:1.0:1787857663.851091:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857663.851257:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171541120 00000100:00100000:2.0:1787857663.851268:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171541120 00000100:00100000:2.0:1787857663.851322:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 179 00000100:00100000:2.0:1787857663.851332:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171541120:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857663.851350:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857663.851371:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3426 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857663.851398:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908aff, blocks: 0x1 00010000:00010000:2.0:1787857663.851430:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1787857663.851435:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857663.851444:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 11 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857663.851461:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 11 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857663.851475:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53400, rc 0) 00000100:00100000:2.0:1787857663.851535:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171541120:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 205us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857663.851543:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 179 00000100:00100000:2.0:1787857663.855636:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857663.855774:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171541376 00000100:00100000:0.0:1787857663.855783:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171541376 00000100:00100000:0.0:1787857663.855864:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 725 00000100:00100000:0.0:1787857663.855874:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:21885:x1874704171541376:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857663.855976:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:21885:x1874704171541376:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 103us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857663.855984:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 725 00000100:00100000:3.0:1787857663.867970:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857663.868278:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171541504 00000100:00100000:1.0:1787857663.868289:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171541504 00000100:00100000:1.0:1787857663.868351:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 180 00000100:00100000:1.0:1787857663.868363:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:21885:x1874704171541504:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857663.868382:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857663.868402:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd342d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.868467:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.868476:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857663.868480:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857663.868486:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.868521:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857663.868535:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 12 pid: 8490 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857663.868549:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188179712:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857663.868664:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857663.872936:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857663.873163:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188179712:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857663.873201:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857663.873225:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707400, rc 0) 00000100:00100000:3.0:1787857663.873292:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:21885:x1874704171541504:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 4931us (5332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857663.873303:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 180 00000100:00100000:2.0:1787857663.874008:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171541632 00000100:00100000:2.0:1787857663.874027:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171541632 00010000:00010000:2.0:1787857663.874062:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 12 pid: 8490 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857663.874124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:2.0:1787857663.874135:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171541632:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857663.874149:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857663.874180:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 12 pid: 8490 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857663.874193:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 12 pid: 8490 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857663.874218:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bb87ec6/0xd3f183cab4a7b09c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3426 expref: 12 pid: 8490 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857663.874233:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857663.874237:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857663.874246:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857663.874256:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857663.874290:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857663.874304:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188179840:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857663.874386:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6f066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857663.883003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857663.883218:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171541760 00000100:00100000:2.0:1787857663.883228:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171541760 00002000:00100000:2.0:1787857663.883286:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x10:0x0] (0->157) req@ffff9998ffa8b480 x1874704171541760/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:309/0 lens 648/0 e 0 to 0 dl 1787857674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857663.883298:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa8b480 with x1874704171541760 ext(0->157) 00002000:00010000:2.0:1787857663.883303:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffa8b480 00000100:00100000:2.0:1787857663.883350:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:2.0:1787857663.883361:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171541760:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787857663.884050:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188179840:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857663.884075:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857663.884144:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171541632:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 10009us (11217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857663.884154:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:2.0:1787857663.885388:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171541760:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 2023us (2389us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787857663.885400:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 58 00002000:00100000:2.0:1787857663.885412:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x10:0x0] (0->157) req@ffff9998ffa8b480 x1874704171541760/t4294967332(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:309/0 lens 648/448 e 0 to 0 dl 1787857674 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857663.885433:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa8b480 with x1874704171541760 ext(0->157) 00002000:00010000:2.0:1787857663.885438:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffa8b480 00000100:00100000:1.0:1787857663.888051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857663.888221:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171541888 00000100:00100000:2.0:1787857663.888230:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171541888 00000100:00100000:2.0:1787857663.888327:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 726 00000100:00100000:2.0:1787857663.888338:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:21885:x1874704171541888:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787857663.946512:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967766 is committed 00000001:00080000:2.0:1787857663.946532:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967762 is committed 00000004:00080000:2.0:1787857663.946555:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:0.0:1787857663.946804:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21885:x1874704171541888:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 58462us (58757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857663.946853:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 726 00000100:00100000:0.0:1787857663.946979:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857663.946996:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188179968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787857663.947427:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857663.947530:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188179968 00000100:00100000:2.0:1787857663.947539:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188179968 00000100:00100000:2.0:1787857663.947593:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787857663.947602:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188179968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787857663.947775:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787857663.947780:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1787857663 00002000:00010000:2.0:1787857663.947782:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787857663.947784:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb ctime from disk: 1787857663 -> 1787857663 00002000:00010000:2.0:1787857663.947786:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787857663.947859:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188179968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 258us (432us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787857663.947866:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000004:00080000:0.0:1787857663.948619:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999900d4a580/2, rc 0, transno 4294967333 00000100:00100000:0.0:1787857663.948629:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188179968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787857663.953314:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857663.953858:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171542016 00000100:00100000:0.0:1787857663.953868:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171542016 00000100:00100000:0.0:1787857663.953923:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:0.0:1787857663.953932:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171542016:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787857663.992037:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00000001:00080000:1.0:1787857663.992054:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967332 is committed 00000100:00100000:2.0:1787857663.992602:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171542016:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 38662us (39289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857663.992615:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:1.0:1787857663.998299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857663.998805:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171542272 00000100:00100000:0.0:1787857663.998945:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171542272 00000100:00100000:0.0:1787857663.999030:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 727 00000100:00100000:0.0:1787857663.999042:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21885:x1874704171542272:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857663.999106:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857663.999140:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7b095 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd341f expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857663.999160:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:0.0:1787857663.999165:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857663.999198:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857663.999214:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857663.999225:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857663.999461:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6f5967d reply state 00000000e5401080 transno 4294967767 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857663.999470:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857663.999592:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:21885:x1874704171542272:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 552us (1304us total) trans 4294967767 rc 0/0 00000100:00100000:0.0:1787857663.999599:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 727 00000100:00100000:1.0:1787857664.005791:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857664.006161:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171542400 00000100:00100000:3.0:1787857664.006172:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171542400 00000100:00100000:3.0:1787857664.006232:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 183 00000100:00100000:3.0:1787857664.006242:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171542400:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787857664.006535:0:6714:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:3.0:1787857664.006539:0:6714:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb mtime from disk: 1787857663 -> 1787857660 00002000:00010000:3.0:1787857664.006541:0:6714:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb atime from disk: 0 -> 1787857660 00002000:00010000:3.0:1787857664.006560:0:6714:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb ctime from disk: 1787857663 -> 1787857662 00002000:00010000:3.0:1787857664.006562:0:6714:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787857664.006651:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171542400:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 410us (868us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1787857664.006660:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 183 00010000:00010000:0.0:1787857664.008761:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.008793:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.008802:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.008809:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857664.008813:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.009217:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.009245:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:0.0:1787857664.009249:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857664.009257:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.009265:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b0aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857664.014109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857664.014331:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171542656 00000100:00100000:3.0:1787857664.014341:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171542656 00000100:00100000:3.0:1787857664.014443:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 728 00000100:00100000:3.0:1787857664.014455:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:21885:x1874704171542656:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787857664.014539:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.014558:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.014568:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.014601:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.014616:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 34 pid: 5858 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857664.014630:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188180096:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857664.014741:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7a80 going to sleep for 11 seconds 00000100:00080000:2.0:1787857664.015779:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857664.021578:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857664.021671:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171542784 00000100:00100000:0.0:1787857664.021681:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171542784 00010000:00010000:0.0:1787857664.021736:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 35 pid: 5858 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857664.021806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 199 00000100:00100000:0.0:1787857664.021859:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d039a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2350:x1874704171542784:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857664.021876:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857664.021884:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 35 pid: 5858 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.021898:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 35 pid: 5858 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.021922:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:0.0:1787857664.021927:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.021937:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.021946:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.021966:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857664.022024:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d039a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2350:x1874704171542784:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 198us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857664.022032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 199 00010000:00010000:3.0:1787857664.022679:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3411 expref: 34 pid: 5858 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857664.022712:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188180096:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857664.022749:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022759:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022765:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022792:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022800:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022807:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022860:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857664.022865:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022874:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022886:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:3.0:1787857664.022889:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787857664.022893:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.022906:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7c00/0xd3f183cab4a7b0b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857664.022966:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:21885:x1874704171542656:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 8514us (8868us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787857664.022975:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 728 00000100:00100000:1.0:1787857664.029469:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857664.029788:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171542912 00000100:00100000:2.0:1787857664.029800:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171542912 00000100:00100000:2.0:1787857664.034623:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 184 00000100:00100000:2.0:1787857664.034641:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171542912:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857664.034769:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.034790:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.034799:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x10:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787857664.034803:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857664.034808:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.034881:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.034896:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 11 pid: 6714 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857664.034913:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188180224:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857664.035019:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b7fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857664.038248:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188180224:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857664.038281:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857664.040664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857664.041182:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171543040 00000100:00100000:3.0:1787857664.041193:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171543040 00010000:00010000:3.0:1787857664.041238:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 12 pid: 6714 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857664.041286:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 200 00000100:00100000:3.0:1787857664.041304:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171543040:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857664.041321:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857664.041346:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 12 pid: 6714 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.041361:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 12 pid: 6714 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.041389:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd342d expref: 12 pid: 6714 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.041408:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857664.041412:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857664.041428:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.041456:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857664.041495:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857664.041564:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171543040:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 261us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857664.041572:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 200 00010000:00010000:1.0:1787857664.042035:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.042046:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.042073:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.042082:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.042091:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.042099:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857664.042103:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.042128:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.042207:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.042217:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000195aaf0/0xd3f183cab4a7b0b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857664.042281:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171542912:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 7645us (12823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857664.042302:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 184 00000100:00100000:1.0:1787857664.052791:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857664.053022:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171543296 00000100:00100000:0.0:1787857664.053033:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171543296 00000100:00100000:0.0:1787857664.053096:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 729 00000100:00100000:0.0:1787857664.053106:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:21885:x1874704171543296:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857664.053202:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.053221:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.053233:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.053508:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.053521:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.053530:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.053565:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 34 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.053581:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 34 pid: 5856 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857664.053594:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188180352:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857664.053683:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2aebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857664.058209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857664.058342:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171543424 00000100:00100000:2.0:1787857664.058351:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171543424 00010000:00010000:2.0:1787857664.058393:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 35 pid: 5856 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857664.058441:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 201 00000100:00100000:2.0:1787857664.058451:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2349:x1874704171543424:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857664.058466:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857664.058473:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 35 pid: 5856 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.058487:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 35 pid: 5856 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.058510:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:2.0:1787857664.058537:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.058565:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.058573:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.058592:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857664.058670:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2349:x1874704171543424:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 220us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857664.058678:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 201 00010000:00010000:0.0:1787857664.060185:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7b087 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3418 expref: 34 pid: 5856 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857664.060227:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188180352:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857664.060250:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.060258:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.060264:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857664.060542:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967768 00000001:00080000:0.0:1787857664.060712:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967769 00000001:00080000:0.0:1787857664.060775:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967770 00000100:00100000:0.0:1787857664.061108:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874704188180480:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787857664.061173:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857664.061220:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2a8b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857664.061655:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188180480 00000100:00100000:2.0:1787857664.061663:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188180480 00000100:00100000:2.0:1787857664.061739:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787857664.061749:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874704188180480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787857664.061872:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874704188180480:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857664.061880:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787857664.062216:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857664.062246:0:5857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:0.0:1787857664.062251:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999900d4a580, transno 4294967333 00000100:00100000:0.0:1787857664.062263:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874704188180480:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787857664.063236:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967771 00000100:00100000:0.0:1787857664.063302:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874704188180608:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787857664.063351:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857664.063388:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2aeb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857664.063606:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188180608 00000100:00100000:2.0:1787857664.063613:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188180608 00000100:00100000:2.0:1787857664.063658:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787857664.063667:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874704188180608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787857664.064038:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1874704188180608:12345-0@lo:1000:mdt00_001.0 Request processed in 371us (685us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787857664.064047:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787857664.064262:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874704188180608:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787857664.064298:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064319:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064327:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064333:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857664.064338:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064347:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064364:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998d1291200) 00010000:00010000:0.0:1787857664.064367:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857664.064372:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064378:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b0c6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064408:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064487:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064494:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064500:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857664.064509:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064515:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064524:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291b00) 00010000:00010000:0.0:1787857664.064527:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857664.064533:0:5857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b01e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33fc expref: 72 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064544:0:5857:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b01e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33fc expref: 72 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064553:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b01e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33fc expref: 72 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.064582:0:5857:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4c00/0xd3f183cab4a7b01e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd33fc expref: 72 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857664.064594:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188180736:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857664.064664:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857664.068703:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857664.068788:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171543552 00000100:00100000:3.0:1787857664.068797:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171543552 00000100:00100000:3.0:1787857664.068891:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 147 00000100:00100000:3.0:1787857664.068902:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+73:21884:x1874704171543552:12345-192.168.204.36@tcp:49:md5sum.0 00000100:00100000:3.0:1787857664.069044:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+73:21884:x1874704171543552:12345-192.168.204.36@tcp:49:md5sum.0 Request processed in 142us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857664.069051:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 147 00000100:00080000:0.0:1787857664.069256:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857664.069605:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188180736:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857664.069634:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069644:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b017 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069675:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069691:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069702:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069736:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069742:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069749:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069755:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857664.069759:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069766:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069779:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291b00) 00010000:00010000:1.0:1787857664.069782:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857664.069786:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069792:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707400/0xd3f183cab4a7b0cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069801:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069807:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069812:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069943:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857664.069946:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069953:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069961:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9998d1291b00) 00010000:00010000:1.0:1787857664.069963:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857664.069966:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.069972:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b0bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857664.070271:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:21885:x1874704171543296:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 17166us (17491us total) trans 4294967772 rc 0/0 00000100:00100000:1.0:1787857664.070281:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 729 00000020:00080000:1.0:1787857664.070286:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787857664.072766:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857664.072966:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857664.074131:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787857664.074146:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857664.076433:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857664.077930:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171543808 00000100:00100000:3.0:1787857664.077943:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171543808 00000100:00100000:3.0:1787857664.078048:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 148 00000100:00100000:3.0:1787857664.078059:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:21885:x1874704171543808:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787857664.079670:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x13:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787857664.079813:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967773 00000100:00100000:3.0:1787857664.083025:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857664.083068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857664.083133:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171544192 00000100:00100000:1.0:1787857664.083144:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171544192 00000100:00100000:1.0:1787857664.083227:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171544448 00000100:00080000:3.0:1787857664.083230:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857664.083231:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171544448 00000100:00080000:3.0:1787857664.083262:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857664.083272:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:1.0:1787857664.083284:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171544192:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857664.083375:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171544192:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 93us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857664.083384:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:1.0:1787857664.083428:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:1.0:1787857664.083435:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171544448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857664.083463:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171544448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857664.083469:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 266 00010000:00010000:2.0:1787857664.084182:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.084212:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.084228:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.084237:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.084244:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.084250:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857664.084264:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857664.084344:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:21885:x1874704171543808:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 6287us (7931us total) trans 4294967774 rc 0/0 00000100:00100000:2.0:1787857664.084353:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 148 00000020:00080000:2.0:1787857664.084357:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857664.085075:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857664.085084:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.085099:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857664.085103:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.085116:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.085131:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9998e18d9500) 00010000:00010000:0.0:1787857664.085134:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857664.085142:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.085149:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b0d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857664.085174:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857664.085176:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857664.085178:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857664.090435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857664.090479:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857664.090518:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857664.090790:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171543936 00000100:00100000:1.0:1787857664.090800:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171543936 00000100:00100000:1.0:1787857664.090898:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171544320 00000100:00100000:1.0:1787857664.090902:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171544320 00000100:00100000:1.0:1787857664.090927:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 267 00000100:00100000:1.0:1787857664.090937:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171544320:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857664.091028:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171544320:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 92us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857664.091036:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 267 00000100:00100000:1.0:1787857664.091053:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 185 00000100:00100000:1.0:1787857664.091060:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+9:21884:x1874704171543936:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:1.0:1787857664.091071:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857664.091094:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3434 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857664.091122:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 158, mtime: 0x6a908afc, atime: 0x6a908afc, ctime: 0x6a908afe, blocks: 0xb 00010000:00010000:1.0:1787857664.091141:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787857664.091147:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857664.091157:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3434 expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.091195:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004d07c82/0xd3f183cab4a7b0db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3434 expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857664.091208:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707400, rc 0) 00000100:00100000:1.0:1787857664.091231:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:21884:x1874704171543936:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 171us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857664.091238:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 185 00000100:00080000:0.0:1787857664.091875:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857664.092089:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171544064 00000100:00100000:3.0:1787857664.092095:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171544064 00000100:00100000:3.0:1787857664.092145:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 358 00000100:00100000:3.0:1787857664.092152:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171544064:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857664.092193:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171544064:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 42us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857664.092199:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 358 00000100:00100000:0.0:1787857664.101440:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857664.101576:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171544576 00000100:00100000:1.0:1787857664.101587:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171544576 00002000:00100000:1.0:1787857664.101643:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x10:0x0] (0->4095) req@ffff9998f7049e00 x1874704171544576/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:310/0 lens 488/0 e 0 to 0 dl 1787857675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857664.101655:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7049e00 with x1874704171544576 ext(0->4095) 00002000:00010000:1.0:1787857664.101661:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f7049e00 00000100:00100000:1.0:1787857664.101696:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:1.0:1787857664.101707:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171544576:12345-192.168.204.36@tcp:3:md5sum.0 00000100:00100000:1.0:1787857664.101990:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171544576:12345-192.168.204.36@tcp:3:md5sum.0 Request processed in 284us (578us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857664.101999:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 59 00002000:00100000:1.0:1787857664.102006:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x10:0x0] (0->4095) req@ffff9998f7049e00 x1874704171544576/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:310/0 lens 488/4536 e 0 to 0 dl 1787857675 ref 1 fl Complete:/600/0 rc 4096/4096 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857664.102023:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7049e00 with x1874704171544576 ext(0->4095) 00002000:00010000:1.0:1787857664.102027:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f7049e00 00000100:00100000:1.0:1787857664.112688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857664.114537:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171544832 00000100:00100000:0.0:1787857664.114551:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171544832 00000100:00100000:0.0:1787857664.114620:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 149 00000100:00100000:0.0:1787857664.114630:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c5af2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+73:21884:x1874704171544832:12345-192.168.204.36@tcp:35:md5sum.0 00000100:00100000:0.0:1787857664.115253:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c5af2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+74:21884:x1874704171544832:12345-192.168.204.36@tcp:35:md5sum.0 Request processed in 623us (2573us total) trans 4294967775 rc 0/0 00000100:00100000:0.0:1787857664.115262:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 149 00010000:00010000:0.0:1787857664.750079:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857665.774331:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857665.902334:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188180864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857665.902415:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857665.903639:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188180864 00000100:00100000:2.0:1787857665.903650:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188180864 00000100:00100000:2.0:1787857665.903743:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787857665.903754:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188180864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857665.903799:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 61276160 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857665.903982:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188180864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 231us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857665.903990:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1787857665.904659:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857665.905437:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188180864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857666.798105:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857666.973167:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000100:00100000:1.0:1787857667.153893:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857667.154295:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171544960 00000100:00100000:2.0:1787857667.154313:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171544960 00002000:00100000:2.0:1787857667.154388:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xd:0x0] (0->157) req@ffff9998f70192c0 x1874704171544960/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:313/0 lens 648/0 e 0 to 0 dl 1787857678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857667.154400:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f70192c0 with x1874704171544960 ext(0->157) 00002000:00010000:2.0:1787857667.154406:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f70192c0 00000100:00080000:0.0:1787857667.154417:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857667.154502:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:2.0:1787857667.154513:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171544960:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:2.0:1787857667.157197:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171544960:12345-192.168.204.36@tcp:4:cp.0 Request processed in 2675us (3304us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787857667.157212:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 60 00002000:00100000:2.0:1787857667.157223:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xd:0x0] (0->157) req@ffff9998f70192c0 x1874704171544960/t4294967327(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:313/0 lens 648/448 e 0 to 0 dl 1787857678 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857667.157233:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f70192c0 with x1874704171544960 ext(0->157) 00002000:00010000:2.0:1787857667.157240:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f70192c0 00000100:00100000:0.0:1787857667.442170:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188180992:0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.442251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857667.442314:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188181504:0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.442344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857667.442373:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787857667.442380:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188181120:0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.442411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857667.442481:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188181504 00000100:00100000:0.0:1787857667.442482:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188181632:0@lo:400:kworker.0 00000100:00100000:3.0:1787857667.442491:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188181504 00000100:00100000:0.0:1787857667.442516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857667.442555:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188181120 00000100:00100000:0.0:1787857667.442559:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188181248:0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.442589:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857667.442620:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188181120 00000100:00100000:0.0:1787857667.442620:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857667.442629:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188181376:0@lo:400:kworker.0 00000100:00100000:3.0:1787857667.442647:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188181248 00000100:00100000:3.0:1787857667.442662:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188181248 00000100:00100000:0.0:1787857667.442672:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857667.442693:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787857667.442705:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188181504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.442710:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188180992 00000100:00100000:0.0:1787857667.442723:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188180992 00000100:00100000:0.0:1787857667.442760:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787857667.442769:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188180992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857667.442773:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188181504:12345-0@lo:400:kworker.0 Request processed in 68us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857667.442782:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787857667.442804:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787857667.442811:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188180992:12345-0@lo:400:kworker.0 Request processed in 43us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857667.442847:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787857667.442849:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188181120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.442883:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787857667.442892:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188181120:12345-0@lo:400:kworker.0 Request processed in 80us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857667.442895:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188181248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857667.442905:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787857667.442939:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188181248:12345-0@lo:400:kworker.0 Request processed in 48us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857667.442947:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:0.0:1787857667.442968:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857667.442982:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188181632 00000100:00100000:0.0:1787857667.442986:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188181632 00000100:00100000:0.0:1787857667.443022:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188181376 00000100:00100000:0.0:1787857667.443026:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188181376 00000100:00100000:3.0:1787857667.443047:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787857667.443056:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787857667.443060:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188181632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.443070:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188181376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.443106:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188181376:12345-0@lo:400:kworker.0 Request processed in 41us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857667.443112:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:0.0:1787857667.443140:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857667.443144:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857667.443170:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000100:00100000:3.0:1787857667.443173:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188181632:12345-0@lo:400:kworker.0 Request processed in 117us (655us total) trans 0 rc 0/0 00000004:00080000:0.0:1787857667.443179:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9998ffa86580, transno 4294967326 00000100:00100000:0.0:1787857667.443197:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188181376:0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.443210:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188181248:0@lo:400:kworker.0 00000100:00100000:3.0:1787857667.443251:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787857667.443690:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188181120:0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.443702:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188181632:0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.443710:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188180992:0@lo:400:kworker.0 00000100:00100000:0.0:1787857667.443722:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188181504:0@lo:400:kworker.0 00010000:00010000:0.0:1787857667.822292:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857667.950357:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857667.950382:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188181760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857667.950484:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857667.952674:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188181760 00000100:00100000:2.0:1787857667.952961:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188181760 00000100:00100000:2.0:1787857667.953696:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787857667.953712:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188181760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857667.953762:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857667.953896:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188181760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (3412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857667.953903:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787857667.954003:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188181760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857668.849159:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857669.111189:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00000001:00080000:1.0:1787857669.111237:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000001:00080000:2.0:1787857669.111298:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967775 is committed 00000001:00080000:2.0:1787857669.111306:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967772 is committed 00000020:00080000:2.0:1787857669.111313:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c2a8b780 refcount 2 committed 0 result 0 batchid 10 00000020:00080000:2.0:1787857669.111337:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998c2a8b180 00000020:00080000:2.0:1787857669.111340:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c1908c00 00000001:00080000:2.0:1787857669.111384:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967774 is committed 00000020:00080000:0.0:1787857669.111445:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 10 committed batchid 9 00000020:00080000:0.0:1787857669.111697:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9 00000100:00100000:3.0:1787857669.204408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857669.204780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857669.204806:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857669.204859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857669.204881:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857669.204903:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857669.204957:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857669.205002:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171545088 00000100:00100000:3.0:1787857669.205030:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171545088 00000100:00100000:3.0:1787857669.205099:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 360 00000100:00100000:3.0:1787857669.205112:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171545088:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857669.205214:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171545088:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 105us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857669.205222:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 360 00000100:00100000:3.0:1787857669.205263:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171545472 00000100:00100000:3.0:1787857669.205267:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171545472 00000100:00100000:3.0:1787857669.205310:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171545728 00000100:00100000:3.0:1787857669.205314:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171545728 00000100:00100000:3.0:1787857669.205334:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171545344 00000100:00100000:3.0:1787857669.205336:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171545344 00000100:00100000:3.0:1787857669.205349:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171545856 00000100:00100000:3.0:1787857669.205351:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171545856 00000100:00100000:3.0:1787857669.205366:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:3.0:1787857669.205372:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171545472:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857669.205407:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171545472:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857669.205427:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:3.0:1787857669.205440:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 271 00000100:00100000:3.0:1787857669.205461:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171545728:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857669.205489:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171545728:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857669.205496:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 271 00000100:00100000:3.0:1787857669.205508:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 272 00000100:00100000:3.0:1787857669.205514:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171545344:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857669.205539:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171545344:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857669.205546:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 272 00000100:00100000:3.0:1787857669.205558:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 273 00000100:00100000:3.0:1787857669.205564:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171545856:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857669.205585:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171545856:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857669.205592:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 273 00000100:00100000:3.0:1787857669.205630:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171545216 00000100:00100000:3.0:1787857669.205634:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171545216 00000100:00100000:3.0:1787857669.205667:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171545600 00000100:00100000:3.0:1787857669.205671:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171545600 00000100:00080000:0.0:1787857669.206186:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857669.206193:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857669.206196:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857669.212064:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 305 00000100:00100000:3.0:1787857669.212096:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+73:2347:x1874704171545216:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857669.212242:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+73:2347:x1874704171545216:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 162us (7860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857669.212251:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 305 00000100:00100000:3.0:1787857669.212277:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:3.0:1787857669.212295:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2348:x1874704171545600:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857669.212513:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2348:x1874704171545600:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 218us (7607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857669.212522:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 306 00010000:00010000:1.0:1787857669.870590:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857670.168901:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857670.169142:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171545984 00000100:00100000:2.0:1787857670.169155:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171545984 00000100:00100000:2.0:1787857670.169251:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 730 00000100:00100000:2.0:1787857670.169264:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21840:x1874704171545984:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787857670.169568:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21840:x1874704171545984:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 305us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857670.169577:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 730 00000100:00100000:0.0:1787857670.176964:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857670.177721:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171546240 00000100:00100000:2.0:1787857670.177737:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171546240 00000100:00100000:2.0:1787857670.177889:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 150 00000100:00100000:2.0:1787857670.177904:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:21840:x1874704171546240:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857670.179182:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:21840:x1874704171546240:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1270us (2223us total) trans 4294967776 rc 0/0 00000100:00100000:3.0:1787857670.179197:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 150 00010000:00010000:0.0:1787857670.894550:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857671.024664:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857671.024703:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188181888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857671.024782:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857671.025507:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188181888 00000100:00100000:3.0:1787857671.025517:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188181888 00000100:00100000:3.0:1787857671.025604:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787857671.025615:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188181888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857671.025654:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857671.025722:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188181888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857671.025729:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787857671.025881:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188181888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787857671.025982:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857671.918190:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857672.144640:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00000100:00100000:3.0:1787857672.559056:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188182144:0@lo:400:kworker.0 00000100:00100000:3.0:1787857672.559145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857672.559223:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188182656:0@lo:400:kworker.0 00000100:00100000:0.0:1787857672.559238:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188182144 00000100:00100000:0.0:1787857672.559255:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188182144 00000100:00100000:3.0:1787857672.559268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857672.559325:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787857672.559334:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188182016:0@lo:400:kworker.0 00000100:00100000:0.0:1787857672.559353:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787857672.559369:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188182144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857672.559379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857672.559412:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188182528:0@lo:400:kworker.0 00000100:00100000:1.0:1787857672.559597:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188182272:0@lo:400:kworker.0 00000100:00100000:3.0:1787857672.559627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857672.568085:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188182144:12345-0@lo:400:kworker.0 Request processed in 8701us (8919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857672.568104:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787857672.568151:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188182528 00000100:00100000:0.0:1787857672.568172:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188182528 00000100:00100000:0.0:1787857672.568264:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787857672.568273:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188182528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857672.568373:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188182528:12345-0@lo:400:kworker.0 Request processed in 100us (8744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857672.568379:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787857672.568417:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188182016 00000100:00100000:0.0:1787857672.568422:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188182016 00000100:00100000:0.0:1787857672.568454:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787857672.568462:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857672.568498:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188182016:12345-0@lo:400:kworker.0 Request processed in 37us (9127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857672.568505:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:0.0:1787857672.568545:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857672.568638:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188182400:0@lo:400:kworker.0 00000100:00100000:0.0:1787857672.568684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857672.568735:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188182656 00000100:00100000:0.0:1787857672.568739:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188182656 00000100:00100000:0.0:1787857672.568776:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188182400 00000100:00100000:0.0:1787857672.568780:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188182400 00000100:00100000:0.0:1787857672.572134:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787857672.572175:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188182656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857672.572303:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188182656:12345-0@lo:400:kworker.0 Request processed in 154us (13035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857672.572311:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787857672.572354:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787857672.572364:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188182400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857672.572438:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188182400:12345-0@lo:400:kworker.0 Request processed in 75us (3753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857672.572445:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:0.0:1787857672.572484:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857672.574295:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188182400:0@lo:400:kworker.0 00000100:00100000:2.0:1787857672.582173:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857672.582282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188182528:0@lo:400:kworker.0 00000100:00100000:2.0:1787857672.582300:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188182144:0@lo:400:kworker.0 00000100:00100000:2.0:1787857672.582311:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:2.0:1787857672.582318:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967335 committed transno 4294967335 00000100:00100000:2.0:1787857672.582340:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188182656:0@lo:400:kworker.0 00000100:00100000:2.0:1787857672.582365:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188182016:0@lo:400:kworker.0 00000100:00100000:3.0:1787857672.582514:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188182272 00000100:00100000:3.0:1787857672.582522:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188182272 00000100:00100000:3.0:1787857672.582624:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787857672.582636:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188182272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857672.582713:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188182272:12345-0@lo:400:kworker.0 Request processed in 80us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857672.582721:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:2.0:1787857672.583120:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857672.583164:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188182272:0@lo:400:kworker.0 00010000:00010000:1.0:1787857672.942265:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857673.004207:0:17296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 15:07:50 (1787857670) 00000100:00100000:0.0:1787857673.073639:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857673.073674:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188182784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857673.073792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857673.073938:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188182784 00000100:00100000:0.0:1787857673.073947:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188182784 00000100:00100000:0.0:1787857673.074010:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787857673.074021:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188182784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857673.074069:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857673.074120:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188182784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857673.074128:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787857673.074203:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188182784:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787857673.326467:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857673.326480:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857673.326899:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 18 count 2 00000040:00080000:0.0:1787857673.326909:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857673.966276:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787857674.067488:0:17345:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff23c6f460 20000000:00000080:0.0:1787857674.067506:0:17345:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9998d0925400 uarg=0000000000000000 00000040:00100000:0.0:1787857674.075020:0:17345:0:(llog.c:1072:llog_reverse_process()) index 41 : idx 1 00000040:00080000:0.0:1787857674.075399:0:17345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 224 off15448 20000000:01000000:0.0:1787857674.075426:0:17345:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre test_11c (null) (null) 00000040:00080000:0.0:1787857674.075460:0:17345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 112 off15560 00000040:00080000:0.0:1787857674.075495:0:17345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15784 00000040:00080000:0.0:1787857674.075885:0:17345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 224 off14712 20000000:01000000:0.0:1787857674.075907:0:17345:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre test_11c (null) (null) 00000040:00080000:0.0:1787857674.075945:0:17345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 120 off14832 00000040:00080000:0.0:1787857674.076004:0:17345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off15056 10000000:01000000:0.0:1787857674.076022:0:17345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787857674.076044:0:17345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076064:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998c13fc200/0xd3f183cab4a781f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a781ef expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076073:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998c1495e00/0xd3f183cab4a78204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a781fd expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076081:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998da8f4a00/0xd3f183cab4a78212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7820b expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076087:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a78220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a78219 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076094:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7822e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a78227 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076101:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998da8f5c00/0xd3f183cab4a7823c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a78235 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076107:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7824a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a78243 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076116:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e95c00/0xd3f183cab4a78251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2688 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076123:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998c1495400/0xd3f183cab4a78258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd268f expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076137:0:17345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998da8f5000/0xd3f183cab4a78297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd269d expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076145:0:17345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076183:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998da8f5000/0xd3f183cab4a78297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd269d expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076200:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9998da8f5000/0xd3f183cab4a78297 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd269d expref: 12 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.076215:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7049680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188182912:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857674.076333:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998c1495400/0xd3f183cab4a78258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd268f expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076341:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9998c1495400/0xd3f183cab4a78258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd268f expref: 12 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.076348:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183040:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857674.076378:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e95c00/0xd3f183cab4a78251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2688 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076386:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9998f8e95c00/0xd3f183cab4a78251 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2688 expref: 12 pid: 5849 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.076394:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183168:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857674.076431:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7824a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a78243 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076438:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7824a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a78243 expref: 18 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.076448:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183296:0@lo:104: 00000100:00100000:0.0:1787857674.076483:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857674.076508:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998da8f5c00/0xd3f183cab4a7823c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a78235 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076516:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998da8f5c00/0xd3f183cab4a7823c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a78235 expref: 18 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.076535:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183424:0@lo:104: 00000100:00100000:0.0:1787857674.076558:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857674.076594:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7822e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a78227 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076602:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7822e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a78227 expref: 18 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.076610:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183552:0@lo:104: 00000100:00100000:0.0:1787857674.076632:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857674.076648:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a78220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a78219 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.076655:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a78220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a78219 expref: 18 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857674.076712:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188183296 00000100:00100000:1.0:1787857674.076720:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188183296 00000100:00100000:3.0:1787857674.076734:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188183424 00000100:00100000:3.0:1787857674.076738:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188183424 00000100:00100000:3.0:1787857674.076756:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188183552 00000100:00100000:3.0:1787857674.076758:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188183552 00000100:00100000:1.0:1787857674.076760:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787857674.076768:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17345:x1874704188183424:12345-0@lo:104: 00010000:00010000:1.0:1787857674.076780:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a78235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7823c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857674.079045:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857674.079064:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17345:x1874704188183424:12345-0@lo:104: Request processed in 2292us (2501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857674.079076:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787857674.079117:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787857674.079145:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17345:x1874704188183296:12345-0@lo:104: 00010000:00010000:1.0:1787857674.079162:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a78243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7824a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.083966:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857674.084010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857674.084077:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857674.084111:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171546368 00000100:00100000:3.0:1787857674.084120:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171546368 00010000:00010000:3.0:1787857674.084162:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998da8f5000/0xd3f183cab4a78297 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd269d expref: 13 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.084238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171546624 00000100:00100000:3.0:1787857674.084242:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171546624 00010000:00010000:3.0:1787857674.084257:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e95c00/0xd3f183cab4a78251 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2688 expref: 14 pid: 5849 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.084269:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171546496 00000100:00100000:3.0:1787857674.084272:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171546496 00010000:00010000:3.0:1787857674.084282:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998c1495400/0xd3f183cab4a78258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd268f expref: 15 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.084294:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 202 00000100:00100000:3.0:1787857674.084303:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:2350:x1874704171546368:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857674.084335:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857674.084341:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998da8f5000/0xd3f183cab4a78297 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd269d expref: 15 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.086147:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183680:0@lo:104: 00000100:00100000:0.0:1787857674.086236:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:0.0:1787857674.086252:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:2350:x1874704171546624:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857674.086271:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857674.086278:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e95c00/0xd3f183cab4a78251 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2688 expref: 15 pid: 5849 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086372:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857674.086380:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a78235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7823c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086388:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857674.086392:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a78235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7823c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086401:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a78235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7823c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857674.086409:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a78235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7823c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857674.086415:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857674.086452:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a78235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7823c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086457:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857674.086475:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a78235 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7823c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086483:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a78235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7823c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086498:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857674.086501:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a78243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7824a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086513:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857674.086516:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a78243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7824a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086535:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a78243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7824a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857674.086541:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a78243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7824a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857674.086547:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857674.086561:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a78243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7824a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086566:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857674.086580:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a78243 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7824a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086587:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a78243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7824a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.086595:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857674.086596:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857674.086598:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857674.086619:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188183808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857674.086684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857674.086728:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857674.086735:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188183936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857674.086766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857674.088371:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998da8f5000/0xd3f183cab4a78297 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd269d expref: 15 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.088404:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857674.088480:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:2350:x1874704171546368:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 4176us (4526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.088599:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 202 00000100:00100000:3.0:1787857674.088629:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188183808 00000100:00100000:3.0:1787857674.088637:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188183808 00010000:00010000:3.0:1787857674.088664:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998da8f5c00/0xd3f183cab4a7823c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a78235 expref: 19 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.088679:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188183936 00000100:00100000:3.0:1787857674.088681:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188183936 00010000:00010000:3.0:1787857674.088690:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7824a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a78243 expref: 20 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.088703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:3.0:1787857674.088710:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:2349:x1874704171546496:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857674.088722:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857674.088727:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998c1495400/0xd3f183cab4a78258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd268f expref: 14 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.088737:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998c1495400/0xd3f183cab4a78258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd268f expref: 14 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.088763:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857674.088781:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:2349:x1874704171546496:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 71us (4704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.088787:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:3.0:1787857674.088799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787857674.088806:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3303:x1874704188183808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857674.088813:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857674.088833:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998da8f5c00/0xd3f183cab4a7823c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a78235 expref: 20 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.088843:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998da8f5c00/0xd3f183cab4a7823c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a78235 expref: 20 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.088852:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857674.088895:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3303:x1874704188183808:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.088902:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787857674.088913:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787857674.088919:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188183936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857674.088926:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857674.088929:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7824a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a78243 expref: 19 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.088937:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7824a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a78243 expref: 19 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.088946:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857674.088973:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188183936:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.088980:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787857674.089180:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857674.089213:0:5839:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787857674.089222:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1787857674.089357:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998da8f4a00/0xd3f183cab4a78212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7820b expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.089372:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998da8f4a00/0xd3f183cab4a78212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7820b expref: 18 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.089387:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012221c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188184064:0@lo:104: 00000100:00100000:3.0:1787857674.089417:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857674.089456:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998c1495e00/0xd3f183cab4a78204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a781fd expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.089465:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998c1495e00/0xd3f183cab4a78204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a781fd expref: 18 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.089473:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188184192:0@lo:104: 00000100:00100000:3.0:1787857674.089724:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857674.089746:0:17345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998c13fc200/0xd3f183cab4a781f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a781ef expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.089756:0:17345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998c13fc200/0xd3f183cab4a781f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a781ef expref: 18 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.089764:0:17345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188184320:0@lo:104: 00000100:00100000:3.0:1787857674.089787:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857674.089806:0:17345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6180 going to sleep for 11 seconds 00010000:00010000:3.0:1787857674.089862:0:17345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998da8f5000/0xd3f183cab4a78297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd269d expref: 13 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.089879:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7049680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188182912:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857674.089891:0:17345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998c1495400/0xd3f183cab4a78258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd268f expref: 12 pid: 5850 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.089900:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183040:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857674.089911:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183168:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857674.089921:0:17345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7824a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a78243 expref: 18 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.089929:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183296:0@lo:104: 00010000:00010000:3.0:1787857674.089938:0:17345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998da8f5c00/0xd3f183cab4a7823c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a78235 expref: 17 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.089945:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183424:0@lo:104: 00000100:00100000:3.0:1787857674.089978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188183680 00000100:00100000:3.0:1787857674.089982:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188183680 00000100:00100000:3.0:1787857674.090010:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787857674.090018:0:5839:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787857674.090025:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188184064 00000100:00100000:3.0:1787857674.090027:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188184064 00000100:00100000:3.0:1787857674.090035:0:5839:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787857674.090039:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188184192 00000100:00100000:3.0:1787857674.090041:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188184192 00000100:00100000:3.0:1787857674.090048:0:5839:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787857674.090051:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188184320 00000100:00100000:3.0:1787857674.090157:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188184320 00000100:00100000:3.0:1787857674.090248:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787857674.090256:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+8:17345:x1874704188183552:12345-0@lo:104: 00010000:00010000:3.0:1787857674.090271:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998c13fd800/0xd3f183cab4a78227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7822e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857674.090314:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188183808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857674.090346:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183552:0@lo:104: 00000100:00100000:2.0:1787857674.090368:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188183936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857674.090385:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787857674.090487:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+8:17345:x1874704188183552:12345-0@lo:104: Request processed in 137us (13759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.090495:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787857674.090586:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787857674.090593:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+7:17345:x1874704188183680:12345-0@lo:104: 00010000:00010000:3.0:1787857674.090601:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998c13fd200/0xd3f183cab4a78219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a78220 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.090645:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787857674.090650:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+7:17345:x1874704188183680:12345-0@lo:104: Request processed in 59us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.090656:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787857674.090669:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787857674.090674:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+6:17345:x1874704188184064:12345-0@lo:104: 00010000:00010000:3.0:1787857674.090680:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998f8e94200/0xd3f183cab4a7820b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a78212 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.090704:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787857674.090709:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+6:17345:x1874704188184064:12345-0@lo:104: Request processed in 35us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.090723:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787857674.090734:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787857674.090738:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17345:x1874704188184192:12345-0@lo:104: 00010000:00010000:3.0:1787857674.090746:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998f8e95200/0xd3f183cab4a781fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a78204 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.090769:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787857674.090773:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17345:x1874704188184192:12345-0@lo:104: Request processed in 35us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.090778:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787857674.090787:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787857674.090792:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17345:x1874704188184320:12345-0@lo:104: 00010000:00010000:3.0:1787857674.090836:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998f8e95e00/0xd3f183cab4a781ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a781f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.090860:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787857674.090864:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17345:x1874704188184320:12345-0@lo:104: Request processed in 73us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857674.090870:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1787857674.091204:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787857674.091211:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998c13fd800/0xd3f183cab4a78227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7822e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091221:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857674.091225:0:7647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998c13fd800/0xd3f183cab4a78227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7822e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091235:0:7647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998c13fd800/0xd3f183cab4a78227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7822e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857674.091242:0:7647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998c13fd800/0xd3f183cab4a78227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7822e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857674.091249:0:7647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857674.091295:0:7647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998c13fd800/0xd3f183cab4a78227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7822e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091302:0:7647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857674.091308:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e95c00/0xd3f183cab4a78251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2688 expref: 11 pid: 5849 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091318:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998c13fd800/0xd3f183cab4a78227 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7822e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091324:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998c13fd800/0xd3f183cab4a78227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7822e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091327:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e95c00/0xd3f183cab4a78251 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2688 expref: 11 pid: 5849 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091337:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787857674.091340:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857674.091347:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998c13fd200/0xd3f183cab4a78219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a78220 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091353:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857674.091355:0:7647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998c13fd200/0xd3f183cab4a78219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a78220 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091361:0:7647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998c13fd200/0xd3f183cab4a78219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a78220 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857674.091366:0:7647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998c13fd200/0xd3f183cab4a78219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a78220 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857674.091370:0:7647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787857674.091382:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+10:2350:x1874704171546624:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5137us (7371us total) trans 0 rc 0/0 00010000:00010000:2.0:1787857674.091384:0:7647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998c13fd200/0xd3f183cab4a78219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78220 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091389:0:7647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787857674.091391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 203 00010000:00010000:2.0:1787857674.091400:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998c13fd200/0xd3f183cab4a78219 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78220 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091406:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998c13fd200/0xd3f183cab4a78219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78220 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091419:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787857674.091421:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998f8e94200/0xd3f183cab4a7820b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a78212 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091427:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857674.091429:0:7647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e94200/0xd3f183cab4a7820b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a78212 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091445:0:7647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998f8e94200/0xd3f183cab4a7820b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a78212 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857674.091451:0:7647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e94200/0xd3f183cab4a7820b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a78212 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857674.091456:0:7647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857674.091469:0:7647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998f8e94200/0xd3f183cab4a7820b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78212 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091474:0:7647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857674.091479:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857674.091480:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998f8e94200/0xd3f183cab4a7820b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78212 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091483:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998f8e95200/0xd3f183cab4a781fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a78204 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091486:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998f8e94200/0xd3f183cab4a7820b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78212 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091490:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1787857674.091493:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e95200/0xd3f183cab4a781fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a78204 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091496:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857674.091499:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998f8e95e00/0xd3f183cab4a781ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a781f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091500:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998f8e95200/0xd3f183cab4a781fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a78204 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091505:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857674.091508:0:7647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e95e00/0xd3f183cab4a781ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a781f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091514:0:7647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998f8e95e00/0xd3f183cab4a781ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a781f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857674.091518:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e95200/0xd3f183cab4a781fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a78204 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857674.091533:0:7647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e95e00/0xd3f183cab4a781ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a781f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857674.091536:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787857674.091543:0:7647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857674.091550:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998f8e95200/0xd3f183cab4a781fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78204 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091552:0:7647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998f8e95e00/0xd3f183cab4a781ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a781f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091556:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857674.091558:0:7647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857674.091563:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998f8e95e00/0xd3f183cab4a781ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a781f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091563:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998f8e95200/0xd3f183cab4a781fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78204 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091570:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998f8e95e00/0xd3f183cab4a781ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a781f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091571:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998f8e95200/0xd3f183cab4a781fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a78204 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091580:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857674.091582:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857674.091582:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857674.091584:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857674.091584:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857674.091585:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857674.091591:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857674.091597:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188184832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857674.091598:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188184448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857674.091632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857674.091644:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188184576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857674.091667:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857674.091681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857674.091686:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857674.091691:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188184704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857674.091693:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188184960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857674.091710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857674.091719:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188184832 00000100:00100000:2.0:1787857674.091723:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188184832 00000100:00100000:0.0:1787857674.091734:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188184576 00000100:00100000:0.0:1787857674.091737:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188184576 00010000:00010000:2.0:1787857674.091743:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998c1495e00/0xd3f183cab4a78204 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a781fd expref: 18 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091749:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a78220 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a78219 expref: 18 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857674.091758:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188184448 00000100:00100000:0.0:1787857674.091760:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188184960 00000100:00100000:2.0:1787857674.091761:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188184448 00000100:00100000:0.0:1787857674.091761:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188184960 00010000:00010000:2.0:1787857674.091770:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7822e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a78227 expref: 20 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091778:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998c13fc200/0xd3f183cab4a781f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a781ef expref: 20 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857674.091787:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787857674.091790:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787857674.091793:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3304:x1874704188184832:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857674.091795:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3302:x1874704188184576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857674.091803:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857674.091803:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857674.091808:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998c1495e00/0xd3f183cab4a78204 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a781fd expref: 20 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.091808:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a78220 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a78219 expref: 20 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091859:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998c1495e00/0xd3f183cab4a78204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a781fd expref: 20 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091870:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857674.091898:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3304:x1874704188184832:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857674.091905:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787857674.091917:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787857674.091922:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188184448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857674.091930:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857674.091931:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a78220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a78219 expref: 19 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091934:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7822e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a78227 expref: 19 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.091943:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7822e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a78227 expref: 19 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.092220:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787857674.092231:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1787857674.092414:0:17345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a78220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a78219 expref: 19 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.092426:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188183680:0@lo:104: 00000100:00100000:3.0:1787857674.092438:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012221c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188184064:0@lo:104: 00010000:00010000:3.0:1787857674.092448:0:17345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998c1495e00/0xd3f183cab4a78204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a781fd expref: 18 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857674.092467:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188184192:0@lo:104: 00000100:00100000:3.0:1787857674.092479:0:17345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17345:1874704188184320:0@lo:104: 00010000:00010000:1.0:1787857674.095478:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787857674.095505:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17345:x1874704188183296:12345-0@lo:104: Request processed in 16355us (19014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857674.095531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787857674.098658:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857674.098758:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:3302:x1874704188184576:12345-0@lo:103:ldlm_bl.0 Request processed in 6956us (7083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857674.098771:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787857674.098811:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787857674.098836:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:3305:x1874704188184960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857674.098855:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857674.098864:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998c13fc200/0xd3f183cab4a781f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a781ef expref: 16 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.098877:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998c13fc200/0xd3f183cab4a781f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a781ef expref: 16 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.098895:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998c13fc200/0xd3f183cab4a781f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a781ef expref: 16 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.098908:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857674.098948:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:3305:x1874704188184960:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (7237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857674.098954:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787857674.098997:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188184832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857674.099050:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188184960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857674.099071:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857674.099110:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188184576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857674.099131:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188184704 00000100:00100000:0.0:1787857674.099137:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188184704 00010000:00010000:0.0:1787857674.100514:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998da8f4a00/0xd3f183cab4a78212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7820b expref: 15 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.100578:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787857674.100589:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:3302:x1874704188184704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857674.100602:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857674.100607:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998da8f4a00/0xd3f183cab4a78212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7820b expref: 15 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.100619:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998da8f4a00/0xd3f183cab4a78212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7820b expref: 15 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.100637:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998da8f4a00/0xd3f183cab4a78212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7820b expref: 15 pid: 5850 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857674.100652:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857674.100705:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:3302:x1874704188184704:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857674.100713:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00010000:00010000:2.0:1787857674.100733:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7822e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a78227 expref: 14 pid: 5851 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.100746:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857674.100763:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188184704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857674.100765:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.100805:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857674.101170:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.101179:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.101225:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.101232:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.101238:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857674.101242:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.101250:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.101261:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857674.101271:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857674.101361:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:3305:x1874704188184448:12345-0@lo:103:ldlm_bl.0 Request processed in 9437us (9678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857674.101368:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787857674.101405:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188184448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857674.108402:0:17345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.108576:0:17345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.108585:0:17345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857674.108592:0:17345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc5800/0xd3f183cab4a7b0e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787857674.167671:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 10 batchid updated 00000001:00080000:0.0:1787857674.167702:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967776 is committed 00000020:00080000:2.0:1787857674.167752:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00000020:00080000:2.0:1787857674.167769:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00000100:00100000:3.0:1787857674.324011:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857674.324578:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171546752 00000100:00100000:0.0:1787857674.324591:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171546752 00000100:00100000:0.0:1787857674.324701:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 310 00000100:00100000:0.0:1787857674.324714:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+73:2347:x1874704171546752:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857674.324877:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+73:2347:x1874704171546752:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 167us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857674.324886:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 310 00000100:00080000:2.0:1787857674.327328:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857674.328559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857674.328775:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171547008 00000100:00100000:1.0:1787857674.328789:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171547008 00000100:00100000:1.0:1787857674.328908:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 276 00000100:00100000:1.0:1787857674.328921:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171547008:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857674.329016:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171547008:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 98us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857674.329025:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 276 00000100:00080000:2.0:1787857674.331848:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857674.336804:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857674.336980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857674.337007:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857674.337096:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171547136 00000100:00100000:2.0:1787857674.337109:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171547136 00000100:00080000:3.0:1787857674.337225:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857674.337227:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 311 00000100:00100000:2.0:1787857674.337252:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2348:x1874704171547136:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857674.337377:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2348:x1874704171547136:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 129us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857674.337386:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 311 00000100:00100000:1.0:1787857674.345014:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857674.348921:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171546880 00000100:00100000:0.0:1787857674.348944:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171546880 00000100:00100000:0.0:1787857674.350564:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171547392 00000100:00100000:0.0:1787857674.350580:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171547392 00000100:00100000:0.0:1787857674.350661:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 277 00000100:00100000:0.0:1787857674.350675:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171546880:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857674.350893:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171546880:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 221us (14105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857674.350902:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 277 00000100:00100000:0.0:1787857674.350924:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 278 00000100:00100000:0.0:1787857674.350931:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171547392:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857674.350959:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171547392:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (13951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857674.350965:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 278 00000100:00100000:1.0:1787857674.351588:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171547264 00000100:00100000:1.0:1787857674.351599:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171547264 00000100:00100000:1.0:1787857674.351648:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00100000:1.0:1787857674.351657:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171547264:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857674.351699:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171547264:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 44us (6701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857674.351719:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00080000:3.0:1787857674.352613:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857674.352622:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857674.990133:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787857675.694071:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787857675.694478:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9997c18ad800 from 42 10000000:01000000:3.0:1787857675.694497:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787857675.694758:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.694772:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.694787:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857675.694884:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.694985:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857675.695147:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857675.702144:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188185088 00000100:00100000:0.0:1787857675.702168:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188185088 00000100:00100000:0.0:1787857675.702758:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787857675.702775:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:5853:x1874704188185088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857675.702800:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857675.703043:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b0e9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.703083:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.703096:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.703107:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5600, rc 0) 00000100:00100000:0.0:1787857675.703246:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188185088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 477us (8261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857675.703255:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787857675.703369:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857675.703412:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.703424:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857675.703537:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.703986:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857675.711520:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.711658:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188185216 00000100:00100000:2.0:1787857675.711670:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188185216 00000100:00100000:2.0:1787857675.711742:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787857675.711755:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188185216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.713484:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188185216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1720us (9488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.713510:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1787857675.714161:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.714270:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.714339:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857675.714597:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188185344 00000100:00100000:2.0:1787857675.714606:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188185344 00000100:00100000:3.0:1787857675.714718:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.716684:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787857675.716714:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188185344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.719733:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188185344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3019us (5380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.719751:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787857675.722516:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.735203:0:17349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17349:1874704188185472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857675.736567:0:17349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.736625:0:17349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb7fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857675.737226:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188185472 00000100:00100000:0.0:1787857675.737240:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188185472 00000100:00100000:0.0:1787857675.737313:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787857675.737325:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17349:x1874704188185472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857675.737706:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17349:x1874704188185472:12345-0@lo:502:llog_process_th.0 Request processed in 382us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857675.737715:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787857675.738544:0:17349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17349:1874704188185472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857675.738689:0:17349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17349:1874704188185600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857675.738755:0:17349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857675.738809:0:17349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857675.740425:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188185600 00000100:00100000:0.0:1787857675.740441:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188185600 00000100:00100000:0.0:1787857675.740538:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787857675.740550:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17349:x1874704188185600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857675.740986:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17349:x1874704188185600:12345-0@lo:502:llog_process_th.0 Request processed in 437us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857675.740996:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787857675.741282:0:17349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17349:1874704188185600:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787857675.741361:0:17349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:3.0:1787857675.742978:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:3.0:1787857675.743026:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857675.743042:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.743055:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857675.743092:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787857675.743096:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787857675.743099:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787857675.743164:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.743172:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.743185:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857675.743214:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.743297:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857675.743348:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.744319:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188185728 00000100:00100000:2.0:1787857675.744333:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188185728 00000100:00100000:2.0:1787857675.744413:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787857675.744424:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188185728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857675.744443:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857675.744464:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b0f7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.744508:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.744521:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.744532:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52c00, rc 0) 00000100:00100000:2.0:1787857675.744614:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188185728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.744621:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787857675.746558:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857675.746604:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.746631:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857675.747532:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.747637:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.747707:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fd0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857675.748340:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188185856 00000100:00100000:3.0:1787857675.748352:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188185856 00000100:00100000:3.0:1787857675.748433:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787857675.748447:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188185856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.748885:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188185856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 440us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857675.748904:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787857675.752111:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.752218:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.752333:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.752394:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fd0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.755425:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188185984 00000100:00100000:2.0:1787857675.755446:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188185984 00000100:00100000:2.0:1787857675.755568:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787857675.755581:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188185984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.756137:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188185984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 556us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.756152:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787857675.758949:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188185984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787857675.761528:0:17350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1787857675.763223:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787857675.763267:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787857675.763284:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.763298:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857675.763311:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787857675.763314:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9998dba2e800 from 42 10000000:01000000:3.0:1787857675.763317:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787857675.763373:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.763381:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.763394:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857675.763427:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.763536:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857675.763595:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.763754:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188186112 00000100:00100000:2.0:1787857675.763765:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188186112 00000100:00100000:2.0:1787857675.763861:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787857675.763872:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188186112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857675.763890:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857675.763906:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b105 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.764170:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.764186:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.764197:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52400, rc 0) 00000100:00100000:2.0:1787857675.764257:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188186112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 387us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.764264:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787857675.765886:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857675.765931:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.765973:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857675.766084:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.766161:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857675.766219:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.766300:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188186240 00000100:00100000:2.0:1787857675.766309:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188186240 00000100:00100000:2.0:1787857675.766361:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787857675.766376:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188186240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.766709:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188186240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.766718:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787857675.766931:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.766971:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.767022:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857675.767048:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.767286:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188186368 00000100:00100000:2.0:1787857675.767299:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188186368 00000100:00100000:2.0:1787857675.767339:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787857675.767347:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188186368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.767531:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188186368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.767539:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787857675.768652:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.769386:0:17351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17351:1874704188186496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857675.769466:0:17351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857675.769525:0:17351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857675.769584:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188186496 00000100:00100000:1.0:1787857675.769590:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188186496 00000100:00100000:1.0:1787857675.769811:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787857675.769852:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17351:x1874704188186496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857675.770357:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17351:x1874704188186496:12345-0@lo:502:llog_process_th.0 Request processed in 507us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857675.770367:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787857675.770559:0:17351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17351:1874704188186496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857675.771890:0:17351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17351:1874704188186624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857675.771985:0:17351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.772094:0:17351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857675.775672:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188186624 00000100:00100000:1.0:1787857675.775692:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188186624 00000100:00100000:1.0:1787857675.775785:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787857675.775798:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17351:x1874704188186624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857675.776238:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17351:x1874704188186624:12345-0@lo:502:llog_process_th.0 Request processed in 441us (4251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857675.776247:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787857675.777920:0:17351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17351:1874704188186624:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787857675.778014:0:17351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:0.0:1787857675.778957:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:0.0:1787857675.778991:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857675.779850:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.780142:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857675.780157:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787857675.780161:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1787857675.780165:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787857675.780468:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.780513:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.780528:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857675.780565:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.780665:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.780871:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.781500:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188186752 00000100:00100000:2.0:1787857675.781513:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188186752 00000100:00100000:2.0:1787857675.781645:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1787857675.781657:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188186752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857675.781677:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857675.781700:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b113 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.781736:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.781748:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.781759:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52600, rc 0) 00000100:00100000:2.0:1787857675.781873:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188186752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.781880:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787857675.782089:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857675.782110:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.782119:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857675.782225:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.782258:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.782810:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857675.783165:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188186880 00000100:00100000:1.0:1787857675.783173:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188186880 00000100:00100000:1.0:1787857675.783227:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787857675.783236:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188186880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.783611:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188186880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857675.783619:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787857675.784277:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188186880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.784343:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.784402:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.784430:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857675.784575:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188187008 00000100:00100000:1.0:1787857675.784581:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188187008 00000100:00100000:1.0:1787857675.784611:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787857675.784618:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188187008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.785142:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188187008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 522us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857675.785150:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787857675.785563:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787857675.787242:0:17352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:1.0:1787857675.787700:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787857675.787729:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787857675.787742:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857675.787757:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857675.787770:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787857675.787774:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9998dbb32800 from 42 10000000:01000000:1.0:1787857675.787777:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787857675.787860:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857675.787870:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857675.787883:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857675.787911:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.787997:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.788055:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857675.788321:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188187136 00000100:00100000:0.0:1787857675.788330:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188187136 00000100:00100000:0.0:1787857675.788378:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787857675.788388:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188187136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857675.788404:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857675.788420:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b121 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.788448:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.788460:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.788469:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4400, rc 0) 00000100:00100000:0.0:1787857675.788522:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188187136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857675.788530:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787857675.788692:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857675.788708:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857675.788718:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857675.788781:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.788808:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.789769:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857675.791589:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188187264 00000100:00100000:3.0:1787857675.791607:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188187264 00000100:00100000:2.0:1787857675.791795:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787857675.791809:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188187264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.792648:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188187264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 839us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.792666:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787857675.793142:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.793209:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.793340:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.793413:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.793451:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188187392 00000100:00100000:2.0:1787857675.793457:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188187392 00000100:00100000:2.0:1787857675.793533:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787857675.793541:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188187392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.793739:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188187392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.793747:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787857675.793813:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.799033:0:17353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17353:1874704188187520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857675.799160:0:17353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.800605:0:17353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fd0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857675.800705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188187520 00000100:00100000:3.0:1787857675.800717:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188187520 00000100:00100000:3.0:1787857675.800788:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787857675.800797:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17353:x1874704188187520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857675.801679:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17353:x1874704188187520:12345-0@lo:502:llog_process_th.0 Request processed in 878us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857675.801690:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787857675.806530:0:17353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17353:1874704188187520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857675.806802:0:17353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17353:1874704188187648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857675.810562:0:17353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.810626:0:17353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857675.810881:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188187648 00000100:00100000:3.0:1787857675.810892:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188187648 00000100:00100000:3.0:1787857675.810961:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787857675.810972:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17353:x1874704188187648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857675.811332:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17353:x1874704188187648:12345-0@lo:502:llog_process_th.0 Request processed in 361us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857675.811341:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787857675.811685:0:17353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17353:1874704188187648:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787857675.811759:0:17353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:1.0:1787857675.812034:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:1.0:1787857675.812059:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787857675.812081:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857675.812094:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857675.812121:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787857675.812124:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 37 10000000:01000000:1.0:1787857675.812128:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787857675.812165:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857675.812174:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857675.812195:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857675.812221:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.812276:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.812315:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857675.812480:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188187776 00000100:00100000:0.0:1787857675.812496:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188187776 00000100:00100000:0.0:1787857675.812536:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787857675.812551:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188187776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857675.812565:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857675.812578:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b12f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.812605:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.812617:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.812628:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4200, rc 0) 00000100:00100000:0.0:1787857675.812668:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188187776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857675.812675:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787857675.812797:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857675.812811:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857675.813028:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857675.813097:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.813125:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.813154:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857675.813206:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188187904 00000100:00100000:2.0:1787857675.813211:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188187904 00000100:00100000:2.0:1787857675.813245:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787857675.813252:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188187904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.813537:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188187904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.813544:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787857675.813766:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188187904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.813799:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188188032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.813875:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.813894:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65540 going to sleep for 11 seconds 00000100:00100000:1.0:1787857675.813909:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188188032 00000100:00100000:1.0:1787857675.813912:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188188032 00000100:00100000:1.0:1787857675.813931:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1787857675.813937:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188188032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.814102:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188188032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857675.814109:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1787857675.814141:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188188032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857675.816448:0:17354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17354:1874704188188160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857675.816720:0:17354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857675.816782:0:17354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857675.816881:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188188160 00000100:00100000:0.0:1787857675.816891:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188188160 00000100:00100000:0.0:1787857675.816960:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787857675.816971:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17354:x1874704188188160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857675.817389:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17354:x1874704188188160:12345-0@lo:502:llog_process_th.0 Request processed in 418us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857675.817398:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787857675.817655:0:17354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17354:1874704188188160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787857675.817724:0:17354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857675.817740:0:17354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857675.817743:0:17354:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-MDT0000-m new lustre.test_11c 00000020:00000080:1.0:1787857675.817749:0:17354:0:(obd_config.c:1472:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1787857675.817858:0:17354:0:(lod_pool.c:475:lod_pool_new()) test_11c is pool #1 00080000:10000000:1.0:1787857675.819848:0:17354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00080000:10000000:1.0:1787857675.852737:0:17354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00080000:10000000:1.0:1787857675.912324:0:17354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00000100:00100000:0.0:1787857675.986301:0:17354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17354:1874704188188288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857675.990338:0:17354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.990570:0:17354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857675.992202:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188188288 00000100:00100000:3.0:1787857675.992219:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188188288 00000100:00100000:3.0:1787857675.992307:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787857675.992320:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17354:x1874704188188288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857675.993575:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17354:x1874704188188288:12345-0@lo:502:llog_process_th.0 Request processed in 1249us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857675.993589:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787857675.993773:0:17354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17354:1874704188188288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857675.994008:0:17354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857675.994029:0:17354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857675.994032:0:17354:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-MDT0000-m new lustre.test_11c 00000040:00080000:0.0:1787857675.994038:0:17354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000020:01000000:2.0:1787857675.994304:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 37-39 (rc=0) 10000000:01000000:2.0:1787857675.994329:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787857675.994342:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.994355:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857675.994367:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787857675.994376:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9998c56d8000 from 1 10000000:01000000:2.0:1787857675.994380:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787857675.994524:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.994533:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857675.994544:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857675.994572:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188188416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857675.994632:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857675.994780:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5bfd840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857675.995065:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188188416 00000100:00100000:0.0:1787857675.995074:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188188416 00000100:00100000:0.0:1787857675.995129:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787857675.995139:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188188416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857675.995154:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857675.995170:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b13d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.995203:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.995216:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.995227:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5200, rc 0) 00000100:00100000:0.0:1787857675.995270:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188188416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857675.995277:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787857675.995318:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188188416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857675.995333:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857675.995342:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857675.995423:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188188544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857675.995462:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857675.995498:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857675.995556:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188188544 00000100:00100000:3.0:1787857675.995560:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188188544 00000100:00100000:3.0:1787857675.995589:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787857675.995596:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188188544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857675.995907:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188188544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (443us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857675.995914:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787857675.995956:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188188544:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787857675.995988:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787857675.996000:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857675.996007:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857676.014456:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857676.116151:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857676.116602:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171547520 00000100:00100000:2.0:1787857676.116616:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171547520 00000100:00100000:2.0:1787857676.116701:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 390 00000100:00100000:2.0:1787857676.116713:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+10:5605:x1874704171547520:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857676.116737:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857676.116761:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd343b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857676.116800:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857676.116814:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857676.116848:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52000, rc 0) 00000100:00100000:2.0:1787857676.116948:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171547520:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 238us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857676.116957:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 390 00000100:00100000:3.0:1787857676.124460:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857676.124917:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171547648 00000100:00100000:2.0:1787857676.124931:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171547648 00000100:00100000:2.0:1787857676.125003:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 391 00000100:00100000:2.0:1787857676.125014:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171547648:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857676.126669:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171547648:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 1647us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857676.126683:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 391 00000100:00100000:0.0:1787857676.131468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857676.131863:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171547776 00000100:00100000:1.0:1787857676.131877:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171547776 00000100:00100000:1.0:1787857676.131950:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00100000:1.0:1787857676.131961:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171547776:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857676.132289:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171547776:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 327us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857676.132299:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00100000:0.0:1787857676.144994:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857676.145046:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171547904 00000100:00100000:0.0:1787857676.145059:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171547904 00000100:00100000:0.0:1787857676.145136:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00100000:0.0:1787857676.145150:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22480:x1874704171547904:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857676.145589:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22480:x1874704171547904:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 440us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857676.145600:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00100000:3.0:1787857676.149325:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857676.149358:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188188672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857676.149449:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857676.149546:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188188672 00000100:00100000:3.0:1787857676.149556:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188188672 00000100:00100000:3.0:1787857676.149625:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787857676.149636:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188188672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857676.149681:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857676.149737:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188188672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857676.149746:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1787857676.149770:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857676.149837:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188188672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857676.170511:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857676.177348:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171548032 00000100:00100000:0.0:1787857676.177373:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171548032 00000100:00100000:0.0:1787857676.177475:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 394 00000100:00100000:0.0:1787857676.177597:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22480:x1874704171548032:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857676.179794:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22480:x1874704171548032:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 2188us (9283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857676.179812:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 394 00000100:00100000:0.0:1787857676.196347:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857676.196414:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171548160 00000100:00100000:3.0:1787857676.196427:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171548160 00000100:00100000:3.0:1787857676.196516:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 395 00000100:00100000:3.0:1787857676.196528:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171548160:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857676.196601:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857676.196627:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3442 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857676.196747:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857676.196761:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857676.196773:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6e00, rc 0) 00000100:00100000:3.0:1787857676.196938:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171548160:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 410us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857676.196946:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 395 00000100:00100000:0.0:1787857676.201602:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857676.202639:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171548288 00000100:00100000:1.0:1787857676.202657:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171548288 00000100:00100000:1.0:1787857676.206348:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 396 00000100:00100000:1.0:1787857676.206374:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171548288:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857676.206840:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171548288:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 475us (6358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857676.206851:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 396 00000100:00100000:0.0:1787857676.222711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857676.225160:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171548416 00000100:00100000:2.0:1787857676.225180:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171548416 00000100:00100000:2.0:1787857676.225261:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:2.0:1787857676.225273:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171548416:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857676.225709:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171548416:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 437us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857676.225719:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:0.0:1787857676.232738:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857676.233625:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171548544 00000100:00100000:2.0:1787857676.233641:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171548544 00000100:00100000:2.0:1787857676.233731:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:2.0:1787857676.233743:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22487:x1874704171548544:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857676.234144:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22487:x1874704171548544:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 402us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857676.234153:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:3.0:1787857676.240920:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857676.241075:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171548672 00000100:00100000:2.0:1787857676.241094:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171548672 00000100:00100000:2.0:1787857676.241574:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 399 00000100:00100000:2.0:1787857676.241589:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22487:x1874704171548672:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857676.241977:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22487:x1874704171548672:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 391us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857676.241988:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 399 00000100:00100000:3.0:1787857676.246371:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857676.249762:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171548800 00000100:00100000:0.0:1787857676.249784:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171548800 00000100:00100000:0.0:1787857676.250223:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 400 00000100:00100000:0.0:1787857676.250250:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171548800:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857676.250276:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857676.250299:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3449 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857676.250350:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857676.250364:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857676.250374:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4000, rc 0) 00000100:00100000:0.0:1787857676.250460:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171548800:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 214us (4101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857676.250468:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 400 00000100:00100000:3.0:1787857676.253238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857676.253427:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171548928 00000100:00100000:2.0:1787857676.253441:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171548928 00000100:00100000:2.0:1787857676.253506:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 401 00000100:00100000:2.0:1787857676.253519:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171548928:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857676.253891:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171548928:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 374us (665us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857676.253900:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 401 00010000:00010000:2.0:1787857677.038126:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787857677.307128:0:17403:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe9ed26c20 20000000:00000080:1.0:1787857677.307154:0:17403:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff99990122ac00 uarg=0000000000000000 00000040:00100000:0.0:1787857677.312594:0:17403:0:(llog.c:1072:llog_reverse_process()) index 44 : idx 1 20000000:01000000:0.0:1787857677.312611:0:17403:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 43 cmd:0xce020 lustre.test_11c 00000040:00080000:0.0:1787857677.313107:0:17403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off16008 20000000:01000000:0.0:1787857677.313134:0:17403:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:0.0:1787857677.313173:0:17403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 136 off16144 00000040:00080000:0.0:1787857677.313228:0:17403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].48, 224 off16608 00000040:00080000:0.0:1787857677.313508:0:17403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15280 20000000:01000000:0.0:1787857677.313519:0:17403:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:0.0:1787857677.313571:0:17403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 144 off15424 00000040:00080000:0.0:1787857677.313608:0:17403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15648 10000000:01000000:0.0:1787857677.313623:0:17403:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787857677.313643:0:17403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313662:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313678:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313685:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313692:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313699:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313705:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313711:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313720:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313728:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313736:0:17403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313744:0:17403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313797:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313850:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 12 pid: 5849 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.313868:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188188800:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857677.313989:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.313998:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 12 pid: 5851 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.314007:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188188928:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857677.314039:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.314050:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 12 pid: 5850 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.314058:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189056:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857677.314090:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.314099:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 18 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.314110:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189184:0@lo:104: 00000100:00100000:0.0:1787857677.314171:0:17403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857677.314239:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188189184 00000100:00100000:3.0:1787857677.314254:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188189184 00000100:00100000:3.0:1787857677.314331:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787857677.314344:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17403:x1874704188189184:12345-0@lo:104: 00010000:00010000:3.0:1787857677.314376:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.315368:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.315383:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 18 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.315394:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189312:0@lo:104: 00000100:00100000:0.0:1787857677.315438:0:17403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857677.315487:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.315496:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 18 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.315504:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189440:0@lo:104: 00000100:00100000:0.0:1787857677.315527:0:17403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857677.315553:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.315563:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 18 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.315571:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189568:0@lo:104: 00000100:00100000:1.0:1787857677.315651:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188189312 00000100:00100000:1.0:1787857677.315659:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188189312 00000100:00100000:1.0:1787857677.315698:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188189440 00000100:00100000:1.0:1787857677.315701:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188189440 00000100:00100000:1.0:1787857677.315715:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787857677.315723:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17403:x1874704188189312:12345-0@lo:104: 00010000:00010000:1.0:1787857677.315735:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.315857:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857677.315864:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17403:x1874704188189312:12345-0@lo:104: Request processed in 141us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.315871:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787857677.315892:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787857677.315900:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17403:x1874704188189440:12345-0@lo:104: 00010000:00010000:1.0:1787857677.315920:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.315987:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787857677.316000:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787857677.316008:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17403:x1874704188189440:12345-0@lo:104: Request processed in 109us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.316019:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787857677.316020:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17403:x1874704188189184:12345-0@lo:104: Request processed in 1657us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.316034:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1787857677.316040:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787857677.316048:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316056:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1787857677.316061:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316070:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.316074:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:1.0:1787857677.316078:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.316084:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857677.316088:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787857677.316122:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1787857677.316127:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316129:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316146:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857677.316147:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316172:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316180:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c2706800/0xd3f183cab4a7b12f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b136 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316202:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857677.316205:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316232:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1787857677.316236:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316244:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857677.316250:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857677.316255:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857677.316269:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316274:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857677.316289:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316296:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c2707c00/0xd3f183cab4a7b121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b128 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316305:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857677.316306:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857677.316308:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857677.316315:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857677.316343:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188189696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.316376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857677.316428:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188189824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.316453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857677.316494:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188189696 00000100:00100000:1.0:1787857677.316498:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188189696 00010000:00010000:1.0:1787857677.316517:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 19 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.316539:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188189824 00000100:00100000:1.0:1787857677.316542:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188189824 00010000:00010000:1.0:1787857677.316551:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 20 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.316569:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787857677.316575:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3303:x1874704188189696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857677.316586:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857677.316591:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 20 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316599:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 20 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316614:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857677.316639:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3303:x1874704188189696:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.316645:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787857677.316659:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787857677.316664:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188189824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857677.316679:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857677.316683:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 19 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316691:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 19 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.316700:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857677.316726:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188189824:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.316732:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787857677.316805:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188189824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.316861:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188189696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857677.317116:0:17403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857677.317160:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.317171:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 18 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.317193:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189952:0@lo:104: 00000100:00100000:0.0:1787857677.317216:0:17403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857677.317244:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.317252:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 18 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.317260:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901222580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188190080:0@lo:104: 00000100:00100000:0.0:1787857677.317283:0:17403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857677.317303:0:17403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.317310:0:17403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 18 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.317318:0:17403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012221c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188190208:0@lo:104: 00000100:00100000:0.0:1787857677.317340:0:17403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.317348:0:17403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857677.317367:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189184:0@lo:104: 00010000:00010000:0.0:1787857677.317376:0:17403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b12f expref: 18 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.317387:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189312:0@lo:104: 00010000:00010000:0.0:1787857677.317395:0:17403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc4400/0xd3f183cab4a7b128 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b121 expref: 17 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.317402:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189440:0@lo:104: 00000100:00100000:1.0:1787857677.318652:0:17346:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787857677.318677:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188189568 00000100:00100000:1.0:1787857677.318685:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188189568 00000100:00100000:1.0:1787857677.318723:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188189952 00000100:00100000:1.0:1787857677.318727:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188189952 00000100:00100000:1.0:1787857677.318737:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188190080 00000100:00100000:1.0:1787857677.318740:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188190080 00000100:00100000:1.0:1787857677.318750:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188190208 00000100:00100000:1.0:1787857677.318752:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188190208 00000100:00100000:1.0:1787857677.318766:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787857677.318774:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+6:17403:x1874704188189568:12345-0@lo:104: 00010000:00010000:1.0:1787857677.318790:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.318904:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857677.318922:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+6:17403:x1874704188189568:12345-0@lo:104: Request processed in 146us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.318933:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1787857677.318936:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857677.318951:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.318959:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1787857677.318971:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857677.318977:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.318987:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17403:x1874704188189952:12345-0@lo:104: 00010000:00010000:2.0:1787857677.319008:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.319012:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857677.319038:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857677.319067:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857677.319073:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857677.319081:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17403:x1874704188189952:12345-0@lo:104: Request processed in 98us (1863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.319089:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787857677.319109:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787857677.319117:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17403:x1874704188190080:12345-0@lo:104: 00010000:00010000:1.0:1787857677.319128:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.319136:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.319146:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857677.319164:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787857677.319170:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17403:x1874704188190080:12345-0@lo:104: Request processed in 56us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.319176:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787857677.319188:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787857677.319194:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990150cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17403:x1874704188190208:12345-0@lo:104: 00010000:00010000:1.0:1787857677.319203:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.319231:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787857677.319242:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990150cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17403:x1874704188190208:12345-0@lo:104: Request processed in 49us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.319248:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1787857677.319304:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787857677.319421:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188190336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.319453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787857677.319523:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857677.319536:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787857677.319575:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.319582:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857677.319598:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.319606:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c2c53400/0xd3f183cab4a7b13d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b144 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.319623:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787857677.319627:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.319633:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1787857677.319636:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.319706:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188190464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.319735:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857677.319777:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188190336 00000100:00100000:1.0:1787857677.319781:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188190336 00010000:00010000:1.0:1787857677.319801:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 17 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.319894:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188190464 00000100:00100000:1.0:1787857677.319898:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188190464 00010000:00010000:1.0:1787857677.319911:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 18 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.319927:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787857677.319934:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:3305:x1874704188190336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857677.319944:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857677.319949:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 18 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.320086:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 18 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.320109:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857677.320141:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:3305:x1874704188190336:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.320158:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787857677.320174:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787857677.320181:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:3302:x1874704188190464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857677.320188:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857677.320193:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 17 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.320201:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 17 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.320211:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc5200/0xd3f183cab4a7b144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b13d expref: 17 pid: 5851 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.320222:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857677.320250:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:3302:x1874704188190464:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.320256:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787857677.320294:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188190464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.320319:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188190336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857677.320415:0:17403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b11a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b113 expref: 15 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.320426:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189568:0@lo:104: 00000100:00100000:0.0:1787857677.320437:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189952:0@lo:104: 00000100:00100000:0.0:1787857677.320444:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901222580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188190080:0@lo:104: 00000100:00100000:0.0:1787857677.320452:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012221c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188190208:0@lo:104: 00010000:00010000:3.0:1787857677.320791:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857677.320800:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857677.320805:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787857677.320922:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.320929:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857677.320954:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.320962:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff999900ce7000/0xd3f183cab4a7b0f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b0fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.320976:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857677.320980:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.320986:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1787857677.320989:0:5844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.320996:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857677.321002:0:5844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857677.321014:0:5844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787857677.321030:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.321036:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857677.321105:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.321114:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188190592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857677.321117:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b11a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.321136:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857677.321138:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857677.321141:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857677.321168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.321277:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188190592 00000100:00100000:2.0:1787857677.321285:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188190592 00010000:00010000:2.0:1787857677.321317:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 15 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857677.321354:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787857677.321372:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:3303:x1874704188190592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857677.321385:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857677.321390:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 15 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.321401:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 15 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.321415:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c52c00/0xd3f183cab4a7b0fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b0f7 expref: 15 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.321436:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857677.321508:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:3303:x1874704188190592:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.321516:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00010000:3.0:1787857677.321632:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.321640:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b0e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b0f0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.321658:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857677.321660:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857677.321662:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857677.324692:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188190720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.324767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857677.324852:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188190720 00000100:00100000:1.0:1787857677.324859:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188190720 00010000:00010000:1.0:1787857677.324895:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 14 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.324926:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787857677.324951:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:3304:x1874704188190720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857677.325091:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857677.325099:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 14 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.325110:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 14 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.325128:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc5600/0xd3f183cab4a7b0f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b0e9 expref: 14 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.325145:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857677.325183:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:3304:x1874704188190720:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.325191:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787857677.325240:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188190720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857677.325357:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188190592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857677.327143:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857677.327154:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857677.327171:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857677.327194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857677.327233:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857677.327335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857677.327396:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188188800:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857677.327409:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188188928:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857677.327416:0:17403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17403:1874704188189056:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857677.327487:0:17403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857677.329014:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171549056 00000100:00100000:3.0:1787857677.329030:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171549056 00010000:00010000:3.0:1787857677.329092:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 13 pid: 5849 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857677.329150:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171549312 00000100:00100000:3.0:1787857677.329153:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171549312 00010000:00010000:3.0:1787857677.329168:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 14 pid: 5850 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.329203:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:3.0:1787857677.329215:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 219 00000100:00100000:0.0:1787857677.329227:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:2349:x1874704171549056:12345-192.168.204.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787857677.329232:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:2349:x1874704171549312:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857677.329250:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857677.329262:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 14 pid: 5849 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.329280:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857677.329281:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 14 pid: 5849 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.329323:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc4000/0xd3f183cab4a7b159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3449 expref: 14 pid: 5849 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.329339:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857677.329401:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171549056:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 187us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.329409:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 218 00010000:00010000:3.0:1787857677.331498:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 12 pid: 5850 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.331525:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 12 pid: 5850 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.331552:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b14b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd343b expref: 12 pid: 5850 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.331574:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857677.331648:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:2349:x1874704171549312:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2423us (4416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.331692:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171549184 00000100:00100000:0.0:1787857677.331706:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171549184 00010000:00010000:1.0:1787857677.331893:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.331908:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1787857677.331914:0:7647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.331924:0:7647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857677.331951:0:7647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857677.331957:0:7647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857677.332013:0:7647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.332019:0:7647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857677.332042:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.332049:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff999900ce6400/0xd3f183cab4a7b105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b10c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.332064:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857677.332066:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857677.332067:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857677.332449:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 219 00010000:00010000:0.0:1787857677.335206:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 11 pid: 5851 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.335271:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00100000:0.0:1787857677.335289:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:2349:x1874704171549184:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857677.335308:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857677.335316:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 11 pid: 5851 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.335330:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 11 pid: 5851 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.335351:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999900ce6e00/0xd3f183cab4a7b152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3442 expref: 11 pid: 5851 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.335366:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857677.335432:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a844d87e-58d2-455f-ad2c-5bf80fe2767e+10:2349:x1874704171549184:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 152us (8096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.335467:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00100000:1.0:1787857677.335784:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188190848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.336273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.336363:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188190848 00000100:00100000:0.0:1787857677.336371:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188190848 00010000:00010000:0.0:1787857677.336397:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 13 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.336425:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787857677.336432:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:3305:x1874704188190848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857677.336441:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857677.336445:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 13 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336454:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 13 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336479:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c52400/0xd3f183cab4a7b10c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b105 expref: 13 pid: 5850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336491:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336499:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336515:0:17347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336522:0:17347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336541:0:17347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336548:0:17347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336554:0:17347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857677.336558:0:17347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336566:0:17347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336581:0:17347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336665:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857677.336695:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:3305:x1874704188190848:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.336702:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00010000:0.0:1787857677.336729:0:17403:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336737:0:17403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.336744:0:17403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b160 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857677.337722:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188190848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857677.409805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857677.409989:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171549440 00000100:00100000:0.0:1787857677.410013:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171549440 00000100:00100000:0.0:1787857677.410067:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00100000:0.0:1787857677.410076:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+10:5605:x1874704171549440:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857677.410096:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857677.410119:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3450 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.410153:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.410165:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.410175:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4e00, rc 0) 00000100:00100000:0.0:1787857677.410253:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171549440:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 177us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.410260:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00100000:0.0:1787857677.417398:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857677.417497:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171549568 00000100:00100000:3.0:1787857677.417507:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171549568 00000100:00100000:3.0:1787857677.417604:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:3.0:1787857677.417615:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171549568:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857677.418099:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171549568:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 484us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.418109:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:3.0:1787857677.425156:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857677.425309:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171549696 00000100:00100000:2.0:1787857677.425320:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171549696 00000100:00100000:2.0:1787857677.425380:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 404 00000100:00100000:2.0:1787857677.425390:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171549696:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.425657:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171549696:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 267us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.425666:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 404 00000100:00100000:1.0:1787857677.432735:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857677.436324:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171549824 00000100:00100000:3.0:1787857677.436345:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171549824 00000100:00100000:3.0:1787857677.436415:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 405 00000100:00100000:3.0:1787857677.436426:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22514:x1874704171549824:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787857677.436765:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22514:x1874704171549824:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 329us (4029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.436783:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 405 00000100:00100000:1.0:1787857677.439709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857677.439812:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171549952 00000100:00100000:0.0:1787857677.439863:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171549952 00000100:00100000:0.0:1787857677.439920:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 406 00000100:00100000:0.0:1787857677.439929:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22514:x1874704171549952:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857677.440292:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22514:x1874704171549952:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 363us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.440301:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 406 00000100:00100000:0.0:1787857677.442812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857677.443250:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171550080 00000100:00100000:2.0:1787857677.443260:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171550080 00000100:00100000:2.0:1787857677.443317:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 407 00000100:00100000:2.0:1787857677.443329:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22514:x1874704171550080:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857677.443580:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:22514:x1874704171550080:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 253us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.443588:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 407 00000100:00100000:1.0:1787857677.450356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857677.450445:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171550208 00000100:00100000:3.0:1787857677.450464:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171550208 00000100:00100000:3.0:1787857677.450520:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:3.0:1787857677.450529:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171550208:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857677.450548:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857677.450564:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3457 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.450600:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.450611:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.450621:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7c00, rc 0) 00000100:00100000:3.0:1787857677.450679:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171550208:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 151us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.450687:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:1.0:1787857677.454426:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857677.454538:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171550336 00000100:00100000:0.0:1787857677.454561:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171550336 00000100:00100000:0.0:1787857677.454625:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:0.0:1787857677.454636:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171550336:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.455717:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171550336:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 944us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.455728:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:0.0:1787857677.469218:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857677.469375:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171550464 00000100:00100000:2.0:1787857677.469386:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171550464 00000100:00100000:2.0:1787857677.469446:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 410 00000100:00100000:2.0:1787857677.469467:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171550464:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.469720:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171550464:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 265us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.469737:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 410 00000100:00100000:1.0:1787857677.474259:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857677.474805:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171550592 00000100:00100000:0.0:1787857677.474994:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171550592 00000100:00100000:0.0:1787857677.475054:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 411 00000100:00100000:0.0:1787857677.475065:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22515:x1874704171550592:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857677.475518:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22515:x1874704171550592:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 453us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.475527:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 411 00000100:00100000:1.0:1787857677.486218:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857677.486349:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171550720 00000100:00100000:3.0:1787857677.486360:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171550720 00000100:00100000:3.0:1787857677.486419:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 412 00000100:00100000:3.0:1787857677.486430:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22515:x1874704171550720:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787857677.486692:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22515:x1874704171550720:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 263us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.486701:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 412 00000100:00100000:1.0:1787857677.490216:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857677.490812:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171550848 00000100:00100000:2.0:1787857677.491324:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171550848 00000100:00100000:2.0:1787857677.491396:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:2.0:1787857677.491405:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22515:x1874704171550848:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857677.491669:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:22515:x1874704171550848:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 264us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.491678:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:2.0:1787857677.497614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857677.497782:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171550976 00000100:00100000:1.0:1787857677.497808:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171550976 00000100:00100000:1.0:1787857677.497908:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 414 00000100:00100000:1.0:1787857677.497918:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171550976:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857677.497935:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857677.497954:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd345e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.497996:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.498008:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.498017:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94000, rc 0) 00000100:00100000:1.0:1787857677.498075:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171550976:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 158us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.498082:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 414 00000100:00100000:1.0:1787857677.501142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857677.501235:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171551104 00000100:00100000:3.0:1787857677.501244:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171551104 00000100:00100000:3.0:1787857677.501302:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 415 00000100:00100000:3.0:1787857677.501311:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171551104:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.504424:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171551104:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 3102us (3282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857677.504440:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 415 10000000:01000000:2.0:1787857677.608345:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787857677.608374:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9997c18ad800 from 45 10000000:01000000:2.0:1787857677.608380:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787857677.608430:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.608442:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.608464:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857677.608490:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188190976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.608562:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.608638:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857677.609127:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188190976 00000100:00100000:3.0:1787857677.609135:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188190976 00000100:00100000:3.0:1787857677.609208:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1787857677.609220:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:5853:x1874704188190976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857677.609235:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857677.609249:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b17c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.609276:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.609287:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.609298:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7000, rc 0) 00000100:00100000:3.0:1787857677.609349:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188190976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.609357:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1787857677.609603:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188190976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857677.609620:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.609628:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857677.609692:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188191104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.609723:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.609761:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857677.609894:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188191104 00000100:00100000:0.0:1787857677.609900:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188191104 00000100:00100000:0.0:1787857677.609936:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1787857677.609943:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188191104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.610244:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188191104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.610251:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1787857677.610626:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188191104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.610662:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188191232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.610704:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.610789:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857677.616129:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188191232 00000100:00100000:1.0:1787857677.616147:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188191232 00000100:00100000:1.0:1787857677.616218:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1787857677.616228:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188191232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857677.616496:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188191232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (5791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.616504:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1787857677.617166:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188191232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857677.630665:0:17405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17405:1874704188191360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857677.630970:0:17405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857677.631033:0:17405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857677.631942:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188191360 00000100:00100000:1.0:1787857677.631952:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188191360 00000100:00100000:1.0:1787857677.632027:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1787857677.632051:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17405:x1874704188191360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857677.632377:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17405:x1874704188191360:12345-0@lo:502:llog_process_th.0 Request processed in 328us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.632386:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1787857677.632812:0:17405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17405:1874704188191360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857677.632944:0:17405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17405:1874704188191488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857677.632999:0:17405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857677.633045:0:17405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.633289:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188191488 00000100:00100000:2.0:1787857677.633295:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188191488 00000100:00100000:2.0:1787857677.633335:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1787857677.633344:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17405:x1874704188191488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.633522:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17405:x1874704188191488:12345-0@lo:502:llog_process_th.0 Request processed in 179us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.633531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1787857677.633685:0:17405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17405:1874704188191488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.633721:0:17405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17405:1874704188191616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.633763:0:17405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.633790:0:17405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857677.634098:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188191616 00000100:00100000:1.0:1787857677.634102:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188191616 00000100:00100000:1.0:1787857677.634137:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1787857677.634143:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17405:x1874704188191616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857677.634274:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17405:x1874704188191616:12345-0@lo:502:llog_process_th.0 Request processed in 131us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.634281:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787857677.634515:0:17405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17405:1874704188191616:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787857677.634542:0:17405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000020:01000000:2.0:1787857677.634721:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:2.0:1787857677.634744:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787857677.634766:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.634785:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857677.634795:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787857677.634798:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1787857677.634801:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787857677.634872:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.634880:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.634890:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857677.634907:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188191744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.634945:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.634979:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857677.635312:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188191744 00000100:00100000:3.0:1787857677.635318:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188191744 00000100:00100000:3.0:1787857677.635354:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1787857677.635361:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188191744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857677.635371:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857677.635383:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b18a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.635404:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.635414:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.635423:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7200, rc 0) 00000100:00100000:3.0:1787857677.635475:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188191744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.635482:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1787857677.635555:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188191744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857677.635571:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.635593:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.635647:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188191872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.635678:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.635702:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.635797:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188191872 00000100:00100000:2.0:1787857677.635802:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188191872 00000100:00100000:2.0:1787857677.635861:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787857677.635869:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188191872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.636126:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188191872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.636134:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1787857677.636533:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188191872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.636564:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.636618:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.636646:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857677.637029:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188192000 00000100:00100000:1.0:1787857677.637035:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188192000 00000100:00100000:1.0:1787857677.637075:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1787857677.637083:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188192000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857677.637270:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188192000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.637280:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1787857677.637756:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787857677.640758:0:17406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:1.0:1787857677.641515:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1787857677.641548:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787857677.641560:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.641584:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857677.641597:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787857677.641616:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9998dba2e800 from 45 10000000:01000000:1.0:1787857677.641620:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787857677.641661:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.641670:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.641682:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.641708:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857677.641786:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857677.642066:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2469600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.642197:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188192128 00000100:00100000:2.0:1787857677.642211:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188192128 00000100:00100000:2.0:1787857677.642262:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1787857677.642272:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188192128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857677.642285:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857677.642297:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b198 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.642320:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.642331:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.642339:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53a00, rc 0) 00000100:00100000:2.0:1787857677.642388:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188192128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.642394:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1787857677.642569:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857677.642595:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.642603:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.642659:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857677.642686:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857677.642707:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2469600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.642967:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188192256 00000100:00100000:2.0:1787857677.642972:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188192256 00000100:00100000:2.0:1787857677.643003:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1787857677.643010:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188192256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.643418:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188192256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.643425:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1787857677.648890:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.648971:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.649070:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.649441:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857677.650675:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188192384 00000100:00100000:3.0:1787857677.650688:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188192384 00000100:00100000:3.0:1787857677.651398:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1787857677.651417:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188192384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857677.651766:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188192384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 356us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.651774:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1787857677.652302:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.656500:0:17407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17407:1874704188192512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.657257:0:17407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.657341:0:17407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857677.657419:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188192512 00000100:00100000:0.0:1787857677.657435:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188192512 00000100:00100000:0.0:1787857677.657538:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1787857677.657548:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17407:x1874704188192512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.657967:0:17407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17407:1874704188192512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.658032:0:17407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17407:1874704188192640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.658104:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17407:x1874704188192512:12345-0@lo:502:llog_process_th.0 Request processed in 556us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.658112:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1787857677.658513:0:17407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.658598:0:17407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857677.658684:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188192640 00000100:00100000:0.0:1787857677.658691:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188192640 00000100:00100000:0.0:1787857677.658726:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1787857677.658734:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17407:x1874704188192640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.659421:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17407:x1874704188192640:12345-0@lo:502:llog_process_th.0 Request processed in 685us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.659429:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1787857677.659527:0:17407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17407:1874704188192640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.659589:0:17407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17407:1874704188192768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.659628:0:17407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.659657:0:17407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857677.659765:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188192768 00000100:00100000:0.0:1787857677.659770:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188192768 00000100:00100000:0.0:1787857677.659795:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1787857677.659802:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17407:x1874704188192768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.660421:0:17407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17407:1874704188192768:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787857677.660449:0:17407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000100:00100000:0.0:1787857677.660682:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17407:x1874704188192768:12345-0@lo:502:llog_process_th.0 Request processed in 879us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.660692:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000020:01000000:0.0:1787857677.660729:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:0.0:1787857677.660767:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857677.660778:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.660788:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857677.660812:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787857677.660999:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1787857677.661002:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787857677.661036:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.661044:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.661054:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.661072:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.661109:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.661144:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.661238:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188192896 00000100:00100000:2.0:1787857677.661244:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188192896 00000100:00100000:2.0:1787857677.661275:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1787857677.661282:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188192896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857677.661293:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857677.661306:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b1a6 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.661340:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.661352:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.661362:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:2.0:1787857677.661393:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188192896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.661409:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1787857677.661538:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188192896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857677.661552:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.661562:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.661676:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.661705:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.661725:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857677.661791:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188193024 00000100:00100000:1.0:1787857677.661796:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188193024 00000100:00100000:1.0:1787857677.661949:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1787857677.661958:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188193024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857677.662267:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188193024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.662281:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1787857677.662441:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.662484:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.662529:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.662550:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.662704:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188193152 00000100:00100000:2.0:1787857677.662710:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188193152 00000100:00100000:2.0:1787857677.662731:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1787857677.662737:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188193152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.663054:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188193152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.663060:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1787857677.663143:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787857677.666219:0:17408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:1.0:1787857677.666508:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787857677.666535:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787857677.666546:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.666559:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857677.666572:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787857677.666575:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9998dbb32800 from 45 10000000:01000000:1.0:1787857677.667285:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787857677.667412:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.667422:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857677.667433:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857677.667472:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857677.668072:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857677.668169:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb7f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.668368:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188193280 00000100:00100000:2.0:1787857677.668377:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188193280 00000100:00100000:2.0:1787857677.668485:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1787857677.668495:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188193280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857677.668511:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857677.668525:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b1b4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.668550:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.668562:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.668571:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52e00, rc 0) 00000100:00100000:2.0:1787857677.668633:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188193280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.668640:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1787857677.668723:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857677.668737:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.668754:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.668854:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.668881:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.669171:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857677.669273:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188193408 00000100:00100000:1.0:1787857677.669277:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188193408 00000100:00100000:1.0:1787857677.669300:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1787857677.669306:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188193408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857677.669707:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188193408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.669722:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1787857677.670098:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.670137:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.670647:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.670724:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857677.671015:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188193536 00000100:00100000:1.0:1787857677.671022:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188193536 00000100:00100000:1.0:1787857677.671099:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1787857677.671108:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188193536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857677.671443:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188193536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 336us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.671459:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1787857677.671537:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188193536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.672220:0:17409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17409:1874704188193664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.672269:0:17409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.672311:0:17409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857677.672421:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188193664 00000100:00100000:3.0:1787857677.672434:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188193664 00000100:00100000:3.0:1787857677.672480:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1787857677.672489:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17409:x1874704188193664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857677.672729:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17409:x1874704188193664:12345-0@lo:502:llog_process_th.0 Request processed in 241us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.672736:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1787857677.673014:0:17409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17409:1874704188193664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.673065:0:17409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17409:1874704188193792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.673109:0:17409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.673141:0:17409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.673293:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188193792 00000100:00100000:2.0:1787857677.673298:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188193792 00000100:00100000:2.0:1787857677.673324:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1787857677.673332:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17409:x1874704188193792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.673472:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17409:x1874704188193792:12345-0@lo:502:llog_process_th.0 Request processed in 141us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.673478:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1787857677.673605:0:17409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17409:1874704188193792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.673641:0:17409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17409:1874704188193920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.673674:0:17409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.673695:0:17409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.674101:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188193920 00000100:00100000:2.0:1787857677.674106:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188193920 00000100:00100000:2.0:1787857677.674140:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1787857677.674146:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17409:x1874704188193920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.674283:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17409:x1874704188193920:12345-0@lo:502:llog_process_th.0 Request processed in 137us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.674289:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1787857677.674474:0:17409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17409:1874704188193920:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787857677.674497:0:17409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000020:01000000:3.0:1787857677.674670:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:3.0:1787857677.674692:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857677.674703:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.674714:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857677.674724:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787857677.674726:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 40 10000000:01000000:3.0:1787857677.674729:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787857677.674762:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.674771:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.674780:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857677.674795:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188194048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857677.675273:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857677.675304:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.675690:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188194048 00000100:00100000:2.0:1787857677.675696:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188194048 00000100:00100000:3.0:1787857677.675797:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1787857677.675804:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188194048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857677.675943:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857677.675960:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b1c2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.675983:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.675995:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.676004:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00100000:3.0:1787857677.676047:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188194048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857677.676053:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1787857677.676224:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188194048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857677.676239:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.676249:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857677.676306:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188194176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.676336:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.676359:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.676423:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188194176 00000100:00100000:2.0:1787857677.676427:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188194176 00000100:00100000:2.0:1787857677.676460:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1787857677.676468:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188194176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.676947:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188194176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 479us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.676955:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1787857677.677099:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188194176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.677133:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188194304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.677326:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.677355:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.677396:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188194304 00000100:00100000:2.0:1787857677.677401:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188194304 00000100:00100000:2.0:1787857677.677483:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1787857677.677491:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188194304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857677.677667:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188194304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.677673:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1787857677.678242:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188194304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.678445:0:17410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17410:1874704188194432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.678505:0:17410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.678528:0:17410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857677.678780:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188194688:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.678810:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.678872:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787857677.678878:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188194560:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.678901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.678916:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188195072:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.678940:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.678965:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188194816:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.678988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.679008:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857677.679013:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188194944:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857677.679073:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188194688 00000100:00100000:2.0:1787857677.679078:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188194688 00000100:00100000:2.0:1787857677.679122:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188194560 00000100:00100000:2.0:1787857677.679125:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188194560 00000100:00100000:2.0:1787857677.679139:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188194944 00000100:00100000:2.0:1787857677.679141:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188194944 00000100:00100000:2.0:1787857677.679170:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787857677.679176:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188194688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679219:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188194688:12345-0@lo:400:kworker.0 Request processed in 42us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.679225:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787857677.679251:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787857677.679257:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188194560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679284:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188194560:12345-0@lo:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.679290:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787857677.679301:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787857677.679307:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188194944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679335:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188194944:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.679341:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787857677.679359:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188195072 00000100:00100000:2.0:1787857677.679363:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188195072 00000100:00100000:2.0:1787857677.679387:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188194816 00000100:00100000:2.0:1787857677.679390:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188194816 00000100:00100000:2.0:1787857677.679404:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787857677.679410:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188195072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679439:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188195072:12345-0@lo:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.679445:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787857677.679466:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787857677.679473:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188194816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679497:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188194816:12345-0@lo:400:kworker.0 Request processed in 25us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.679502:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787857677.679535:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188194944:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679544:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188194816:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679591:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188194560:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679600:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188195072:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679607:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188194688:0@lo:400:kworker.0 00000100:00100000:2.0:1787857677.679628:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188194432 00000100:00100000:2.0:1787857677.679631:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188194432 00000100:00100000:2.0:1787857677.679651:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1787857677.679656:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17410:x1874704188194432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857677.679904:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17410:x1874704188194432:12345-0@lo:502:llog_process_th.0 Request processed in 246us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857677.679911:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1787857677.680412:0:17410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17410:1874704188194432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857677.680447:0:17410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857677.680472:0:17410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857677.680474:0:17410:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:0.0:1787857677.680481:0:17410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1787857677.680497:0:17410:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to test_11c as member 1 00000100:00100000:0.0:1787857677.681807:0:17410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17410:1874704188195200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857677.682030:0:17410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857677.682074:0:17410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5ff00 going to sleep for 11 seconds 00000020:01000004:2.0:1787857677.682376:0:17411:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9998dbb32800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787857677.682381:0:17411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9998dbb32800 4 00000100:00100000:1.0:1787857677.682676:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188195200 00000100:00100000:1.0:1787857677.682684:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188195200 00000100:00100000:1.0:1787857677.682733:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1787857677.682743:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17410:x1874704188195200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857677.683596:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17410:x1874704188195200:12345-0@lo:502:llog_process_th.0 Request processed in 853us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857677.683604:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00080000:3.0:1787857677.683797:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857677.683804:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857677.684376:0:17410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17410:1874704188195200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857677.684412:0:17410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857677.684419:0:17410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857677.684422:0:17410:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:0.0:1787857677.684428:0:17410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787857677.684651:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 40-42 (rc=0) 10000000:01000000:2.0:1787857677.684674:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787857677.684686:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.684698:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857677.684709:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787857677.684711:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9998c56d8000 from 1 10000000:01000000:2.0:1787857677.684714:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787857677.684810:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.685032:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857677.685054:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857677.685233:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188195328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857677.685291:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857677.685368:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857677.685413:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188195328 00000100:00100000:0.0:1787857677.685419:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188195328 00000100:00100000:0.0:1787857677.685508:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1787857677.685518:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188195328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857677.685530:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857677.685544:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b1d0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.685567:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.685651:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857677.685668:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857677.685764:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188195328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857677.685771:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1787857677.686064:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188195328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857677.686080:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.686090:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857677.686213:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188195456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857677.686241:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857677.686309:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857677.686360:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188195456 00000100:00100000:0.0:1787857677.686365:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188195456 00000100:00100000:0.0:1787857677.686433:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1787857677.686441:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188195456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857677.686711:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188195456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (467us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857677.686718:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1787857677.686785:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188195456:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787857677.686806:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787857677.686813:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857677.686856:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.062408:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857678.190035:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857678.190059:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188195584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857678.190167:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857678.190634:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188195584 00000100:00100000:3.0:1787857678.190645:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188195584 00000100:00100000:3.0:1787857678.190710:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787857678.190721:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ef914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188195584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857678.190777:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857678.190876:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ef914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188195584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857678.190885:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787857678.191505:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188195584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857678.459335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857678.459374:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857678.459482:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171551488 00000100:00100000:1.0:1787857678.459491:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171551488 00000100:00100000:1.0:1787857678.459557:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171551232 00000100:00100000:1.0:1787857678.459560:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171551232 00000100:00100000:1.0:1787857678.459590:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 731 00000100:00100000:1.0:1787857678.459601:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:22526:x1874704171551488:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:1.0:1787857678.459669:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857678.459701:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1e00/0xd3f183cab4a7add9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3338 expref: 74 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.459723:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:1.0:1787857678.459729:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857678.460195:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.460213:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.460223:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.460258:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 30 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.460276:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 30 pid: 7656 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857678.460299:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188195712:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857678.460404:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5383f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857678.460429:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 732 00000100:00100000:1.0:1787857678.460450:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+73:2350:x1874704171551232:12345-192.168.204.36@tcp:41:mkdir.0 00000004:00000024:1.0:1787857678.460481:0:7656:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 2259812352 avail 2257715200 00000100:00100000:1.0:1787857678.460525:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+73:2350:x1874704171551232:12345-192.168.204.36@tcp:41:mkdir.0 Request processed in 89us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857678.460539:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 732 00000100:00080000:0.0:1787857678.460660:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857678.469860:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857678.469934:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171551616 00000100:00100000:3.0:1787857678.469944:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171551616 00010000:00010000:3.0:1787857678.470009:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 31 pid: 7656 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857678.470047:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 222 00000100:00100000:3.0:1787857678.470058:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2348:x1874704171551616:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857678.470085:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857678.470093:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 31 pid: 7656 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470107:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 31 pid: 7656 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470132:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:3.0:1787857678.470148:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470160:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470168:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470189:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857678.470250:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2348:x1874704171551616:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 194us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857678.470259:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 222 00010000:00010000:3.0:1787857678.470404:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ae18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd334d expref: 30 pid: 7656 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857678.470420:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188195712:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857678.470462:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470473:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470487:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470508:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470520:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.470528:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787857678.471785:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787857678.473118:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00010000:00010000:3.0:1787857678.473654:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.473669:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.473677:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.473684:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857678.473688:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.473697:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.473716:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:3.0:1787857678.473719:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857678.473895:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.473903:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94200/0xd3f183cab4a7b1de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857678.473925:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8dc1617 reply state 00000000d9944f93 transno 4294967777 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857678.473934:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857678.474321:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:22526:x1874704171551488:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 14717us (14990us total) trans 4294967777 rc 0/0 00000100:00100000:3.0:1787857678.474330:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 731 00010000:00010000:2.0:1787857678.486381:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.486400:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.486407:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.486413:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857678.486417:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.486426:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.486458:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff9998d1291800) 00010000:00010000:2.0:1787857678.486462:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857678.486467:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.486474:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b1e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857678.512057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857678.512100:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171551744 00000100:00100000:3.0:1787857678.512110:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171551744 00000100:00100000:3.0:1787857678.512160:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 733 00000100:00100000:3.0:1787857678.512171:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+73:22527:x1874704171551744:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857678.512195:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857678.512219:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b1ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3465 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.512284:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b1f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.512298:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.512310:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857678.512386:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857678.512389:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857678.512409:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.512431:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b1ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3465 expref: 75 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.513649:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3465 expref: 74 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.513659:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291700) 00010000:00010000:3.0:1787857678.513662:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857678.513666:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:3.0:1787857678.513725:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+74:22527:x1874704171551744:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1556us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857678.513734:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 733 00000100:00100000:1.0:1787857678.525992:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857678.527348:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171551872 00000100:00100000:2.0:1787857678.527361:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171551872 00000100:00100000:2.0:1787857678.527461:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 734 00000100:00100000:2.0:1787857678.527474:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+74:22527:x1874704171551872:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857678.527499:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857678.527523:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b1fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd346c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527605:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527623:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527638:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527660:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527669:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527678:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527849:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b20f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527858:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527866:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857678.527924:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000004:00200000:2.0:1787857678.527928:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857678.527953:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527967:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527975:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527983:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.527990:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857678.527995:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528003:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528016:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291700) 00010000:00010000:2.0:1787857678.528020:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857678.528025:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528033:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528047:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528064:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528070:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528089:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857678.528092:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528098:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528108:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff9998e18d9f00) 00010000:00010000:2.0:1787857678.528111:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857678.528114:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528121:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b208 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528159:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b1fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd346c expref: 76 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528174:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b20f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd346c expref: 75 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.528182:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9998e18d9000) 00010000:00010000:2.0:1787857678.528185:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857678.528193:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52c00, rc 0) 00000100:00100000:2.0:1787857678.528276:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:22527:x1874704171551872:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 804us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857678.528285:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 734 00000100:00100000:1.0:1787857678.536561:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857678.536649:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171552128 00000100:00100000:3.0:1787857678.536661:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171552128 00000100:00100000:3.0:1787857678.536733:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 735 00000100:00100000:3.0:1787857678.536752:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+75:22527:x1874704171552128:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857678.536774:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857678.536796:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7b216 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3473 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857678.536968:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00010000:00010000:3.0:1787857678.537114:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7b216 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3473 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.537426:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291700) 00010000:00010000:3.0:1787857678.537430:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857678.537446:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7b216 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3473 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.537460:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6c00, rc 0) 00000100:00100000:3.0:1787857678.537565:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+76:22527:x1874704171552128:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 815us (1014us total) trans 4294967778 rc 301/301 00000100:00100000:3.0:1787857678.537573:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 735 00000100:00100000:3.0:1787857678.544432:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857678.544625:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171552384 00000100:00100000:1.0:1787857678.544637:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171552384 00000100:00100000:1.0:1787857678.544708:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 736 00000100:00100000:1.0:1787857678.544719:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+76:22527:x1874704171552384:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:1.0:1787857678.544794:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857678.544869:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b20f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd346c expref: 76 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.544895:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9998e18d9000) 00010000:00010000:1.0:1787857678.544911:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857678.545042:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857678.545057:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857678.545068:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857678.545459:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf9e21fd reply state 00000000f63ff538 transno 4294967779 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857678.545470:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787857678.545484:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000100:00100000:0.0:1787857678.545889:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+77:22527:x1874704171552384:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 1170us (1466us total) trans 4294967779 rc 0/0 00000100:00100000:0.0:1787857678.545898:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 736 00010000:00010000:1.0:1787857678.548287:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857678.548529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857678.548707:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171552640 00000100:00100000:0.0:1787857678.548718:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171552640 00000100:00100000:0.0:1787857678.548782:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 151 00000100:00100000:0.0:1787857678.548792:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+77:22527:x1874704171552640:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1787857678.549120:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+78:22527:x1874704171552640:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 328us (593us total) trans 4294967780 rc 0/0 00000100:00100000:0.0:1787857678.549128:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 151 00010000:00010000:1.0:1787857678.549378:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.549388:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.549395:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857678.549400:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.549408:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.549455:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9998d5316900) 00010000:00010000:1.0:1787857678.549458:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857678.549463:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.549470:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b224 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857678.939098:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857678.939248:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171552896 00000100:00100000:1.0:1787857678.939258:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171552896 00000100:00100000:1.0:1787857678.939326:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 737 00000100:00100000:1.0:1787857678.939336:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+77:22564:x1874704171552896:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:1.0:1787857678.939403:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857678.939444:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b1f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3465 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857678.939470:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291700) 00010000:00010000:1.0:1787857678.939480:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857678.939674:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+76:22564:x1874704171552896:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 339us (589us total) trans 0 rc -17/-17 00000100:00100000:1.0:1787857678.939682:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 737 00000100:00100000:3.0:1787857678.941986:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857678.942077:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171553024 00000100:00100000:2.0:1787857678.942087:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171553024 00000100:00100000:2.0:1787857678.942168:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 738 00000100:00100000:2.0:1787857678.942180:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+76:22564:x1874704171553024:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:2.0:1787857678.942201:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857678.942227:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b22b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd347a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.942315:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.942331:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.942344:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857678.942420:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857678.942435:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857678.942466:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.942490:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b22b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd347a expref: 78 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.942506:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd347a expref: 77 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857678.942529:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9f00) 00010000:00010000:2.0:1787857678.942533:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857678.942536:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52200, rc 0) 00000100:00100000:2.0:1787857678.942601:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+77:22564:x1874704171553024:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 424us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857678.942609:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 738 00000100:00100000:1.0:1787857678.945897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857678.946691:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171553152 00000100:00100000:3.0:1787857678.946703:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171553152 00000100:00100000:3.0:1787857678.946767:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 739 00000100:00100000:3.0:1787857678.946777:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+77:22564:x1874704171553152:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:3.0:1787857678.946796:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857678.946851:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7b239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3481 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.946918:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.946933:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.946944:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.946976:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.946984:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.946990:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947110:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b24e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947119:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947126:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857678.947166:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000004:00200000:3.0:1787857678.947171:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857678.947194:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947206:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947212:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947219:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947235:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857678.947239:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947248:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947262:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9f00) 00010000:00010000:3.0:1787857678.947265:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857678.947269:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947276:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947290:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947296:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947611:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947619:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857678.947622:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947629:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947651:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff9998d1291000) 00010000:00010000:3.0:1787857678.947653:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857678.947656:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947661:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947696:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7b239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3481 expref: 79 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947709:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b24e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3481 expref: 78 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857678.947716:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9998d1291d00) 00010000:00010000:3.0:1787857678.947718:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857678.947720:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:3.0:1787857678.949005:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+78:22564:x1874704171553152:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 2218us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857678.949017:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 739 00000100:00100000:0.0:1787857679.033764:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857679.034341:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171553280 00000100:00100000:2.0:1787857679.034351:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171553280 00000100:00100000:2.0:1787857679.034416:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 740 00000100:00100000:2.0:1787857679.034436:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+30:22570:x1874704171553280:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857679.034458:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857679.034479:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3488 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.034579:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.034594:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.034630:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857679.034753:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857679.034757:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857679.034787:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.034861:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.034882:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 31 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.034890:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9f00) 00010000:00010000:2.0:1787857679.034893:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857679.034897:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52a00, rc 0) 00000100:00100000:2.0:1787857679.034972:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:22570:x1874704171553280:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 548us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857679.034979:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 740 00000100:00100000:0.0:1787857679.047139:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857679.047314:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171553536 00000100:00100000:1.0:1787857679.047324:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171553536 00000100:00100000:1.0:1787857679.047451:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 741 00000100:00100000:1.0:1787857679.047463:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+78:22570:x1874704171553536:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857679.047487:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857679.047506:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787857679.047548:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b24e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3481 expref: 78 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.047574:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9998d1291d00) 00010000:00010000:1.0:1787857679.047586:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857679.047601:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b263 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd348f expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.047751:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.047764:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.047775:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.047788:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.047795:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.047802:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048650:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048663:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048684:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857679.048694:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00010000:00010000:1.0:1787857679.048721:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048728:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048735:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048740:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857679.048744:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048752:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048761:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857679.048764:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857679.048768:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048775:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95200/0xd3f183cab4a7b26a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857679.048786:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009db6c25 reply state 0000000065e444f5 transno 4294967781 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857679.048805:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857679.048853:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b263 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 80 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048869:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 79 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.048877:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9998c3984300) 00010000:00010000:1.0:1787857679.048879:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857679.048882:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94400, rc 0) 00000100:00100000:1.0:1787857679.049612:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+80:22570:x1874704171553536:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2148us (2537us total) trans 4294967781 rc 0/0 00000100:00100000:1.0:1787857679.049633:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 741 00010000:00010000:2.0:1787857679.055517:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.056340:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.056351:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.056357:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857679.056362:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.056370:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.056388:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0xecadbcfe (ffff9998c3984600) 00010000:00010000:2.0:1787857679.056409:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857679.056415:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.056422:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95600/0xd3f183cab4a7b271 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857679.057649:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857679.057879:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171553792 00000100:00100000:2.0:1787857679.057889:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171553792 00000100:00100000:2.0:1787857679.057949:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 742 00000100:00100000:2.0:1787857679.057960:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+79:22570:x1874704171553792:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857679.057986:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857679.058009:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b286 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3496 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.058130:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.058144:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 80 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.058152:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.058529:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 80 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.058546:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 80 pid: 7656 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857679.058755:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188195840:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857679.059301:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf600 going to sleep for 11 seconds 00000100:00100000:1.0:1787857679.074766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857679.075033:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171553920 00000100:00100000:0.0:1787857679.075043:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171553920 00010000:00010000:0.0:1787857679.075095:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 81 pid: 7656 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857679.075139:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 223 00000100:00100000:0.0:1787857679.075149:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+81:2350:x1874704171553920:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857679.075173:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857679.075181:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 81 pid: 7656 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857679.075196:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 81 pid: 7656 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857679.075244:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9998c3984300) 00010000:00010000:0.0:1787857679.075250:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857679.075260:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857679.075267:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857679.075286:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857679.075357:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+81:2350:x1874704171553920:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 210us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857679.075365:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 223 00010000:00010000:2.0:1787857679.077415:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b278 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd348f expref: 80 pid: 7656 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857679.077450:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188195840:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857679.077473:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.077485:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.077491:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857679.077510:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00010000:00010000:2.0:1787857679.078280:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078291:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078299:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078305:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857679.078310:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078336:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078353:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9998c3984300) 00010000:00010000:2.0:1787857679.078356:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857679.078361:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078367:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b28d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078438:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b286 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3496 expref: 80 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078448:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:2.0:1787857679.078449:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857679.078453:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b286 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3496 expref: 80 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.078468:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53c00, rc 0) 00000100:00100000:2.0:1787857679.078548:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+79:22570:x1874704171553792:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 20588us (20907us total) trans 4294967782 rc 301/301 00000100:00100000:2.0:1787857679.078564:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 742 00000100:00100000:1.0:1787857679.084334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857679.086498:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171554176 00000100:00100000:0.0:1787857679.086514:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171554176 00000100:00100000:0.0:1787857679.086592:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 152 00000100:00100000:0.0:1787857679.086603:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+79:22570:x1874704171554176:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857679.088731:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+80:22570:x1874704171554176:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 2120us (4399us total) trans 4294967783 rc 0/0 00000100:00100000:1.0:1787857679.088743:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 152 00010000:00010000:3.0:1787857679.089136:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857679.092159:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857679.092419:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171554304 00000100:00100000:3.0:1787857679.092445:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171554304 00000100:00100000:3.0:1787857679.092560:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 743 00000100:00100000:3.0:1787857679.092571:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+80:22570:x1874704171554304:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857679.092603:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857679.092627:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7b29b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd349d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.092709:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7b29b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd349d expref: 81 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.092728:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6c00/0xd3f183cab4a7b29b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd349d expref: 81 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.092759:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9998d1291000) 00010000:00010000:3.0:1787857679.092762:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857679.092766:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6c00, rc 0) 00000100:00100000:3.0:1787857679.092863:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+81:22570:x1874704171554304:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 294us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857679.092879:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 743 00000100:00100000:0.0:1787857679.101392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857679.103128:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171554560 00000100:00100000:3.0:1787857679.103140:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171554560 00000100:00100000:3.0:1787857679.103386:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 744 00000100:00100000:3.0:1787857679.103397:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+81:22570:x1874704171554560:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787857679.103486:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.103501:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.103512:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.103756:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.103783:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.103790:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.103795:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857679.103799:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.104028:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.104043:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9998d1291000) 00010000:00010000:3.0:1787857679.104045:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787857679.104051:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857679.104057:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b2a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857679.105528:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:22570:x1874704171554560:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 749us (2765us total) trans 4294967784 rc 0/0 00000100:00100000:3.0:1787857679.105541:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 744 00000100:00100000:0.0:1787857679.109131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857679.109272:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171554816 00000100:00100000:1.0:1787857679.109283:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171554816 00000100:00100000:1.0:1787857679.109346:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 745 00000100:00100000:1.0:1787857679.109356:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+82:22570:x1874704171554816:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857679.109689:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.109707:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857679.109735:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857679.109867:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967785 00000004:00010000:1.0:1787857679.109919:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8ae6635 reply state 000000005b217afb transno 4294967786 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857679.109941:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857679.110046:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+85:22570:x1874704171554816:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 690us (926us total) trans 4294967786 rc 0/0 00000100:00100000:1.0:1787857679.110055:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 745 00000020:00080000:1.0:1787857679.110060:0:7656:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787857679.119746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857679.119847:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.119861:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.119888:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.119894:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857679.119899:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.119908:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.119926:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9998d1291000) 00010000:00010000:2.0:1787857679.119929:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787857679.119934:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857679.119940:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b2a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857679.120021:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171555072 00000100:00100000:1.0:1787857679.120031:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171555072 00000100:00100000:1.0:1787857679.120089:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 153 00000100:00100000:1.0:1787857679.120100:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+84:22570:x1874704171555072:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857679.120576:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+85:22570:x1874704171555072:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 476us (839us total) trans 4294967787 rc 0/0 00000100:00100000:1.0:1787857679.120585:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 153 00000100:00100000:2.0:1787857679.442670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857679.442713:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857679.442743:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857679.442767:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857679.442795:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857679.442846:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171555456 00000100:00100000:2.0:1787857679.442854:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171555456 00000100:00100000:2.0:1787857679.442904:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171555712 00000100:00100000:2.0:1787857679.442907:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171555712 00000100:00100000:2.0:1787857679.442920:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171555328 00000100:00100000:2.0:1787857679.442923:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171555328 00000100:00100000:2.0:1787857679.442934:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171555584 00000100:00100000:2.0:1787857679.442950:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171555584 00000100:00100000:2.0:1787857679.442976:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 282 00000100:00100000:2.0:1787857679.442986:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171555456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857679.443383:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 283 00000100:00100000:0.0:1787857679.443394:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171555712:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857679.443484:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171555712:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 93us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857679.443502:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 283 00000100:00100000:0.0:1787857679.443521:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 284 00000100:00100000:0.0:1787857679.443528:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171555328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857679.443554:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171555328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857679.443561:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 284 00000100:00100000:0.0:1787857679.443570:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 285 00000100:00100000:0.0:1787857679.443576:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171555584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857679.443596:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171555584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857679.443601:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 285 00000100:00100000:2.0:1787857679.443878:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171555456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 892us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857679.443885:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 282 00000100:00100000:1.0:1787857679.444145:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171555200 00000100:00100000:1.0:1787857679.444151:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171555200 00000100:00100000:1.0:1787857679.444190:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 447 00000100:00100000:1.0:1787857679.444197:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171555200:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857679.444339:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171555200:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 142us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857679.444347:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 447 00000100:00080000:1.0:1787857679.444395:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857679.444400:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857680.109989:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857681.134137:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857681.262078:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188195968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857681.262164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857681.263498:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188195968 00000100:00100000:0.0:1787857681.263510:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188195968 00000100:00100000:0.0:1787857681.263582:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787857681.263593:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188195968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857681.263633:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00080000:3.0:1787857681.263774:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857681.266997:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188195968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3397us (4824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857681.267013:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787857681.267560:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188195968:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787857681.358854:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967783 is committed 00000001:00080000:0.0:1787857681.358888:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967787 is committed 00010000:00010000:2.0:1787857682.159445:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857682.798490:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188196224:0@lo:400:kworker.0 00000100:00100000:1.0:1787857682.798558:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188196352:0@lo:400:kworker.0 00000100:00100000:0.0:1787857682.798588:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857682.798637:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188196224 00000100:00100000:1.0:1787857682.798645:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188196224 00000100:00100000:0.0:1787857682.798678:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188196736:0@lo:400:kworker.0 00000100:00100000:1.0:1787857682.798705:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787857682.798716:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188196224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857682.798725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857682.798767:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188196736 00000100:00100000:0.0:1787857682.798771:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188196736 00000100:00100000:1.0:1787857682.798786:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188196224:12345-0@lo:400:kworker.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857682.798794:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787857682.798846:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787857682.798857:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188196736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857682.798858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857682.798903:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188196352 00000100:00100000:0.0:1787857682.798906:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188196736:12345-0@lo:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857682.798908:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188196352 00000100:00100000:0.0:1787857682.798917:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787857682.798940:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787857682.798948:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188196352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857682.798973:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188196736:0@lo:400:kworker.0 00000100:00100000:0.0:1787857682.798990:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188196224:0@lo:400:kworker.0 00000100:00100000:1.0:1787857682.798991:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188196352:12345-0@lo:400:kworker.0 Request processed in 42us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857682.799002:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787857682.799033:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188196352:0@lo:400:kworker.0 00000100:00100000:3.0:1787857682.799123:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188196480:0@lo:400:kworker.0 00000100:00100000:3.0:1787857682.799152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857682.799192:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188196096:0@lo:400:kworker.0 00000100:00080000:3.0:1787857682.799205:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857682.799211:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857682.799233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857682.799271:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188196608:0@lo:400:kworker.0 00000100:00100000:1.0:1787857682.799275:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188196480 00000100:00100000:1.0:1787857682.799280:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188196480 00000100:00100000:2.0:1787857682.799295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857682.799322:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787857682.799332:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188196480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857682.799393:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188196480:12345-0@lo:400:kworker.0 Request processed in 63us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857682.799399:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787857682.799481:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188196480:0@lo:400:kworker.0 00000100:00100000:0.0:1787857682.800974:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188196096 00000100:00100000:0.0:1787857682.800983:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188196096 00000100:00100000:0.0:1787857682.801036:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1787857682.801044:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188196096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857682.801120:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188196096:12345-0@lo:400:kworker.0 Request processed in 76us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857682.801127:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1787857682.801247:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188196096:0@lo:400:kworker.0 00000100:00100000:3.0:1787857682.801325:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188196608 00000100:00100000:3.0:1787857682.801330:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188196608 00000100:00100000:3.0:1787857682.801397:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787857682.801405:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188196608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857682.801451:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188196608:12345-0@lo:400:kworker.0 Request processed in 47us (2156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857682.801457:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787857682.801487:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188196608:0@lo:400:kworker.0 00000100:00080000:2.0:1787857682.801607:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857683.182084:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857683.310452:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188196864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857683.310531:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857683.311220:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188196864 00000100:00100000:3.0:1787857683.311229:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188196864 00000100:00100000:3.0:1787857683.311283:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787857683.311292:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188196864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857683.311330:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857683.311400:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188196864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857683.311408:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787857683.311495:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188196864:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787857683.566188:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857683.566198:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857683.566563:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 1 00000040:00080000:1.0:1787857683.566571:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857684.207160:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857684.561200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857684.561252:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857684.561278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857684.561403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857684.561426:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857684.561441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857684.561481:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857684.561578:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171556224 00000100:00100000:0.0:1787857684.561588:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171556224 00000100:00100000:0.0:1787857684.561657:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 288 00000100:00100000:0.0:1787857684.561669:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171556224:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857684.561744:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171556224:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 78us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857684.561898:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 288 00000100:00100000:0.0:1787857684.561918:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171556480 00000100:00100000:0.0:1787857684.561921:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171556480 00000100:00100000:0.0:1787857684.561938:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171556096 00000100:00100000:0.0:1787857684.561941:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171556096 00000100:00100000:0.0:1787857684.561953:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171556608 00000100:00100000:0.0:1787857684.561955:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171556608 00000100:00100000:0.0:1787857684.561969:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 289 00000100:00100000:0.0:1787857684.561976:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171556480:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857684.562010:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171556480:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857684.562017:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 289 00000100:00100000:0.0:1787857684.562029:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 290 00000100:00100000:0.0:1787857684.562036:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171556096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857684.562060:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2350:x1874704171556096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857684.562066:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 290 00000100:00100000:0.0:1787857684.562077:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 291 00000100:00100000:0.0:1787857684.562083:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171556608:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857684.562107:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171556608:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857684.562112:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 291 00000100:00100000:0.0:1787857684.562132:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171555840 00000100:00100000:0.0:1787857684.562135:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171555840 00000100:00100000:0.0:1787857684.562159:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:0.0:1787857684.562174:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171555840:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857684.562201:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171555840:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857684.562207:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:3.0:1787857684.562420:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171555968 00000100:00100000:3.0:1787857684.562425:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171555968 00000100:00100000:3.0:1787857684.562460:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171556352 00000100:00100000:3.0:1787857684.562464:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171556352 00000100:00100000:3.0:1787857684.562489:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:3.0:1787857684.562496:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:2350:x1874704171555968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857684.562533:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:2350:x1874704171555968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857684.562553:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:3.0:1787857684.562567:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00100000:3.0:1787857684.562573:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2350:x1874704171556352:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857684.562595:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2350:x1874704171556352:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857684.562602:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00080000:2.0:1787857684.563437:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857684.563443:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857684.563455:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787857685.234287:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857686.256220:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857686.382086:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857686.382113:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188196992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857686.382187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857686.386017:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188196992 00000100:00100000:1.0:1787857686.386034:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188196992 00000100:00100000:1.0:1787857686.386122:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787857686.386133:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188196992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857686.386177:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857686.386261:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188196992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857686.386270:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1787857686.386376:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857686.386902:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188196992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857687.278176:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787857687.561214:0:17706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd462aa2d0 20000000:00000080:1.0:1787857687.561233:0:17706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9998ffbee800 uarg=0000000000000000 00000040:00100000:1.0:1787857687.562569:0:17706:0:(llog.c:1072:llog_reverse_process()) index 48 : idx 48 00000040:00100000:1.0:1787857687.562607:0:17706:0:(llog.c:1072:llog_reverse_process()) index 46 : idx 1 20000000:01000000:1.0:1787857687.562613:0:17706:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 46 cmd:0xce021 lustre.test_11c lustre-OST0001_UUID 20000000:01000000:1.0:1787857687.562629:0:17706:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_11c.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1787857687.563570:0:17707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 45 marker 30 1->4: lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 20000000:01000000:3.0:1787857687.563715:0:17707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 48 marker 30 2->4: lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1787857687.563748:0:17707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000040:00080000:1.0:1787857687.564468:0:17706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16832 20000000:01000000:1.0:1787857687.564485:0:17706:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:1.0:1787857687.564544:0:17706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 136 off16968 00000040:00080000:1.0:1787857687.564584:0:17706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off17192 20000000:01000000:1.0:1787857687.564601:0:17706:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_11c.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1787857687.565501:0:17708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 40 marker 31 1->4: lustre-MDT0000-mdtlov add lustre.test_11c.lustre-OST0001_UUID 20000000:01000000:3.0:1787857687.565606:0:17708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 42 marker 31 2->4: lustre-MDT0000-mdtlov add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1787857687.565646:0:17708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1787857687.566565:0:17706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15872 20000000:01000000:1.0:1787857687.566583:0:17706:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:1.0:1787857687.566639:0:17706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 144 off16016 00000040:00080000:1.0:1787857687.566691:0:17706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off16240 10000000:01000000:1.0:1787857687.566706:0:17706:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787857687.566729:0:17706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.566750:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.566758:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.566765:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567060:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567067:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567074:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567080:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567086:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567092:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567109:0:17706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567116:0:17706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567156:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567171:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 18 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.567185:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197120:0@lo:104: 00000100:00100000:1.0:1787857687.567248:0:17706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857687.567407:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567416:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 18 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.567425:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197248:0@lo:104: 00000100:00100000:1.0:1787857687.567450:0:17706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857687.567548:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.567556:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 18 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.567565:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197376:0@lo:104: 00000100:00100000:1.0:1787857687.567596:0:17706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857687.567649:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188197120 00000100:00100000:0.0:1787857687.567658:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188197120 00000100:00100000:0.0:1787857687.567715:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188197248 00000100:00100000:0.0:1787857687.567719:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188197248 00000100:00100000:0.0:1787857687.567736:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787857687.567745:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17706:x1874704188197120:12345-0@lo:104: 00010000:00010000:0.0:1787857687.567757:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.567855:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857687.567861:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17706:x1874704188197120:12345-0@lo:104: Request processed in 117us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857687.567868:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787857687.567887:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787857687.567893:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17706:x1874704188197248:12345-0@lo:104: 00010000:00010000:0.0:1787857687.567900:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.567937:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787857687.567951:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17706:x1874704188197248:12345-0@lo:104: Request processed in 59us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857687.567957:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1787857687.567987:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787857687.567993:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568001:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1787857687.568005:0:7647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568014:0:7647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857687.568020:0:7647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857687.568026:0:7647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857687.568052:0:7647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568059:0:7647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857687.568077:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568084:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c2c53200/0xd3f183cab4a7b1d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568095:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857687.568098:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568113:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1787857687.568116:0:7647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568122:0:7647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857687.568128:0:7647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857687.568133:0:7647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857687.568146:0:7647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568152:0:7647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857687.568165:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568171:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff999900ce6200/0xd3f183cab4a7b1c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568179:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857687.568181:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857687.568182:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857687.568202:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188197504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857687.568230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857687.568279:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857687.568287:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188197632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857687.568518:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857687.568553:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857687.568570:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188197504 00000100:00100000:0.0:1787857687.568574:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188197504 00010000:00010000:0.0:1787857687.568594:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 19 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857687.568613:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188197632 00000100:00100000:0.0:1787857687.568615:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188197632 00010000:00010000:0.0:1787857687.568626:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 20 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857687.568642:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787857687.568648:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3305:x1874704188197504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857687.568658:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857687.568663:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 20 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568672:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 20 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568687:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857687.568714:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3305:x1874704188197504:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857687.568720:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787857687.568734:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787857687.568739:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188197632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857687.568747:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857687.568751:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 19 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568766:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 19 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.568776:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857687.568801:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188197632:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857687.568965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787857687.569018:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188197504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857687.569045:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188197632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857687.569328:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.569338:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 18 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569348:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197760:0@lo:104: 00000100:00100000:1.0:1787857687.569376:0:17706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857687.569408:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.569417:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 18 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569425:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197888:0@lo:104: 00000100:00100000:1.0:1787857687.569446:0:17706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857687.569464:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.569472:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 18 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569479:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa80f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198016:0@lo:104: 00000100:00100000:1.0:1787857687.569499:0:17706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857687.569517:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.569524:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 18 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569545:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa81680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198144:0@lo:104: 00000100:00100000:1.0:1787857687.569569:0:17706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857687.569592:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.569603:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 12 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569613:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198272:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857687.569663:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.569670:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 12 pid: 5850 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569678:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198400:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857687.569704:0:17706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.569712:0:17706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 12 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569720:0:17706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198528:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857687.569742:0:17706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d0946780 going to sleep for 11 seconds 00010000:00010000:1.0:1787857687.569756:0:17706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc4a00/0xd3f183cab4a7b1d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b1d0 expref: 18 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569791:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197120:0@lo:104: 00010000:00010000:1.0:1787857687.569838:0:17706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999900ce6800/0xd3f183cab4a7b1c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b1c2 expref: 17 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.569848:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197248:0@lo:104: 00000100:00100000:2.0:1787857687.570122:0:17346:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787857687.570132:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188197376 00000100:00100000:2.0:1787857687.570137:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188197376 00000100:00100000:2.0:1787857687.570161:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188197760 00000100:00100000:2.0:1787857687.570163:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188197760 00000100:00100000:2.0:1787857687.570172:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188197888 00000100:00100000:2.0:1787857687.570173:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188197888 00000100:00100000:2.0:1787857687.570181:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188198016 00000100:00100000:2.0:1787857687.570182:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188198016 00000100:00100000:2.0:1787857687.570190:0:17346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188198144 00000100:00100000:2.0:1787857687.570192:0:17346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188198144 00000100:00100000:2.0:1787857687.570204:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787857687.570211:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+7:17706:x1874704188197376:12345-0@lo:104: 00010000:00010000:2.0:1787857687.570222:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570287:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787857687.570292:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+7:17706:x1874704188197376:12345-0@lo:104: Request processed in 82us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.570299:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787857687.570315:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787857687.570321:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+6:17706:x1874704188197760:12345-0@lo:104: 00010000:00010000:2.0:1787857687.570328:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570361:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787857687.570366:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+6:17706:x1874704188197760:12345-0@lo:104: Request processed in 46us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.570379:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787857687.570391:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787857687.570396:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17706:x1874704188197888:12345-0@lo:104: 00010000:00010000:2.0:1787857687.570402:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570437:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787857687.570442:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17706:x1874704188197888:12345-0@lo:104: Request processed in 47us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.570447:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787857687.570458:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787857687.570463:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17706:x1874704188198016:12345-0@lo:104: 00010000:00010000:2.0:1787857687.570470:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570500:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787857687.570505:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17706:x1874704188198016:12345-0@lo:104: Request processed in 42us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.570511:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787857687.570522:0:17346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787857687.570527:0:17346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17706:x1874704188198144:12345-0@lo:104: 00010000:00010000:2.0:1787857687.570533:0:17346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570558:0:17346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787857687.570562:0:17346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17706:x1874704188198144:12345-0@lo:104: Request processed in 36us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.570575:0:17346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1787857687.570613:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787857687.570619:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570626:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857687.570630:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570637:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857687.570644:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857687.570649:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857687.570672:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570678:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857687.570696:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570702:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998f8e94800/0xd3f183cab4a7b1b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570713:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787857687.570716:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570731:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857687.570734:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.570741:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857687.570747:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857687.570752:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857687.570765:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571034:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857687.571052:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571059:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5c00/0xd3f183cab4a7b1a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571069:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787857687.571072:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571304:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857687.571307:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571324:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857687.571330:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857687.571335:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857687.571351:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571357:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857687.571363:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571369:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b19f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571378:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857687.571381:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571387:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857687.571389:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571396:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857687.571402:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857687.571412:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857687.571423:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571429:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857687.571435:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571440:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b18a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b191 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571449:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857687.571452:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571457:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857687.571460:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571466:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857687.571472:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857687.571477:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857687.571487:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571493:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857687.571504:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571510:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c2c52800/0xd3f183cab4a7b17c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.571524:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857687.571525:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857687.571527:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857687.571546:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188199040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857687.571585:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857687.571626:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857687.571631:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188198656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857687.571655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857687.571671:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188199168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857687.571690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857687.571719:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188199040 00000100:00100000:2.0:1787857687.571723:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188199040 00010000:00010000:2.0:1787857687.571746:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 17 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857687.571782:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188198656 00000100:00100000:2.0:1787857687.571785:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188198656 00010000:00010000:2.0:1787857687.571798:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 18 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857687.572109:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188198784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857687.572142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857687.572161:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857687.572167:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188198912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857687.572187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857687.572202:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857687.572215:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857687.572225:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188199168 00000100:00100000:0.0:1787857687.572228:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188199168 00010000:00010000:0.0:1787857687.572244:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 19 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.572341:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197376:0@lo:104: 00000100:00100000:1.0:1787857687.572352:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197760:0@lo:104: 00000100:00100000:1.0:1787857687.572359:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188197888:0@lo:104: 00000100:00100000:1.0:1787857687.572366:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa80f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198016:0@lo:104: 00000100:00100000:1.0:1787857687.572374:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa81680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198144:0@lo:104: 00000100:00100000:2.0:1787857687.572442:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188198784 00000100:00100000:2.0:1787857687.572447:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188198784 00010000:00010000:2.0:1787857687.572461:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 20 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857687.575431:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188198912 00000100:00100000:3.0:1787857687.575447:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188198912 00010000:00010000:3.0:1787857687.575487:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 21 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857687.578084:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787857687.578105:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e19aa925-029c-4b3f-9a96-6d2fc52887f3+21:3302:x1874704188199040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857687.578123:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857687.578133:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 21 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578164:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 21 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578181:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b18a expref: 21 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578196:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857687.578282:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3302:x1874704188199040:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (6696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857687.578289:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787857687.578311:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787857687.578319:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188198656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857687.578328:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857687.578332:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 19 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578343:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 19 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578353:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c52e00/0xd3f183cab4a7b1bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b1b4 expref: 19 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578361:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857687.578384:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:3302:x1874704188198656:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (6728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857687.578390:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787857687.578436:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787857687.578442:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:3302:x1874704188199168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857687.578456:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857687.578460:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 17 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578468:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 17 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578478:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b183 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b17c expref: 17 pid: 5851 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857687.578485:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857687.578509:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:3302:x1874704188199168:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (6817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857687.578515:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787857687.578568:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188198656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857687.578578:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188199168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857687.578586:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188199040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857687.579102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787857687.579111:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:3304:x1874704188198784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857687.579119:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857687.579125:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 15 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.579133:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 15 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.579144:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c53e00/0xd3f183cab4a7b1ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b1a6 expref: 15 pid: 5850 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.579155:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857687.579189:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:3304:x1874704188198784:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (7047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.579196:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787857687.579271:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188198784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857687.579980:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857687.581139:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787857687.581157:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:3304:x1874704188198912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857687.581173:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857687.581181:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 13 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.581195:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 13 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.581229:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b19f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b198 expref: 13 pid: 5849 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.581244:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857687.581326:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:3304:x1874704188198912:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (9137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857687.581334:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787857687.581400:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188198912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857687.587279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857687.587322:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857687.587362:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171556736 00000100:00100000:2.0:1787857687.587371:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171556736 00010000:00010000:2.0:1787857687.587408:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 13 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857687.587444:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171556864 00000100:00100000:2.0:1787857687.587448:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171556864 00010000:00010000:2.0:1787857687.587477:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 14 pid: 5850 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857687.587500:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 231 00000100:00100000:2.0:1787857687.587509:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:2350:x1874704171556736:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857687.587523:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857687.587529:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 14 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.587540:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 14 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.587562:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857687.587615:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:2350:x1874704171556736:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.587624:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 231 00000100:00100000:2.0:1787857687.587642:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00100000:2.0:1787857687.587648:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171556864:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857687.587655:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857687.587660:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 13 pid: 5850 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.587669:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 13 pid: 5850 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857687.587679:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857687.587696:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171556864:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 48us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.587711:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 232 00010000:00010000:1.0:1787857687.588228:0:17706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b175 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd345e expref: 12 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.588243:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198272:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857687.588267:0:17706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999900ce7c00/0xd3f183cab4a7b16e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3457 expref: 11 pid: 5850 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857687.588276:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198400:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857687.588286:0:17706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17706:1874704188198528:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857687.588341:0:17706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857687.595074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857687.595164:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171556992 00000100:00100000:3.0:1787857687.595176:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171556992 00010000:00010000:3.0:1787857687.595216:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 11 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857687.595256:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:3.0:1787857687.595275:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:2350:x1874704171556992:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857687.595292:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857687.595298:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 11 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595311:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 11 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595332:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc4e00/0xd3f183cab4a7b167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3450 expref: 11 pid: 5849 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595351:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595360:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595396:0:8468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595403:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595410:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595417:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595423:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857687.595428:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.595437:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.603665:0:17706:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857687.603706:0:17706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.604926:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.604944:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b2b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857687.604968:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857687.608686:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a844d87e-58d2-455f-ad2c-5bf80fe2767e+10:2350:x1874704171556992:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 13400us (13609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.608703:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:3.0:1787857687.918685:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188199552:0@lo:400:kworker.0 00000100:00100000:3.0:1787857687.918759:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857687.919315:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188199296:0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.919353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857687.919385:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188199808:0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.919408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857687.919433:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857687.919440:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188199424:0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.919462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857687.919498:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188199552 00000100:00100000:1.0:1787857687.919504:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188199552 00000100:00100000:1.0:1787857687.919545:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188199808 00000100:00100000:1.0:1787857687.919548:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188199808 00000100:00100000:1.0:1787857687.919581:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787857687.919591:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188199552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.919638:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188199552:12345-0@lo:400:kworker.0 Request processed in 48us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857687.919645:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787857687.919661:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787857687.919667:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188199808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.919697:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188199808:12345-0@lo:400:kworker.0 Request processed in 31us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857687.919703:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1787857687.919722:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857687.919752:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188199808:0@lo:400:kworker.0 00000100:00100000:2.0:1787857687.919969:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188199296 00000100:00100000:2.0:1787857687.919974:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188199296 00000100:00100000:2.0:1787857687.920009:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188199424 00000100:00100000:2.0:1787857687.920012:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188199424 00000100:00100000:2.0:1787857687.920036:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787857687.920043:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188199296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857687.920082:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188199296:12345-0@lo:400:kworker.0 Request processed in 39us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.920088:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787857687.920101:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787857687.920107:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188199424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857687.920135:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188199424:12345-0@lo:400:kworker.0 Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857687.920141:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787857687.920786:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188199680:0@lo:400:kworker.0 00000100:00100000:0.0:1787857687.920849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857687.921514:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188199552:0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.921633:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188199680 00000100:00100000:1.0:1787857687.921639:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188199680 00000100:00100000:1.0:1787857687.921686:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787857687.921693:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188199680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.921742:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188199680:12345-0@lo:400:kworker.0 Request processed in 50us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857687.921749:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:1.0:1787857687.921766:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857687.921785:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188199680:0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.921812:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188199424:0@lo:400:kworker.0 00000100:00100000:1.0:1787857687.921855:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188199296:0@lo:400:kworker.0 00010000:00010000:2.0:1787857688.305966:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857688.430259:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188199936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857688.430327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.430494:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188199936 00000100:00100000:3.0:1787857688.430502:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188199936 00000100:00100000:3.0:1787857688.430552:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787857688.430561:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188199936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857688.430596:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857688.430644:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188199936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.430651:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787857688.430790:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188199936:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1787857688.622294:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787857688.622304:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9997c18ad800 from 49 10000000:01000000:0.0:1787857688.622309:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787857688.622360:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.622372:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.622398:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857688.622425:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.622504:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857688.622570:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.622766:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188200064 00000100:00100000:1.0:1787857688.622774:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188200064 00000100:00100000:1.0:1787857688.622853:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1787857688.622862:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:5853:x1874704188200064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857688.622876:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857688.622890:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b2b7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.622913:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.622924:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.622933:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94000, rc 0) 00000100:00100000:1.0:1787857688.623004:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188200064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.623011:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1787857688.623200:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857688.623215:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.623233:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857688.623320:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.623345:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857688.623375:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.623894:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188200192 00000100:00100000:1.0:1787857688.623901:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188200192 00000100:00100000:1.0:1787857688.624092:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1787857688.624102:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188200192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857688.624427:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188200192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.624496:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.624542:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.624583:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.624601:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66840 going to sleep for 11 seconds 00000100:00100000:2.0:1787857688.629043:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188200320 00000100:00100000:2.0:1787857688.629059:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188200320 00000100:00100000:2.0:1787857688.629105:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1787857688.629115:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188200320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.636835:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188200320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7688us (12218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.636850:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1787857688.637136:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857688.637509:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1787857688.637703:0:17710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17710:1874704188200448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857688.637759:0:17710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857688.637797:0:17710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857688.637897:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188200448 00000100:00100000:0.0:1787857688.637904:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188200448 00000100:00100000:0.0:1787857688.637952:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1787857688.637961:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17710:x1874704188200448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857688.638189:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17710:x1874704188200448:12345-0@lo:502:llog_process_th.0 Request processed in 229us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857688.638197:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1787857688.638340:0:17710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17710:1874704188200448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857688.638386:0:17710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17710:1874704188200576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857688.638420:0:17710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857688.638450:0:17710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c788f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857688.638507:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188200576 00000100:00100000:3.0:1787857688.638511:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188200576 00000100:00100000:3.0:1787857688.638544:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1787857688.638551:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17710:x1874704188200576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857688.638662:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17710:x1874704188200576:12345-0@lo:502:llog_process_th.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.638670:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1787857688.638753:0:17710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17710:1874704188200576:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787857688.638775:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787857688.639098:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:3.0:1787857688.639123:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857688.639133:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.639162:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857688.639172:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787857688.639175:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787857688.639178:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787857688.639201:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.639209:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.639219:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.639233:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.639273:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.639301:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.639544:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188200704 00000100:00100000:1.0:1787857688.639549:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188200704 00000100:00100000:1.0:1787857688.639584:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1787857688.639592:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188200704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857688.639601:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857688.639612:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b2c5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.639633:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.639657:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.639666:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94c00, rc 0) 00000100:00100000:1.0:1787857688.639698:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188200704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.639704:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1787857688.640040:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857688.640055:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.640062:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.640111:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.640136:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.640171:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.640322:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188200832 00000100:00100000:1.0:1787857688.640327:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188200832 00000100:00100000:1.0:1787857688.640358:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1787857688.640365:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188200832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857688.640611:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188200832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.640619:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1787857688.640688:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.640715:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.640751:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.640773:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857688.640884:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188200960 00000100:00100000:0.0:1787857688.640889:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188200960 00000100:00100000:0.0:1787857688.640921:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1787857688.640928:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188200960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.641196:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188200960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 268us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857688.641204:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1787857688.641341:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188200960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787857688.642519:0:17711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:0.0:1787857688.644499:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1787857688.644543:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787857688.644557:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.644570:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857688.644599:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787857688.644602:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9998dba2e800 from 49 10000000:01000000:0.0:1787857688.644605:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787857688.644641:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.644650:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.644661:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857688.644688:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.644755:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857688.644798:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857688.650111:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188201088 00000100:00100000:3.0:1787857688.650125:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188201088 00000100:00100000:3.0:1787857688.650185:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1787857688.650195:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188201088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857688.650212:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857688.650230:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b2d3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.650269:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.650279:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.650288:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7a00, rc 0) 00000100:00100000:3.0:1787857688.650376:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188201088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (5621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.650384:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1787857688.650511:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857688.650530:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.650540:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857688.650613:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.650648:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857688.650687:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857688.651334:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188201216 00000100:00100000:3.0:1787857688.651341:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188201216 00000100:00100000:3.0:1787857688.651379:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1787857688.651386:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188201216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.651662:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188201216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.651669:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1787857688.651766:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.651806:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.651877:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857688.651903:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857688.651973:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188201344 00000100:00100000:3.0:1787857688.651978:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188201344 00000100:00100000:3.0:1787857688.652005:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1787857688.652012:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188201344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.652156:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188201344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.652163:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1787857688.652457:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.653626:0:17712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17712:1874704188201472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857688.653688:0:17712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857688.653725:0:17712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc600 going to sleep for 11 seconds 00000100:00100000:3.0:1787857688.653773:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188201472 00000100:00100000:3.0:1787857688.653778:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188201472 00000100:00100000:3.0:1787857688.654087:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1787857688.654099:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17712:x1874704188201472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857688.654362:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17712:x1874704188201472:12345-0@lo:502:llog_process_th.0 Request processed in 265us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857688.654411:0:17712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17712:1874704188201472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857688.654463:0:17712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17712:1874704188201600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857688.654497:0:17712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857688.654525:0:17712:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.658313:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188201600 00000100:00100000:1.0:1787857688.658327:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188201600 00000100:00100000:3.0:1787857688.658562:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1787857688.664986:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1787857688.665013:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17712:x1874704188201600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857688.665300:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17712:x1874704188201600:12345-0@lo:502:llog_process_th.0 Request processed in 300us (10801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.665308:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1787857688.665646:0:17712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17712:1874704188201600:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787857688.665686:0:17712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787857688.669324:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:3.0:1787857688.669365:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857688.669378:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.669390:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857688.669423:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787857688.669426:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787857688.669429:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787857688.669468:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.669476:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.669487:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.669513:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.669582:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.669634:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.669914:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188201728 00000100:00100000:1.0:1787857688.669921:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188201728 00000100:00100000:1.0:1787857688.669981:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1787857688.669991:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188201728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857688.670013:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857688.670027:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b2e1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.670051:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.670062:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.670071:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94400, rc 0) 00000100:00100000:1.0:1787857688.670114:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188201728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.670121:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1787857688.670324:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857688.670338:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.670346:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.670403:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.670432:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.670462:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857688.670520:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188201856 00000100:00100000:2.0:1787857688.670525:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188201856 00000100:00100000:2.0:1787857688.670559:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1787857688.670567:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188201856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.670865:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188201856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.670873:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1787857688.671034:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.671064:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.671107:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.671128:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857688.671354:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188201984 00000100:00100000:0.0:1787857688.671359:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188201984 00000100:00100000:0.0:1787857688.671392:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1787857688.671400:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188201984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.671550:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188201984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857688.671563:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1787857688.671668:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188201984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787857688.672679:0:17713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1787857688.678636:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1787857688.678676:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787857688.678689:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.678702:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857688.678713:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787857688.678716:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9998dbb32800 from 49 10000000:01000000:2.0:1787857688.678719:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787857688.678776:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.678784:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.678796:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857688.680943:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.681024:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857688.681073:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857688.681201:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188202112 00000100:00100000:0.0:1787857688.681210:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188202112 00000100:00100000:0.0:1787857688.681271:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1787857688.681281:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188202112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857688.681295:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857688.681311:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b2ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.681337:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.681348:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.681357:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4200, rc 0) 00000100:00100000:0.0:1787857688.681404:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188202112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857688.681411:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1787857688.681548:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857688.681563:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.681571:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.681635:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.681661:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.681678:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66000 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.681728:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188202240 00000100:00100000:1.0:1787857688.681732:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188202240 00000100:00100000:1.0:1787857688.681763:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1787857688.681770:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188202240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857688.682219:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188202240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.682227:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1787857688.682304:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.682336:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.682380:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.682409:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857688.682448:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188202368 00000100:00100000:0.0:1787857688.682452:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188202368 00000100:00100000:0.0:1787857688.682483:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1787857688.682490:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188202368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.682636:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188202368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857688.682644:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1787857688.682797:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.683288:0:17714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17714:1874704188202496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857688.683334:0:17714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857688.683365:0:17714:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857688.683423:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188202496 00000100:00100000:2.0:1787857688.683428:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188202496 00000100:00100000:2.0:1787857688.683462:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1787857688.683469:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17714:x1874704188202496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857688.683671:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17714:x1874704188202496:12345-0@lo:502:llog_process_th.0 Request processed in 201us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.683678:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1787857688.683760:0:17714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17714:1874704188202496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857688.683799:0:17714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17714:1874704188202624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857688.683860:0:17714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857688.683880:0:17714:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.683932:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188202624 00000100:00100000:1.0:1787857688.684004:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188202624 00000100:00100000:1.0:1787857688.684025:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1787857688.684032:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17714:x1874704188202624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857688.684159:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17714:x1874704188202624:12345-0@lo:502:llog_process_th.0 Request processed in 127us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.684174:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1787857688.684405:0:17714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17714:1874704188202624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787857688.684427:0:17714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787857688.684576:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:3.0:1787857688.684600:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857688.684609:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.684619:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857688.684636:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787857688.684639:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787857688.684642:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787857688.684667:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.684674:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.684682:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.684697:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.684728:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.684748:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857688.684854:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188202752 00000100:00100000:2.0:1787857688.684859:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188202752 00000100:00100000:2.0:1787857688.684886:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1787857688.684893:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188202752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857688.684903:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857688.684914:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b2fd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.685003:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.685029:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.685037:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53800, rc 0) 00000100:00100000:2.0:1787857688.685074:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188202752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.685080:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1787857688.685285:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857688.685299:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857688.685308:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857688.685353:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.685379:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857688.685407:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857688.685449:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188202880 00000100:00100000:2.0:1787857688.685453:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188202880 00000100:00100000:2.0:1787857688.685473:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1787857688.685479:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188202880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.685703:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188202880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.685709:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1787857688.686293:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188202880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.686328:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188203008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857688.686367:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857688.686397:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857688.686473:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188203008 00000100:00100000:3.0:1787857688.686478:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188203008 00000100:00100000:3.0:1787857688.686511:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1787857688.686518:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188203008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.686666:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188203008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.686673:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1787857688.688086:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188203008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.695376:0:17715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17715:1874704188203136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857688.695478:0:17715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857688.695525:0:17715:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc600 going to sleep for 11 seconds 00000100:00100000:3.0:1787857688.696107:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188203136 00000100:00100000:3.0:1787857688.696114:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188203136 00000100:00100000:3.0:1787857688.696420:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1787857688.696432:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17715:x1874704188203136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857688.697873:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17715:x1874704188203136:12345-0@lo:502:llog_process_th.0 Request processed in 1439us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.697897:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1787857688.699042:0:17715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17715:1874704188203136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857688.699094:0:17715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857688.699107:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857688.699109:0:17715:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:0.0:1787857688.699116:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1787857688.699131:0:17715:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from test_11c 00000100:00100000:0.0:1787857688.701626:0:17715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17715:1874704188203264:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787857688.701947:0:17716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9998dbb32800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787857688.701952:0:17716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9998dbb32800 4 00000100:00100000:0.0:1787857688.702224:0:17715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857688.702284:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188203264 00000100:00100000:1.0:1787857688.702291:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188203264 00000100:00100000:0.0:1787857688.702291:0:17715:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.702340:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1787857688.702349:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17715:x1874704188203264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857688.702619:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17715:x1874704188203264:12345-0@lo:502:llog_process_th.0 Request processed in 271us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.702628:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1787857688.702782:0:17715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17715:1874704188203264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857688.702811:0:17715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857688.702853:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857688.702856:0:17715:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:0.0:1787857688.702860:0:17715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787857688.705782:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1787857688.705842:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787857688.705854:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.705867:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857688.705879:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787857688.705882:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9998c56d8000 from 1 10000000:01000000:3.0:1787857688.705885:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787857688.705927:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.705945:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.705957:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.705982:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901252580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188203392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.706051:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.706089:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66600 going to sleep for 11 seconds 00000100:00100000:1.0:1787857688.706258:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188203392 00000100:00100000:1.0:1787857688.706266:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188203392 00000100:00100000:1.0:1787857688.706320:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1787857688.706329:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188203392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857688.706341:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857688.706353:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b30b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.706378:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.706389:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857688.706398:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95600, rc 0) 00000100:00100000:1.0:1787857688.706450:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188203392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.706457:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1787857688.706569:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901252580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188203392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857688.706582:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.706610:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.706658:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901252580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188203520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.706682:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857688.706701:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857688.706741:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188203520 00000100:00100000:2.0:1787857688.706746:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188203520 00000100:00100000:2.0:1787857688.706777:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1787857688.706784:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188203520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.707064:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188203520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (380us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857688.707071:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1787857688.708248:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901252580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188203520:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787857688.708288:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787857688.708296:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857688.708306:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857688.721116:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857688.721168:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171557120 00000100:00100000:2.0:1787857688.721178:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171557120 00000100:00100000:2.0:1787857688.721248:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 478 00000100:00100000:2.0:1787857688.721259:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+10:5605:x1874704171557120:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857688.721275:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857688.721291:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34a4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.721320:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.721332:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.721343:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53600, rc 0) 00000100:00100000:2.0:1787857688.721413:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171557120:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 156us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.721420:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 478 00000100:00100000:2.0:1787857688.725330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857688.725603:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171557248 00000100:00100000:1.0:1787857688.725628:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171557248 00000100:00100000:1.0:1787857688.725685:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 479 00000100:00100000:1.0:1787857688.725695:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171557248:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857688.726690:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171557248:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 993us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.726700:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 479 00000100:00100000:0.0:1787857688.729193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857688.729226:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171557376 00000100:00100000:3.0:1787857688.729248:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171557376 00000100:00100000:3.0:1787857688.729305:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00100000:3.0:1787857688.729315:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171557376:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857688.729530:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171557376:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 217us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857688.729539:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00100000:2.0:1787857688.737598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857688.737865:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171557504 00000100:00100000:1.0:1787857688.737875:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171557504 00000100:00100000:1.0:1787857688.737938:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:1.0:1787857688.737948:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:23034:x1874704171557504:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787857688.738257:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:23034:x1874704171557504:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 310us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.738266:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:2.0:1787857688.743142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857688.743641:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171557632 00000100:00100000:3.0:1787857688.743655:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171557632 00000100:00100000:3.0:1787857688.743736:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:3.0:1787857688.743749:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:23034:x1874704171557632:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857688.744253:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:23034:x1874704171557632:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 504us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.744264:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:0.0:1787857688.750658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857688.751162:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171557760 00000100:00100000:2.0:1787857688.751172:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171557760 00000100:00100000:2.0:1787857688.751255:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 483 00000100:00100000:2.0:1787857688.751266:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171557760:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857688.751298:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857688.751316:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34ab expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.751345:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.751356:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.751365:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52600, rc 0) 00000100:00100000:2.0:1787857688.751430:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171557760:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 166us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.751438:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 483 00000100:00100000:0.0:1787857688.758441:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857688.758619:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171557888 00000100:00100000:2.0:1787857688.758629:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171557888 00000100:00100000:2.0:1787857688.758733:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 484 00000100:00100000:2.0:1787857688.758746:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171557888:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.759096:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171557888:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 353us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.759105:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 484 00000100:00100000:3.0:1787857688.761172:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857688.761362:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171558016 00000100:00100000:1.0:1787857688.761371:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171558016 00000100:00100000:1.0:1787857688.761426:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 485 00000100:00100000:1.0:1787857688.761436:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171558016:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857688.761726:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171558016:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 290us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857688.761735:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 485 00000100:00100000:0.0:1787857688.769223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857688.769479:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171558144 00000100:00100000:2.0:1787857688.769495:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171558144 00000100:00100000:2.0:1787857688.769638:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 486 00000100:00100000:2.0:1787857688.769649:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:23035:x1874704171558144:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857688.770031:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:23035:x1874704171558144:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 378us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.770047:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 486 00000100:00100000:0.0:1787857688.773123:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857688.773231:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171558272 00000100:00100000:2.0:1787857688.773253:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171558272 00000100:00100000:2.0:1787857688.773362:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00100000:2.0:1787857688.773373:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:23035:x1874704171558272:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857688.773654:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:23035:x1874704171558272:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 282us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.773670:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00100000:3.0:1787857688.777685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857688.778322:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171558400 00000100:00100000:2.0:1787857688.778333:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171558400 00000100:00100000:2.0:1787857688.778455:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 488 00000100:00100000:2.0:1787857688.778465:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171558400:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857688.778483:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857688.778502:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.778543:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.778562:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857688.778571:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52000, rc 0) 00000100:00100000:2.0:1787857688.778636:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171558400:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 173us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857688.778643:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 488 00000100:00100000:0.0:1787857688.781601:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857688.782769:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171558528 00000100:00100000:1.0:1787857688.782788:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171558528 00000100:00100000:2.0:1787857688.783062:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 489 00000100:00100000:2.0:1787857688.783074:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171558528:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857688.783395:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171558528:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 310us (1789us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857688.783404:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 489 00010000:00010000:0.0:1787857689.326592:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857689.692901:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857689.693044:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857689.693068:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857689.693097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857689.693113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857689.693129:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857689.693186:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171559040 00000100:00100000:1.0:1787857689.693196:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171559040 00000100:00100000:1.0:1787857689.693273:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171559296 00000100:00100000:1.0:1787857689.693276:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171559296 00000100:00100000:1.0:1787857689.693308:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171558912 00000100:00100000:1.0:1787857689.693311:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171558912 00000100:00100000:1.0:1787857689.693331:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 294 00000100:00100000:1.0:1787857689.693340:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171559040:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857689.693431:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171559040:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 92us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857689.693439:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 294 00000100:00100000:1.0:1787857689.693456:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 295 00000100:00100000:1.0:1787857689.693463:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171559296:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857689.693488:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171559296:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857689.693494:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 295 00000100:00100000:1.0:1787857689.693507:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 296 00000100:00100000:1.0:1787857689.693513:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171558912:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857689.693541:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171558912:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857689.693547:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 296 00000100:00100000:1.0:1787857689.693566:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171558656 00000100:00100000:1.0:1787857689.693570:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171558656 00000100:00100000:1.0:1787857689.693594:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 490 00000100:00100000:1.0:1787857689.693601:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171558656:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857689.693626:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171558656:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857689.693632:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 490 00000100:00080000:1.0:1787857689.694147:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857689.694151:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857689.697298:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857689.697328:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171559424 00000100:00100000:1.0:1787857689.697338:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171559424 00000100:00100000:1.0:1787857689.698730:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00100000:1.0:1787857689.698760:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171559424:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857689.698932:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171559424:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 187us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857689.698940:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00080000:1.0:1787857689.698981:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857689.704133:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171558784 00000100:00100000:3.0:1787857689.704149:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171558784 00000100:00080000:1.0:1787857689.704244:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857689.704259:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171559168 00000100:00100000:3.0:1787857689.704263:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171559168 00000100:00080000:1.0:1787857689.704360:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857689.704781:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 323 00000100:00100000:0.0:1787857689.704794:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+74:2347:x1874704171558784:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857689.704900:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+74:2347:x1874704171558784:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 108us (12009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857689.704908:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 323 00000100:00100000:0.0:1787857689.705080:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 324 00000100:00100000:0.0:1787857689.705087:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2347:x1874704171559168:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857689.705114:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2347:x1874704171559168:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (11984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857689.705120:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 324 00010000:00010000:0.0:1787857690.352525:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857691.380337:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787857691.470271:0:17815:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe75803570 20000000:00000080:3.0:1787857691.470289:0:17815:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff999901415800 uarg=0000000000000000 00000040:00100000:3.0:1787857691.473326:0:17815:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 48 20000000:01000000:3.0:1787857691.473339:0:17815:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 50 cmd:0xce022 lustre.test_11c lustre-OST0001_UUID 20000000:01000000:3.0:1787857691.473354:0:17815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.test_11c fl=4 20000000:01000000:1.0:1787857691.481417:0:17816:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 42 marker 28 1->4: lustre-clilov new lustre.test_11c 20000000:01000000:1.0:1787857691.481528:0:17816:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 44 marker 28 2->4: lustre-clilov new lustre.test_11c 00000040:00080000:1.0:1787857691.481586:0:17816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000040:00080000:3.0:1787857691.482134:0:17815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17416 20000000:01000000:3.0:1787857691.482154:0:17815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre test_11c (null) (null) 00000040:00080000:3.0:1787857691.482203:0:17815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17528 00000040:00080000:3.0:1787857691.482244:0:17815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17752 20000000:01000000:3.0:1787857691.482262:0:17815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_11c fl=4 20000000:01000000:1.0:1787857691.484115:0:17817:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 29 1->4: lustre-MDT0000-mdtlov new lustre.test_11c 20000000:01000000:1.0:1787857691.484207:0:17817:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 39 marker 29 2->4: lustre-MDT0000-mdtlov new lustre.test_11c 00000040:00080000:1.0:1787857691.484274:0:17817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000040:00080000:3.0:1787857691.484736:0:17815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16608 20000000:01000000:3.0:1787857691.484752:0:17815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre test_11c (null) (null) 00000040:00080000:3.0:1787857691.484780:0:17815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].48, 120 off16728 00000040:00080000:3.0:1787857691.484851:0:17815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16952 10000000:01000000:3.0:1787857691.484866:0:17815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787857691.486401:0:17815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486432:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486441:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486452:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486475:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486482:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486488:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486494:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486504:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486512:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486519:0:17815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486525:0:17815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486567:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.486584:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 12 pid: 5851 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.486611:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188203648:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857691.490701:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.490731:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 12 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.490749:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188203776:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857691.490856:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.490864:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 12 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.490874:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188203904:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857691.490905:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.490912:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 18 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.490921:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204032:0@lo:104: 00000100:00100000:3.0:1787857691.490960:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857691.491004:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491012:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 18 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.491035:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204160:0@lo:104: 00000100:00100000:3.0:1787857691.491059:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857691.491079:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491087:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 18 pid: 5849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.491095:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204288:0@lo:104: 00000100:00100000:3.0:1787857691.491117:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857691.491155:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188204032 00000100:00100000:3.0:1787857691.491163:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188204032 00000100:00100000:3.0:1787857691.491211:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188204160 00000100:00100000:3.0:1787857691.491214:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188204160 00000100:00100000:3.0:1787857691.491223:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188204288 00000100:00100000:3.0:1787857691.491224:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188204288 00000100:00100000:3.0:1787857691.491236:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787857691.491244:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17815:x1874704188204032:12345-0@lo:104: 00010000:00010000:3.0:1787857691.491257:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491296:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787857691.491301:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+5:17815:x1874704188204032:12345-0@lo:104: Request processed in 58us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857691.491307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787857691.491324:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787857691.491329:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17815:x1874704188204160:12345-0@lo:104: 00010000:00010000:3.0:1787857691.491345:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491373:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787857691.491378:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+4:17815:x1874704188204160:12345-0@lo:104: Request processed in 50us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857691.491384:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787857691.491395:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787857691.491400:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204288:12345-0@lo:104: 00010000:00010000:3.0:1787857691.491406:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491430:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787857691.491434:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204288:12345-0@lo:104: Request processed in 35us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857691.491440:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787857691.491463:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491471:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 18 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.491479:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204416:0@lo:104: 00000100:00100000:3.0:1787857691.491498:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857691.491514:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188204416 00000100:00100000:3.0:1787857691.491518:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188204416 00000100:00100000:3.0:1787857691.491532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787857691.491537:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204416:12345-0@lo:104: 00010000:00010000:3.0:1787857691.491553:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491583:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787857691.491587:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204416:12345-0@lo:104: Request processed in 50us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857691.491593:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1787857691.491619:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491628:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 18 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.491636:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204544:0@lo:104: 00000100:00100000:3.0:1787857691.491660:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857691.491678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188204544 00000100:00100000:3.0:1787857691.491681:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188204544 00000100:00100000:3.0:1787857691.491699:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787857691.491704:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204544:12345-0@lo:104: 00010000:00010000:3.0:1787857691.491711:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491736:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787857691.491740:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204544:12345-0@lo:104: Request processed in 37us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857691.491746:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1787857691.491767:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491787:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 18 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.491796:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204672:0@lo:104: 00000100:00100000:3.0:1787857691.491842:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857691.491858:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188204672 00000100:00100000:3.0:1787857691.491861:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188204672 00000100:00100000:3.0:1787857691.491875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787857691.491880:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204672:12345-0@lo:104: 00010000:00010000:3.0:1787857691.491887:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491909:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787857691.491913:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204672:12345-0@lo:104: Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857691.491918:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:3.0:1787857691.491938:0:17815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.491946:0:17815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 18 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857691.491954:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204800:0@lo:104: 00000100:00100000:3.0:1787857691.491974:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857691.491996:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787857691.492004:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188204800 00000100:00100000:3.0:1787857691.492007:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188204800 00000100:00100000:3.0:1787857691.492021:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787857691.492031:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efb5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204800:12345-0@lo:104: 00010000:00010000:3.0:1787857691.492039:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.492063:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787857691.492067:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efb5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+3:17815:x1874704188204800:12345-0@lo:104: Request processed in 36us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857691.492072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787857691.492109:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5bfd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857691.492129:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204032:0@lo:104: 00000100:00100000:3.0:1787857691.492136:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204160:0@lo:104: 00000100:00100000:3.0:1787857691.492142:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204288:0@lo:104: 00000100:00100000:3.0:1787857691.492148:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204416:0@lo:104: 00000100:00100000:3.0:1787857691.492153:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204544:0@lo:104: 00000100:00100000:3.0:1787857691.492159:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204672:0@lo:104: 00000100:00100000:3.0:1787857691.492165:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188204800:0@lo:104: 00010000:00010000:2.0:1787857691.492706:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787857691.492715:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492722:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857691.492726:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492734:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857691.492740:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857691.492745:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857691.492785:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492792:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857691.492844:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492852:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff999900ce6600/0xd3f183cab4a7b30b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b312 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492876:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787857691.492889:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492896:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857691.492899:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492910:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857691.492917:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857691.492922:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857691.492937:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492943:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857691.492949:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492956:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff999900ce7e00/0xd3f183cab4a7b2fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b304 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492964:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787857691.492967:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492982:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857691.492984:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.492991:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857691.492997:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857691.493003:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857691.493013:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493018:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857691.493034:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493040:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c2c53000/0xd3f183cab4a7b2ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493049:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787857691.493052:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493057:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857691.493060:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493076:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857691.493082:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857691.493087:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857691.493098:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493103:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857691.493108:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493114:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff999900ce6e00/0xd3f183cab4a7b2e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493122:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787857691.493125:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493131:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857691.493134:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493140:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857691.493146:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857691.493155:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857691.493166:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493172:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857691.493177:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493194:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4000/0xd3f183cab4a7b2d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2da expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493203:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857691.493206:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493211:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857691.493213:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493220:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857691.493226:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857691.493231:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857691.493243:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493248:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857691.493260:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493266:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff999900ce7400/0xd3f183cab4a7b2c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2cc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493275:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857691.493278:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493284:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1787857691.493287:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493294:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857691.493300:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857691.493304:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857691.493316:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493321:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857691.493326:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493332:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9997c3bc4400/0xd3f183cab4a7b2b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd3f183cab4a7b2be expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493345:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857691.493353:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857691.493355:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857691.493363:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857691.493388:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188204928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.493437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857691.493471:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188205440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.493489:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857691.493507:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857691.493513:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188205056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.493530:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857691.493544:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188205568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.493563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857691.493586:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188205184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.493603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857691.493617:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188205696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.493635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857691.493645:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857691.493649:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188205312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.493665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857691.493688:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188204928 00000100:00100000:2.0:1787857691.493692:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188204928 00010000:00010000:2.0:1787857691.493717:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 19 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.493735:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188205440 00000100:00100000:2.0:1787857691.493739:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188205440 00010000:00010000:2.0:1787857691.493749:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 20 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.493766:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188205056 00000100:00100000:2.0:1787857691.493769:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188205056 00010000:00010000:2.0:1787857691.493779:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 21 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.493787:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188205568 00000100:00100000:2.0:1787857691.493789:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188205568 00010000:00010000:2.0:1787857691.493797:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 22 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.493805:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188205184 00000100:00100000:2.0:1787857691.493807:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188205184 00010000:00010000:2.0:1787857691.493841:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 23 pid: 5849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.493851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188205696 00000100:00100000:2.0:1787857691.493853:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188205696 00010000:00010000:2.0:1787857691.493861:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 24 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.493869:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188205312 00000100:00100000:2.0:1787857691.493871:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188205312 00010000:00010000:2.0:1787857691.493879:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 25 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.493889:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787857691.493895:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+25:3302:x1874704188204928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.493907:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.493912:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 25 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493931:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 25 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493945:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b30b expref: 25 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.493960:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.493988:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+24:3302:x1874704188204928:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.493995:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787857691.494036:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787857691.494041:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+23:3302:x1874704188205440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.494047:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.494051:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 23 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494060:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 23 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494070:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999900ce7a00/0xd3f183cab4a7b2da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b2d3 expref: 23 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494078:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.494094:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+22:3302:x1874704188205440:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.494099:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787857691.494108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787857691.494112:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+21:3302:x1874704188205056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.494124:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.494128:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 21 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494136:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 21 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494146:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c53800/0xd3f183cab4a7b304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b2fd expref: 21 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494154:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.494173:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+20:3302:x1874704188205056:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.494179:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787857691.494203:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787857691.494209:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188205568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.494215:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.494219:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 19 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494227:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 19 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494236:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e94c00/0xd3f183cab4a7b2cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b2c5 expref: 19 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494243:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.494264:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:3302:x1874704188205568:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.494279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787857691.494291:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787857691.494297:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:3304:x1874704188205184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.494303:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.494307:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 17 pid: 5849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494315:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 17 pid: 5849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494325:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c3bc4200/0xd3f183cab4a7b2f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b2ef expref: 17 pid: 5849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494333:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.494359:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:3304:x1874704188205184:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.494365:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787857691.494376:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787857691.494381:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:3304:x1874704188205696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.494388:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.494392:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 15 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494400:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 15 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494409:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b2be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b2b7 expref: 15 pid: 5851 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494427:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.494447:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:3304:x1874704188205696:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.494453:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787857691.494465:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787857691.494470:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:3304:x1874704188205312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.494476:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.494480:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 13 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494488:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 13 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494498:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998f8e94400/0xd3f183cab4a7b2e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd3f183cab4a7b2e1 expref: 13 pid: 5850 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.494505:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.494523:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:3304:x1874704188205312:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.494529:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787857691.494575:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188205312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.494583:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188205184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.494589:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188205696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.494615:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188205056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.494622:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188205568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.494638:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188204928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857691.494644:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188205440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857691.495004:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857691.495010:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857691.500036:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188203648:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857691.500053:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188203776:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857691.500061:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17815:1874704188203904:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857691.500127:0:17815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.505994:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188205824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857691.506070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857691.506173:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188205824 00000100:00100000:3.0:1787857691.506188:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188205824 00000100:00100000:3.0:1787857691.506265:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787857691.506275:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188205824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857691.506325:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857691.506372:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188205824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857691.506379:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1787857691.506586:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857691.506637:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188205824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857691.515535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857691.515577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857691.515658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857691.516456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171559680 00000100:00100000:2.0:1787857691.516470:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171559680 00010000:00010000:2.0:1787857691.516527:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 13 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.516570:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171559552 00000100:00100000:2.0:1787857691.516575:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171559552 00010000:00010000:2.0:1787857691.516587:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 14 pid: 5851 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.516603:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171559808 00000100:00100000:2.0:1787857691.516606:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171559808 00010000:00010000:2.0:1787857691.516616:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 15 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857691.516630:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 241 00000100:00100000:2.0:1787857691.516639:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:2350:x1874704171559680:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.516652:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.516658:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 15 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.516684:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 15 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.516703:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c52600/0xd3f183cab4a7b320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ab expref: 15 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.516720:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.516777:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:2350:x1874704171559680:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 138us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.516784:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 241 00000100:00100000:2.0:1787857691.516845:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 242 00000100:00100000:2.0:1787857691.516851:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171559552:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.516859:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.516863:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 13 pid: 5851 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.516872:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 13 pid: 5851 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517204:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b2 expref: 13 pid: 5851 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517214:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.517235:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:2350:x1874704171559552:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 384us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.517241:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 242 00000100:00100000:2.0:1787857691.517258:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 243 00000100:00100000:2.0:1787857691.517271:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:2350:x1874704171559808:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857691.517279:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857691.517284:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 11 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517293:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 11 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517303:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34a4 expref: 11 pid: 5849 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517313:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517322:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517338:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517345:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517352:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517358:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517364:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857691.517368:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517382:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517394:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857691.517406:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857691.517427:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+10:2350:x1874704171559808:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 157us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857691.517433:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 243 00010000:00010000:3.0:1787857691.518196:0:17815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.518209:0:17815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857691.518215:0:17815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999900ce7800/0xd3f183cab4a7b32e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857692.398213:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857693.038113:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188206080:0@lo:400:kworker.0 00000100:00100000:0.0:1787857693.038113:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188205952:0@lo:400:kworker.0 00000100:00100000:2.0:1787857693.038142:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188206336:0@lo:400:kworker.0 00000100:00100000:3.0:1787857693.038245:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188206208:0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.038386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857693.038459:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188206592:0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.038489:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857693.038516:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857693.038538:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188206464:0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.038564:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857693.038655:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188206592 00000100:00100000:1.0:1787857693.038741:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188206592 00000100:00100000:1.0:1787857693.038944:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787857693.038954:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188206592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.039011:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188206592:12345-0@lo:400:kworker.0 Request processed in 58us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.039019:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787857693.039337:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188206592:0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.039386:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188206080 00000100:00100000:1.0:1787857693.039390:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188206080 00000100:00100000:1.0:1787857693.039421:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188206464 00000100:00100000:1.0:1787857693.039424:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188206464 00000100:00100000:1.0:1787857693.039445:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787857693.039451:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188206080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.039880:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188206080:12345-0@lo:400:kworker.0 Request processed in 390us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.039888:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787857693.039902:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787857693.039909:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188206464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.039937:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188206464:12345-0@lo:400:kworker.0 Request processed in 30us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.039942:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787857693.039974:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188206464:0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.039986:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188206080:0@lo:400:kworker.0 00000100:00080000:1.0:1787857693.040053:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857693.040058:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857693.040347:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857693.040359:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857693.040422:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188206336 00000100:00100000:2.0:1787857693.040427:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188206336 00000100:00100000:2.0:1787857693.040469:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787857693.040476:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188206336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857693.040515:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188206336:12345-0@lo:400:kworker.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.040521:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1787857693.040538:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857693.040556:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188206336:0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.041216:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188205952 00000100:00100000:1.0:1787857693.041222:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188205952 00000100:00100000:1.0:1787857693.041254:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1787857693.041262:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:3302:x1874704188205952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.041568:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:3302:x1874704188205952:12345-0@lo:400:kworker.0 Request processed in 305us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.041576:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1787857693.042459:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188205952:0@lo:400:kworker.0 00000100:00100000:3.0:1787857693.042596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857693.042712:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188206208 00000100:00100000:1.0:1787857693.042719:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188206208 00000100:00100000:1.0:1787857693.042917:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787857693.042925:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188206208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857693.042973:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188206208:12345-0@lo:400:kworker.0 Request processed in 49us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.042979:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787857693.043197:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188206208:0@lo:400:kworker.0 00000100:00080000:2.0:1787857693.043261:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1787857693.103142:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787857693.103163:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9997c18ad800 from 52 10000000:01000000:3.0:1787857693.103169:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787857693.103234:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7800/0xd3f183cab4a7b335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.103246:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce7800/0xd3f183cab4a7b335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.103256:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce7800/0xd3f183cab4a7b335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857693.103286:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188206720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.103377:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.103433:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5bfd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787857693.104229:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188206720 00000100:00100000:1.0:1787857693.104239:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188206720 00000100:00100000:1.0:1787857693.104304:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1787857693.104314:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+12:5853:x1874704188206720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857693.104327:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857693.104343:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b33c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b335 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.104370:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b335 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.104382:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e95200/0xd3f183cab4a7b33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b335 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.104400:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95200, rc 0) 00000100:00100000:1.0:1787857693.104469:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188206720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.104476:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1787857693.105906:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188206720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857693.105934:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce7800/0xd3f183cab4a7b335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b33c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.105947:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce7800/0xd3f183cab4a7b335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b33c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857693.106054:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188206848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.106110:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.106171:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857693.106362:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188206848 00000100:00100000:1.0:1787857693.106369:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188206848 00000100:00100000:1.0:1787857693.106421:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1787857693.106430:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188206848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857693.107905:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188206848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1468us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.107917:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1787857693.108548:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188206848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.108608:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188206976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.108688:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.109111:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857693.109282:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188206976 00000100:00100000:1.0:1787857693.109288:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188206976 00000100:00100000:1.0:1787857693.109338:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1787857693.109346:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188206976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857693.109570:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188206976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.109578:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1787857693.109876:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188206976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.110362:0:17819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17819:1874704188207104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857693.110411:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.110543:0:17819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857693.113876:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188207104 00000100:00100000:2.0:1787857693.113893:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188207104 00000100:00100000:2.0:1787857693.113987:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1787857693.114689:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17819:x1874704188207104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857693.116210:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17819:x1874704188207104:12345-0@lo:502:llog_process_th.0 Request processed in 2205us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.116225:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1787857693.116392:0:17819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17819:1874704188207104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857693.116466:0:17819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17819:1874704188207232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857693.116517:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.116560:0:17819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857693.117498:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188207232 00000100:00100000:3.0:1787857693.117509:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188207232 00000100:00100000:3.0:1787857693.117573:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1787857693.117582:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17819:x1874704188207232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857693.117882:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:17819:x1874704188207232:12345-0@lo:502:llog_process_th.0 Request processed in 299us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.117889:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1787857693.118126:0:17819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17819:1874704188207232:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787857693.118172:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1787857693.118494:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1787857693.118518:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857693.118528:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7800/0xd3f183cab4a7b335 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b33c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.118540:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce7800/0xd3f183cab4a7b335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b33c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857693.118548:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787857693.118551:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787857693.118554:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787857693.118584:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.118592:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.118603:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857693.118635:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.118681:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.118734:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5bfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857693.119161:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188207360 00000100:00100000:2.0:1787857693.119167:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188207360 00000100:00100000:2.0:1787857693.119207:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1787857693.119216:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+13:5853:x1874704188207360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857693.119228:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857693.119242:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b34a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b343 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.119263:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b34a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b343 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.119273:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c53600/0xd3f183cab4a7b34a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b343 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.119282:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53600, rc 0) 00000100:00100000:2.0:1787857693.119446:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188207360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.119452:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1787857693.127713:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857693.128308:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b343 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b34a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.128324:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b343 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b34a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857693.128431:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.128500:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.128606:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787857693.134386:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188207488 00000100:00100000:1.0:1787857693.134404:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188207488 00000100:00100000:1.0:1787857693.134473:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1787857693.134484:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188207488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857693.134804:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188207488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (6304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.134810:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1787857693.135170:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.135228:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.135284:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.135323:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857693.135710:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188207616 00000100:00100000:2.0:1787857693.135716:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188207616 00000100:00100000:2.0:1787857693.135776:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1787857693.135795:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188207616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.136628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857693.136681:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188207616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 896us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.136699:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1787857693.136738:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171559936 00000100:00100000:2.0:1787857693.136743:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171559936 00000100:00100000:2.0:1787857693.136776:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 500 00000100:00100000:2.0:1787857693.136791:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+10:5605:x1874704171559936:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857693.136803:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857693.136841:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34b9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.136869:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b9 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.136879:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c52000/0xd3f183cab4a7b351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34b9 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.137013:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52000, rc 0) 00000100:00100000:2.0:1787857693.137128:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171559936:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 343us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.137135:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 500 00000100:00100000:0.0:1787857693.140138:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857693.147072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857693.147209:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171560064 00000100:00100000:1.0:1787857693.147221:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171560064 00000100:00100000:1.0:1787857693.147280:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 501 00000100:00100000:1.0:1787857693.147290:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171560064:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000040:00080000:0.0:1787857693.147472:0:17820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000100:00100000:1.0:1787857693.147598:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171560064:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 308us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.147608:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 501 00000020:01000000:2.0:1787857693.148055:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1787857693.148077:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787857693.148088:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b343 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b34a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.148098:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff999900ce7c00/0xd3f183cab4a7b343 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b34a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857693.148120:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787857693.148123:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9998dba2e800 from 52 10000000:01000000:2.0:1787857693.148126:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787857693.148165:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c52600/0xd3f183cab4a7b358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.148173:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c2c52600/0xd3f183cab4a7b358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.148183:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c2c52600/0xd3f183cab4a7b358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857693.148206:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857693.148254:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857693.148295:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857693.148452:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188207744 00000100:00100000:1.0:1787857693.148457:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188207744 00000100:00100000:1.0:1787857693.148493:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1787857693.148501:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+14:5853:x1874704188207744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857693.148511:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857693.148523:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b35f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b358 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.148543:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b358 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.148553:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e94000/0xd3f183cab4a7b35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b358 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.148561:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94000, rc 0) 00000100:00100000:1.0:1787857693.148747:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188207744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.148753:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1787857693.149568:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857693.149705:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c2c52600/0xd3f183cab4a7b358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b35f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.149715:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c2c52600/0xd3f183cab4a7b358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b35f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857693.150412:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857693.150473:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857693.152474:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857693.153141:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188207872 00000100:00100000:3.0:1787857693.153181:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188207872 00000100:00100000:3.0:1787857693.153241:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1787857693.153251:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188207872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.153585:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188207872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.153594:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1787857693.153938:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188207872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.153989:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.154054:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.154088:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857693.154205:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188208000 00000100:00100000:2.0:1787857693.154210:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188208000 00000100:00100000:2.0:1787857693.154245:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1787857693.154253:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188208000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857693.154413:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188208000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.154420:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1787857693.155622:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857693.157360:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857693.157485:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171560192 00000100:00100000:3.0:1787857693.157494:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171560192 00000100:00100000:3.0:1787857693.157592:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 505 00000100:00100000:3.0:1787857693.157603:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171560192:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.158167:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17821:1874704188208128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857693.158234:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.158282:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171560192:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 680us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.158291:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 505 00000100:00100000:3.0:1787857693.158492:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188208128 00000100:00100000:3.0:1787857693.158497:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188208128 00000100:00100000:3.0:1787857693.158525:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1787857693.158531:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17821:x1874704188208128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857693.166329:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857693.169272:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17821:x1874704188208128:12345-0@lo:502:llog_process_th.0 Request processed in 10729us (11026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.169287:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1787857693.172848:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857693.172909:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171560320 00000100:00100000:0.0:1787857693.172919:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171560320 00000100:00100000:0.0:1787857693.172969:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 507 00000100:00100000:0.0:1787857693.172979:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:23053:x1874704171560320:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857693.173130:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17821:1874704188208128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857693.173521:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:23053:x1874704171560320:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 543us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857693.173531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 507 00000100:00100000:2.0:1787857693.173844:0:17821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17821:1874704188208256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857693.173973:0:17821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857693.174010:0:17821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857693.174102:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188208256 00000100:00100000:0.0:1787857693.174108:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188208256 00000100:00100000:0.0:1787857693.174160:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1787857693.174167:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17821:x1874704188208256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857693.174621:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:17821:x1874704188208256:12345-0@lo:502:llog_process_th.0 Request processed in 453us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857693.174637:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1787857693.176195:0:17821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17821:1874704188208256:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787857693.176242:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1787857693.176507:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1787857693.176530:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857693.176541:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c2c52600/0xd3f183cab4a7b358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b35f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.176552:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c2c52600/0xd3f183cab4a7b358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b35f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857693.176562:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787857693.176565:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1787857693.176568:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787857693.176603:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.176611:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.176621:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857693.176640:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.176693:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.176747:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857693.177002:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188208384 00000100:00100000:1.0:1787857693.177020:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188208384 00000100:00100000:1.0:1787857693.177078:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1787857693.177089:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+15:5853:x1874704188208384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857693.177102:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857693.177115:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b36d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b366 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.177142:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b36d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b366 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.177163:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e95600/0xd3f183cab4a7b36d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b366 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.177173:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95600, rc 0) 00000100:00100000:1.0:1787857693.177406:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188208384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.177414:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1787857693.178456:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857693.178482:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b36d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.178514:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b36d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857693.178851:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857693.178902:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857693.178940:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857693.179021:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188208512 00000100:00100000:0.0:1787857693.179027:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188208512 00000100:00100000:0.0:1787857693.179071:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1787857693.179079:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188208512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.179379:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188208512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857693.179391:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1787857693.179616:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857693.179650:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857693.179691:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857693.179716:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc540 going to sleep for 11 seconds 00000100:00100000:1.0:1787857693.179763:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188208640 00000100:00100000:1.0:1787857693.179768:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188208640 00000100:00100000:1.0:1787857693.179810:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1787857693.179857:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188208640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857693.180022:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188208640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.180028:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1787857693.180240:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787857693.184695:0:17822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:0.0:1787857693.184963:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1787857693.184984:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787857693.184995:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b366 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b36d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.185007:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5400/0xd3f183cab4a7b366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b36d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857693.185016:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787857693.185019:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9998dbb32800 from 52 10000000:01000000:0.0:1787857693.185022:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787857693.185058:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5e00/0xd3f183cab4a7b374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.185067:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5e00/0xd3f183cab4a7b374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.185078:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5e00/0xd3f183cab4a7b374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857693.185119:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.185199:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.185243:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857693.185587:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188208768 00000100:00100000:3.0:1787857693.185595:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188208768 00000100:00100000:3.0:1787857693.185648:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1787857693.185669:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+16:5853:x1874704188208768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857693.185683:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857693.185697:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce6000/0xd3f183cab4a7b37b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b374 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.185723:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce6000/0xd3f183cab4a7b37b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b374 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.185735:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce6000/0xd3f183cab4a7b37b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b374 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.185745:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6000, rc 0) 00000100:00100000:3.0:1787857693.185798:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188208768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.185806:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1787857693.185899:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857693.185915:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5e00/0xd3f183cab4a7b374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b37b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.185923:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5e00/0xd3f183cab4a7b374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b37b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857693.185975:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.186000:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.186031:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857693.186668:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188208896 00000100:00100000:3.0:1787857693.186674:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188208896 00000100:00100000:3.0:1787857693.186709:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1787857693.186717:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188208896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.187974:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188208896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1250us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.187997:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1787857693.188137:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188208896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.188203:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188209024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.188249:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.188283:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857693.188955:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188209024 00000100:00100000:3.0:1787857693.188964:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188209024 00000100:00100000:3.0:1787857693.189010:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1787857693.189019:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188209024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.189223:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188209024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.189231:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1787857693.189265:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188209024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.191950:0:17823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17823:1874704188209152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857693.192034:0:17823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.192078:0:17823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5bfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857693.192195:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188209152 00000100:00100000:2.0:1787857693.192203:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188209152 00000100:00100000:2.0:1787857693.192254:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1787857693.192264:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17823:x1874704188209152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857693.192546:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17823:x1874704188209152:12345-0@lo:502:llog_process_th.0 Request processed in 283us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.192553:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1787857693.195394:0:17823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17823:1874704188209152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857693.195485:0:17823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17823:1874704188209280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857693.195543:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857693.195557:0:17823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.196055:0:17823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c3b22840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857693.198057:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171560448 00000100:00100000:0.0:1787857693.198071:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171560448 00000100:00100000:0.0:1787857693.198514:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188209280 00000100:00100000:0.0:1787857693.198519:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188209280 00000100:00100000:1.0:1787857693.198585:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 516 00000100:00100000:1.0:1787857693.198599:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:23053:x1874704171560448:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857693.198882:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1787857693.198894:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17823:x1874704188209280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857693.199237:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:17823:x1874704188209280:12345-0@lo:502:llog_process_th.0 Request processed in 345us (3680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.199246:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1787857693.199392:0:17823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17823:1874704188209280:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787857693.199434:0:17823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000100:00100000:1.0:1787857693.199476:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:23053:x1874704171560448:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 878us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.199485:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 516 00000020:01000000:1.0:1787857693.200077:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1787857693.200099:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787857693.200109:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5e00/0xd3f183cab4a7b374 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b37b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.200120:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5e00/0xd3f183cab4a7b374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b37b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857693.200129:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787857693.200132:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:1.0:1787857693.200135:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787857693.200175:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.200193:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.200204:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857693.200225:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188209408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857693.200266:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857693.200303:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857693.200501:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188209408 00000100:00100000:2.0:1787857693.200506:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188209408 00000100:00100000:2.0:1787857693.200546:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1787857693.200553:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+17:5853:x1874704188209408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857693.200563:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857693.200575:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b382 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.200596:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b382 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.200606:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c2c53a00/0xd3f183cab4a7b389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b382 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857693.200689:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53a00, rc 0) 00000100:00100000:3.0:1787857693.200970:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188209408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857693.200984:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b389 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.200993:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b389 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857693.201059:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188209536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.201219:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.201251:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5bfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857693.201295:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188209536 00000100:00100000:0.0:1787857693.201299:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188209536 00000100:00100000:0.0:1787857693.201320:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1787857693.201333:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188209536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.201578:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188209536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857693.201585:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1787857693.201717:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188209536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.201761:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188209664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.201798:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.201835:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5bfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857693.202042:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188209664 00000100:00100000:0.0:1787857693.202046:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188209664 00000100:00100000:0.0:1787857693.202065:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1787857693.202070:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188209664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.202229:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188209664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857693.202237:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1787857693.202400:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188209664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.203088:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17824:1874704188209792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857693.203234:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.203261:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5bfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857693.203331:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188209792 00000100:00100000:0.0:1787857693.203337:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188209792 00000100:00100000:0.0:1787857693.203370:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1787857693.203378:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:17824:x1874704188209792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857693.203587:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:17824:x1874704188209792:12345-0@lo:502:llog_process_th.0 Request processed in 210us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857693.203595:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1787857693.204402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857693.204508:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171560576 00000100:00100000:3.0:1787857693.204513:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171560576 00000100:00100000:3.0:1787857693.204541:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 522 00000100:00100000:3.0:1787857693.204549:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+11:5605:x1874704171560576:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857693.204561:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857693.204578:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b390 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.204606:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34c0 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.204846:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce7000/0xd3f183cab4a7b390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34c0 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.204871:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7000, rc 0) 00000100:00100000:3.0:1787857693.205071:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171560576:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 522us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.205079:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 522 00000100:00100000:3.0:1787857693.205127:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17824:1874704188209792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857693.205172:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787857693.205191:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857693.205194:0:17824:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre-MDT0000-m del lustre.test_11c 00000020:00000080:3.0:1787857693.205200:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1787857693.209894:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188209408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 9332us (9619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857693.209906:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1787857693.210421:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17824:1874704188209920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857693.210547:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.210646:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c788f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857693.211546:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188209920 00000100:00100000:1.0:1787857693.211565:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188209920 00000100:00100000:1.0:1787857693.211947:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1787857693.211960:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17824:x1874704188209920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857693.212275:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:17824:x1874704188209920:12345-0@lo:502:llog_process_th.0 Request processed in 316us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.212282:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1787857693.212546:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e19aa925-029c-4b3f-9a96-6d2fc52887f3:17824:1874704188209920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857693.212579:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857693.212587:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857693.212590:0:17824:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre-MDT0000-m del lustre.test_11c 00000040:00080000:3.0:1787857693.212594:0:17824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:0.0:1787857693.213127:0:5853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:0.0:1787857693.213158:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787857693.213169:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b382 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b389 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.213310:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9998f8e95800/0xd3f183cab4a7b382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b389 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857693.213322:0:5853:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787857693.213337:0:5853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9998c56d8000 from 1 10000000:01000000:0.0:1787857693.213340:0:5853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787857693.213376:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5000/0xd3f183cab4a7b397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.213386:0:5853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5000/0xd3f183cab4a7b397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857693.213396:0:5853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5000/0xd3f183cab4a7b397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857693.213419:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188210048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.213469:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857693.213515:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d0946780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857693.213573:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188210048 00000100:00100000:3.0:1787857693.213579:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188210048 00000100:00100000:3.0:1787857693.213625:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1787857693.213634:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+18:5853:x1874704188210048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857693.213645:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857693.213657:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b39e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3f183cab4a7b397 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.213679:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd3f183cab4a7b397 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.213697:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999900ce7200/0xd3f183cab4a7b39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd3f183cab4a7b397 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.213706:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7200, rc 0) 00000100:00100000:3.0:1787857693.213757:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188210048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.213763:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1787857693.213798:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188210048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857693.213809:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5000/0xd3f183cab4a7b397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b39e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.213837:0:5853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5000/0xd3f183cab4a7b397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd3f183cab4a7b39e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857693.213885:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188210176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.213909:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.213923:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857693.213937:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188210176 00000100:00100000:3.0:1787857693.213940:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188210176 00000100:00100000:3.0:1787857693.213956:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1787857693.213961:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188210176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.214192:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:5853:x1874704188210176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (281us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857693.214199:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1787857693.214228:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e19aa925-029c-4b3f-9a96-6d2fc52887f3:5853:1874704188210176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787857693.214255:0:5853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787857693.214260:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5000/0xd3f183cab4a7b397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b39e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857693.214268:0:5853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9997c3bc5000/0xd3f183cab4a7b397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd3f183cab4a7b39e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857693.215197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857693.215296:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171560704 00000100:00100000:0.0:1787857693.215301:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171560704 00000100:00100000:0.0:1787857693.215342:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 526 00000100:00100000:0.0:1787857693.215360:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171560704:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857693.215578:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171560704:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 228us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857693.215586:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 526 00000100:00100000:1.0:1787857693.219505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857693.219580:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171560832 00000100:00100000:3.0:1787857693.219590:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171560832 00000100:00100000:3.0:1787857693.219655:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 527 00000100:00100000:3.0:1787857693.219665:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171560832:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.219966:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171560832:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 302us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.219973:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 527 00000100:00100000:2.0:1787857693.225985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857693.226454:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171560960 00000100:00100000:1.0:1787857693.226465:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171560960 00000100:00100000:1.0:1787857693.226525:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 528 00000100:00100000:1.0:1787857693.226535:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:23054:x1874704171560960:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787857693.226921:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:23054:x1874704171560960:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 386us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.226929:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 528 00000100:00100000:2.0:1787857693.229647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857693.229720:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171561088 00000100:00100000:0.0:1787857693.229737:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171561088 00000100:00100000:0.0:1787857693.229798:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 529 00000100:00100000:0.0:1787857693.229808:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:23054:x1874704171561088:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857693.230086:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:23054:x1874704171561088:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 279us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857693.230095:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 529 00000100:00100000:2.0:1787857693.236670:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857693.236740:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171561216 00000100:00100000:1.0:1787857693.236751:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171561216 00000100:00100000:1.0:1787857693.236807:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 530 00000100:00100000:1.0:1787857693.236857:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+12:5605:x1874704171561216:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857693.236875:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857693.236902:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998f8e94200/0xd3f183cab4a7b3a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.236930:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998f8e94200/0xd3f183cab4a7b3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34c7 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.236940:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998f8e94200/0xd3f183cab4a7b3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34c7 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857693.236965:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94200, rc 0) 00000100:00100000:1.0:1787857693.237016:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171561216:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 201us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857693.237022:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 530 00000100:00100000:2.0:1787857693.241359:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857693.241439:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171561344 00000100:00100000:3.0:1787857693.241450:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171561344 00000100:00100000:3.0:1787857693.241505:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 531 00000100:00100000:3.0:1787857693.241515:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171561344:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857693.241866:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:5605:x1874704171561344:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 351us (515us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857693.241875:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 531 00010000:00010000:2.0:1787857693.423378:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857693.551459:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857693.551483:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188210304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857693.551553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857693.551758:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188210304 00000100:00100000:3.0:1787857693.551767:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188210304 00000100:00100000:3.0:1787857693.551876:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787857693.551886:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188210304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857693.551922:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857693.551982:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188210304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857693.551989:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787857693.552132:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188210304:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787857693.806268:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857693.806278:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857693.806807:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857693.806860:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857694.448738:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857694.804745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857694.804859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857694.804886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857694.804917:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857694.804942:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857694.805100:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171561600 00000100:00100000:3.0:1787857694.805110:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171561600 00000100:00100000:3.0:1787857694.805209:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 328 00000100:00100000:3.0:1787857694.805221:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:2348:x1874704171561600:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857694.805312:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:2348:x1874704171561600:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 93us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857694.805319:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 328 00000100:00100000:1.0:1787857694.805572:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171561728 00000100:00100000:1.0:1787857694.805578:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171561728 00000100:00100000:1.0:1787857694.805629:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171561856 00000100:00100000:1.0:1787857694.805633:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171561856 00000100:00100000:1.0:1787857694.805655:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171562112 00000100:00100000:1.0:1787857694.805658:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171562112 00000100:00100000:1.0:1787857694.805677:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 300 00000100:00100000:1.0:1787857694.805684:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171561728:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857694.805719:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171561728:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (902us total) trans 0 rc 0/0 00000100:00080000:2.0:1787857694.805721:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857694.805727:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857694.805728:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 300 00000100:00080000:2.0:1787857694.805732:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857694.805747:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 301 00000100:00100000:1.0:1787857694.805754:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171561856:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857694.805779:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171561856:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857694.805786:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 301 00000100:00100000:1.0:1787857694.805807:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 302 00000100:00100000:1.0:1787857694.805813:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171562112:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857694.805861:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171562112:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 49us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857694.805867:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 302 00000100:00100000:0.0:1787857694.806220:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171561472 00000100:00100000:0.0:1787857694.806225:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171561472 00000100:00100000:0.0:1787857694.806266:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 532 00000100:00100000:0.0:1787857694.806274:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171561472:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857694.806316:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171561472:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 44us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857694.806324:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 532 00000100:00100000:2.0:1787857694.812297:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857694.812341:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857694.812720:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171561984 00000100:00100000:1.0:1787857694.812730:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171561984 00000100:00100000:3.0:1787857694.812888:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171562240 00000100:00100000:3.0:1787857694.812899:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171562240 00000100:00100000:3.0:1787857694.812939:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 303 00000100:00100000:3.0:1787857694.812948:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171562240:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857694.813014:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171562240:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 68us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857694.813021:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 303 00000100:00080000:2.0:1787857694.814719:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857694.814731:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857694.815329:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 329 00000100:00100000:1.0:1787857694.815348:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2347:x1874704171561984:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857694.815442:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:2347:x1874704171561984:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 101us (3155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857694.815450:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 329 00010000:00010000:0.0:1787857695.470501:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857695.982553:0:17873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 15:08:13 (1787857693) 00010000:00010000:2.0:1787857696.495371:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857696.542441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857696.542648:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171562496 00000100:00100000:3.0:1787857696.542659:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171562496 00000100:00100000:3.0:1787857696.542738:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 746 00000100:00100000:3.0:1787857696.542748:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:23246:x1874704171562496:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857696.542769:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857696.542789:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b3ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34ce expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787857696.543120:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857696.543571:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b3b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.543588:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.543600:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857696.543611:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787857696.543912:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b3ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ce expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.543930:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5200/0xd3f183cab4a7b3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ce expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.543941:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:0.0:1787857696.543951:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787857696.543956:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5200, rc 0) 00000100:00100000:0.0:1787857696.544252:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:23246:x1874704171562496:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1503us (1820us total) trans 4294967788 rc 0/0 00000100:00100000:0.0:1787857696.544263:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 746 00000100:00100000:2.0:1787857696.558729:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857696.558853:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171562624 00000100:00100000:0.0:1787857696.558864:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171562624 00000100:00100000:0.0:1787857696.558929:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 747 00000100:00100000:0.0:1787857696.558940:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:23246:x1874704171562624:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857696.559070:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:23246:x1874704171562624:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 132us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857696.559078:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 747 00000100:00100000:2.0:1787857696.585112:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857696.588389:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171562752 00000100:00100000:0.0:1787857696.588406:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171562752 00000100:00100000:0.0:1787857696.588563:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 748 00000100:00100000:0.0:1787857696.588574:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:23247:x1874704171562752:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857696.588596:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857696.588618:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34d5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.588701:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.588716:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.588727:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.588765:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.588777:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.588784:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589112:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589121:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589127:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589133:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857696.589136:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589148:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589160:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9f00) 00010000:00010000:0.0:1787857696.589163:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857696.589167:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589174:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589194:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589200:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589207:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589212:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857696.589412:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589420:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589433:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff9998d5316300) 00010000:00010000:0.0:1787857696.589436:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857696.589439:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589445:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589480:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34d5 expref: 75 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589490:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9f00) 00010000:00010000:0.0:1787857696.589492:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857696.589503:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34d5 expref: 75 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.589514:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5600, rc 0) 00000100:00100000:0.0:1787857696.589585:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:23247:x1874704171562752:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1012us (4484us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857696.589593:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 748 00000100:00080000:2.0:1787857696.590250:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857696.603612:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857696.603987:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171563008 00000100:00100000:0.0:1787857696.603998:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171563008 00000100:00100000:0.0:1787857696.604261:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 749 00000100:00100000:0.0:1787857696.604272:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+74:23247:x1874704171563008:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1787857696.604329:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857696.604357:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd347a expref: 74 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.604378:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9f00) 00010000:00010000:0.0:1787857696.604394:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857696.604704:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.604720:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.604731:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.604768:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857696.604810:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 32 pid: 5856 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857696.604892:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188210432:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857696.605000:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857696.609564:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188210432:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857696.609597:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857696.621226:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857696.621667:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171563136 00000100:00100000:3.0:1787857696.621679:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171563136 00010000:00010000:3.0:1787857696.621727:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 33 pid: 5856 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857696.621772:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 244 00000100:00100000:3.0:1787857696.621792:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:2350:x1874704171563136:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857696.621808:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857696.621847:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 33 pid: 5856 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857696.621862:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 33 pid: 5856 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857696.621886:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b25c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3488 expref: 33 pid: 5856 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857696.621903:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9f00) 00010000:00010000:3.0:1787857696.621909:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857696.621918:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857696.621926:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857696.621976:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857696.622200:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.622209:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.622235:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.622246:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.622254:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857696.624256:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00010000:00010000:1.0:1787857696.624277:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.624296:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.624303:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.624309:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857696.624314:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.624322:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.624341:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9f00) 00010000:00010000:1.0:1787857696.624345:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857696.624350:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.624356:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b3d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857696.624585:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:2350:x1874704171563136:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2798us (3360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857696.624597:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 244 00000004:00010000:1.0:1787857696.625236:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065766041 reply state 000000009264ae1a transno 4294967789 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857696.625248:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857696.625340:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+75:23247:x1874704171563008:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 21070us (21738us total) trans 4294967789 rc 0/0 00000100:00100000:1.0:1787857696.625349:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 749 00000100:00100000:0.0:1787857696.626253:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188210560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857696.626319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857696.627030:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188210560 00000100:00100000:3.0:1787857696.627040:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188210560 00000100:00100000:3.0:1787857696.627240:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787857696.627251:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188210560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857696.627289:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857696.627352:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188210560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857696.627359:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1787857696.627628:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857696.627710:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188210560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857696.654368:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.654415:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.654424:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.654431:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857696.654437:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.654446:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.654462:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff9998c3984600) 00010000:00010000:1.0:1787857696.654466:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857696.654471:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857696.654478:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b3dd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857696.776073:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967788 is committed 00000001:00080000:0.0:1787857696.776101:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967789 is committed 00000040:00080000:3.0:1787857696.878475:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857696.878486:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857696.880168:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857696.880189:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857697.213016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857697.213539:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171563264 00000100:00100000:0.0:1787857697.213549:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171563264 00000100:00100000:0.0:1787857697.213616:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 750 00000100:00100000:0.0:1787857697.213625:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+73:23284:x1874704171563264:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787857697.213651:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857697.213676:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34dc expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.213741:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.213755:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.213795:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857697.214028:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857697.214032:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857697.214123:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.214148:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b3e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34dc expref: 75 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.214165:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34dc expref: 74 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.214174:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316b00) 00010000:00010000:0.0:1787857697.214177:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857697.214181:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857697.214246:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:23284:x1874704171563264:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 623us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857697.214254:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 750 00000100:00100000:2.0:1787857697.217181:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.217287:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171563520 00000100:00100000:1.0:1787857697.217306:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171563520 00000100:00100000:1.0:1787857697.217379:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 751 00000100:00100000:1.0:1787857697.217390:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+74:23284:x1874704171563520:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:1.0:1787857697.217447:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857697.217474:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b3eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34dc expref: 74 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.217513:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316b00) 00010000:00010000:1.0:1787857697.217522:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857697.218418:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+73:23284:x1874704171563520:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 1026us (1242us total) trans 0 rc -17/-17 00000100:00100000:1.0:1787857697.218428:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 751 00000100:00100000:3.0:1787857697.222162:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857697.222276:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171563648 00000100:00100000:0.0:1787857697.222285:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171563648 00000100:00100000:0.0:1787857697.222358:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 752 00000100:00100000:0.0:1787857697.222379:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+73:23284:x1874704171563648:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787857697.222399:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857697.222423:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34e3 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.222516:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b3f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.222530:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.222541:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857697.222740:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857697.222745:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857697.222863:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.222891:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34e3 expref: 75 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.222909:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34e3 expref: 74 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.222917:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857697.222920:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857697.222924:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857697.222985:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+74:23284:x1874704171563648:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 617us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857697.222992:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 752 00000100:00100000:3.0:1787857697.228504:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857697.228710:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171563776 00000100:00100000:0.0:1787857697.228721:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171563776 00000100:00100000:0.0:1787857697.228800:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 753 00000100:00100000:0.0:1787857697.228810:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+74:23284:x1874704171563776:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787857697.228851:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857697.228872:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34ea expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.228945:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.228960:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.228972:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.228989:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.228996:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.229002:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230584:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230604:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230614:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857697.230725:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 7680 00000004:00200000:0.0:1787857697.230729:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857697.230812:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230854:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230860:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230867:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230873:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857697.230890:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230897:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230910:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857697.230913:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857697.230917:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230924:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230936:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230951:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230957:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230962:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857697.230965:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230971:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230979:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff9998d5316c00) 00010000:00010000:0.0:1787857697.230982:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857697.230984:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.230990:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b40e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.231027:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ea expref: 76 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.231040:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ea expref: 75 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.231048:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316900) 00010000:00010000:0.0:1787857697.231050:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857697.231058:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4000, rc 0) 00000100:00100000:0.0:1787857697.231145:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+75:23284:x1874704171563776:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 2334us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857697.231154:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 753 00000100:00100000:3.0:1787857697.317049:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857697.321852:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171563904 00000100:00100000:0.0:1787857697.321868:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171563904 00000100:00100000:0.0:1787857697.322019:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 754 00000100:00100000:0.0:1787857697.322031:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+31:23290:x1874704171563904:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857697.322052:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857697.322084:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b41c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34f1 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.322156:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.322171:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.322183:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857697.322430:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857697.322435:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857697.322508:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.322535:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b41c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.322553:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.322569:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857697.322573:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857697.322577:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5600, rc 0) 00000100:00100000:0.0:1787857697.322660:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:23290:x1874704171563904:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 632us (5623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857697.322668:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 754 00000100:00100000:3.0:1787857697.330695:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.330791:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171564160 00000100:00100000:1.0:1787857697.330801:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171564160 00000100:00100000:1.0:1787857697.330906:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 755 00000100:00100000:1.0:1787857697.330916:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:23290:x1874704171564160:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857697.330937:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857697.330940:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787857697.330966:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ea expref: 75 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.330985:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316900) 00010000:00010000:1.0:1787857697.330995:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857697.331011:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b42a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34f8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.331361:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.331374:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.331385:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.331460:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.331468:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.331475:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332438:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332452:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332461:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857697.332472:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00010000:00010000:1.0:1787857697.332498:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332511:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332517:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332523:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857697.332527:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332546:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332558:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998c3984600) 00010000:00010000:1.0:1787857697.332561:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857697.332565:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332571:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b431 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857697.332583:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b19a4fb6 reply state 0000000078a5d1d9 transno 4294967790 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857697.332593:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857697.332624:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b42a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 77 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332643:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 76 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.332649:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857697.332651:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857697.332653:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94c00, rc 0) 00000100:00100000:1.0:1787857697.332734:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+77:23290:x1874704171564160:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1819us (2052us total) trans 4294967790 rc 0/0 00000100:00100000:1.0:1787857697.332742:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 755 00010000:00010000:2.0:1787857697.348147:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.348167:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.348174:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.348179:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857697.348214:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.348222:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.348238:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff9998c3984a00) 00010000:00010000:2.0:1787857697.348242:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857697.348246:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.348253:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b438 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857697.360513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.361007:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171564416 00000100:00100000:1.0:1787857697.361030:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171564416 00000100:00100000:1.0:1787857697.361099:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 756 00000100:00100000:1.0:1787857697.361110:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+76:23290:x1874704171564416:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857697.361132:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857697.361154:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b44d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd34ff expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.361260:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.361275:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 77 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.361285:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.361321:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 77 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.361334:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 77 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857697.361348:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188210688:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857697.361451:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857697.366651:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188210688:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857697.366690:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857697.370738:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857697.370909:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171564544 00000100:00100000:2.0:1787857697.370920:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171564544 00010000:00010000:2.0:1787857697.370965:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 78 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857697.371007:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 245 00000100:00100000:2.0:1787857697.371017:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+78:2350:x1874704171564544:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857697.371032:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857697.371039:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 78 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.371053:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 78 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.371086:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b43f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f8 expref: 78 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.371123:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984400) 00010000:00010000:2.0:1787857697.371129:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.371138:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.371146:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.371180:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857697.371241:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+77:2350:x1874704171564544:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 225us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857697.371249:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 245 00010000:00010000:1.0:1787857697.371392:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371401:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857697.371420:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00010000:00010000:1.0:1787857697.371696:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371705:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371711:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371716:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857697.371721:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371728:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371739:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857697.371742:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857697.371745:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371751:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b454 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371888:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b44d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ff expref: 77 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371899:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998c3984600) 00010000:00010000:1.0:1787857697.371902:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857697.371905:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b44d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34ff expref: 77 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.371918:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95c00, rc 0) 00000100:00100000:1.0:1787857697.371955:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+76:23290:x1874704171564416:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 10848us (11454us total) trans 4294967791 rc 301/301 00000100:00100000:1.0:1787857697.371963:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 756 00000100:00100000:3.0:1787857697.375138:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.375313:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171564800 00000100:00100000:1.0:1787857697.375323:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171564800 00000100:00100000:1.0:1787857697.375383:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 154 00000100:00100000:1.0:1787857697.375393:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+76:23290:x1874704171564800:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857697.375791:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+77:23290:x1874704171564800:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 398us (660us total) trans 4294967792 rc 0/0 00000100:00100000:1.0:1787857697.375799:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 154 00000100:00100000:3.0:1787857697.382241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.382375:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171564928 00000100:00100000:1.0:1787857697.382385:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171564928 00000100:00100000:1.0:1787857697.382447:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 757 00000100:00100000:1.0:1787857697.382458:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+77:23290:x1874704171564928:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857697.382485:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857697.382511:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3506 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.382580:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 78 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.382597:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 78 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.382616:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:1.0:1787857697.382619:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857697.382623:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95c00, rc 0) 00000100:00100000:1.0:1787857697.382686:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+78:23290:x1874704171564928:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 230us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857697.382693:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 757 00000100:00100000:2.0:1787857697.390326:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857697.390432:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171565184 00000100:00100000:0.0:1787857697.390445:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171565184 00000100:00100000:0.0:1787857697.390510:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 758 00000100:00100000:0.0:1787857697.390520:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+78:23290:x1874704171565184:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787857697.390588:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.390605:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.390617:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.391089:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.391098:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.391105:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.391127:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857697.391131:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.391139:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.391151:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:0.0:1787857697.391154:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787857697.391158:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.391165:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b469 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857697.391239:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+79:23290:x1874704171565184:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 719us (923us total) trans 4294967793 rc 0/0 00000100:00100000:0.0:1787857697.391247:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 758 00000100:00100000:3.0:1787857697.401342:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.401432:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171565440 00000100:00100000:1.0:1787857697.401441:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171565440 00000100:00100000:1.0:1787857697.401504:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 759 00000100:00100000:1.0:1787857697.401513:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+79:23290:x1874704171565440:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857697.401845:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.401865:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.401878:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857697.401946:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967794 00000004:00010000:1.0:1787857697.401983:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb05b69b reply state 000000003c81d7e5 transno 4294967795 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857697.402006:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857697.402104:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:23290:x1874704171565440:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 590us (771us total) trans 4294967795 rc 0/0 00000100:00100000:1.0:1787857697.402111:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 759 00000020:00080000:1.0:1787857697.402117:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787857697.404241:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.404258:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.404266:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.404272:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857697.404277:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.404285:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.404302:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:1.0:1787857697.404306:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857697.404311:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.404318:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857697.404598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.404898:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171565696 00000100:00100000:1.0:1787857697.404920:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171565696 00000100:00100000:1.0:1787857697.404969:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 155 00000100:00100000:1.0:1787857697.404977:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c5af0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+81:23290:x1874704171565696:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857697.405257:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c5af0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:23290:x1874704171565696:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 279us (663us total) trans 4294967796 rc 0/0 00000100:00100000:1.0:1787857697.405265:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 155 00000100:00100000:3.0:1787857697.470451:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857697.470557:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171565824 00000100:00100000:0.0:1787857697.470569:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171565824 00000100:00100000:0.0:1787857697.470638:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 760 00000100:00100000:0.0:1787857697.470648:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+32:23293:x1874704171565824:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857697.470668:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857697.470688:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd350d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.470775:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.470809:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.470858:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.470874:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.470894:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.470900:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471229:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b48c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471238:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471246:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857697.471274:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 7680 00000004:00200000:0.0:1787857697.471277:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857697.471298:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471310:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471327:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471333:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471340:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857697.471344:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471352:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471363:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857697.471366:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857697.471371:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471377:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b47e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471390:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471396:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471402:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471408:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857697.471417:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471423:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471431:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff9998d5316c00) 00010000:00010000:0.0:1787857697.471434:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857697.471436:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471442:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471471:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd350d expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471485:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5c00/0xd3f183cab4a7b48c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd350d expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.471498:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316400) 00010000:00010000:0.0:1787857697.471500:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857697.471502:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5c00, rc 0) 00000100:00100000:0.0:1787857697.471626:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:23293:x1874704171565824:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 978us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857697.471633:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 760 00000100:00100000:2.0:1787857697.489460:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.495740:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171566080 00000100:00100000:1.0:1787857697.495767:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171566080 00000100:00100000:1.0:1787857697.495863:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 761 00000100:00100000:1.0:1787857697.495875:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:23293:x1874704171566080:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857697.495905:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857697.495929:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b493 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3514 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496007:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496021:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496031:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496046:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496054:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496060:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496213:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b4a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496222:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496229:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857697.496239:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:1.0:1787857697.496356:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496363:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496371:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496378:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857697.496382:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496389:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496402:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316400) 00010000:00010000:1.0:1787857697.496405:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857697.496410:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496427:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b49a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496441:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496448:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496453:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496457:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857697.496459:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496465:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496472:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff9998c3984400) 00010000:00010000:1.0:1787857697.496474:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857697.496477:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496482:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496523:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b493 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3514 expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496549:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3514 expref: 35 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.496556:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:1.0:1787857697.496559:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857697.496561:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94800, rc 0) 00000100:00100000:1.0:1787857697.496649:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23293:x1874704171566080:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 775us (7201us total) trans 4294967797 rc 0/0 00000100:00100000:1.0:1787857697.496658:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 761 00000100:00100000:3.0:1787857697.511231:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857697.511341:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171566208 00000100:00100000:0.0:1787857697.511352:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171566208 00000100:00100000:0.0:1787857697.511420:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 762 00000100:00100000:0.0:1787857697.511431:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23293:x1874704171566208:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:0.0:1787857697.511514:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511543:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511556:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511585:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511592:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511599:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511607:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857697.511611:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511619:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511631:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:0.0:1787857697.511634:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857697.511640:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857697.511646:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b4b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857697.511737:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23293:x1874704171566208:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 308us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857697.511745:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 762 00000100:00100000:3.0:1787857697.517621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.517787:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171566464 00000100:00100000:1.0:1787857697.517797:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171566464 00000100:00100000:1.0:1787857697.517898:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 156 00000100:00100000:1.0:1787857697.517908:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23293:x1874704171566464:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1787857697.518286:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23293:x1874704171566464:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 377us (674us total) trans 4294967798 rc 0/0 00000100:00100000:1.0:1787857697.518294:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 156 00010000:00010000:2.0:1787857697.524311:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857697.639121:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.639223:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171566592 00000100:00100000:1.0:1787857697.639235:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171566592 00000100:00100000:1.0:1787857697.639304:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 763 00000100:00100000:1.0:1787857697.639316:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23301:x1874704171566592:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857697.639344:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857697.639367:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b4bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd351b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.639440:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.639469:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.639482:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857697.639547:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 7680 00000004:00200000:1.0:1787857697.639551:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857697.639573:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.639600:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b4bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd351b expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.639618:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd351b expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857697.639627:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316400) 00010000:00010000:1.0:1787857697.639630:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857697.639634:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94c00, rc 0) 00000100:00100000:1.0:1787857697.639699:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23301:x1874704171566592:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 384us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857697.639707:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 763 00000100:00100000:2.0:1787857697.646590:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857697.646676:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171566848 00000100:00100000:3.0:1787857697.646686:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171566848 00000100:00100000:3.0:1787857697.646748:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:3.0:1787857697.646757:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23301:x1874704171566848:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:3.0:1787857697.646785:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857697.646812:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b4a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3514 expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857697.646849:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:3.0:1787857697.646854:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857697.646921:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23301:x1874704171566848:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 165us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857697.646929:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:1.0:1787857697.649812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857697.650012:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171566976 00000100:00100000:3.0:1787857697.650022:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171566976 00000100:00100000:3.0:1787857697.650086:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 764 00000100:00100000:3.0:1787857697.650096:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23301:x1874704171566976:12345-192.168.204.36@tcp:58:lfs.0 00010000:00010000:3.0:1787857697.650191:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857697.650210:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857697.650237:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857697.650272:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857697.650286:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 81 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857697.650300:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188210816:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857697.650400:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857697.653404:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188210816:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857697.653436:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857697.654862:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857697.655378:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171567104 00000100:00100000:2.0:1787857697.655387:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171567104 00010000:00010000:2.0:1787857697.655429:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 82 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857697.655477:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 246 00000100:00100000:2.0:1787857697.655486:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+82:2350:x1874704171567104:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857697.655502:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857697.655523:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 82 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.655536:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 82 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.655559:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b462 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3506 expref: 82 pid: 5856 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.655574:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:2.0:1787857697.655580:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.655590:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.655598:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.655630:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857697.655694:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+81:2350:x1874704171567104:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 207us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857697.655702:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 246 00010000:00010000:3.0:1787857697.655871:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857697.655880:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857697.656128:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 136 off10640 00000100:00100000:3.0:1787857697.656191:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23301:x1874704171566976:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 6096us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857697.656200:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 764 00000040:00080000:1.0:1787857697.911181:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857697.911192:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857697.911230:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:1.0:1787857697.911250:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857697.911387:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188210944:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857697.911489:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857697.922401:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188210944:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857697.937678:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857697.937875:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171567232 00000100:00100000:3.0:1787857697.937887:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171567232 00000100:00100000:3.0:1787857697.937958:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 765 00000100:00100000:3.0:1787857697.937970:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23311:x1874704171567232:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857697.938007:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857697.938130:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23311:x1874704171567232:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 162us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857697.938138:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 765 00000100:00100000:1.0:1787857697.954348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857697.954906:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171567360 00000100:00100000:2.0:1787857697.954917:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171567360 00000100:00100000:2.0:1787857697.954984:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 766 00000100:00100000:2.0:1787857697.954995:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23311:x1874704171567360:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787857697.955077:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955107:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955121:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955137:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955145:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955151:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955177:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955184:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955190:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857697.955228:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00000004:00200000:2.0:1787857697.955232:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857697.955245:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955256:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.955272:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956637:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956650:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857697.956656:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956665:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956680:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857697.956684:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857697.956688:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956695:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b4d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956711:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956718:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956724:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956728:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857697.956744:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956751:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956767:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x43be2ce7 (ffff9998e18d9400) 00010000:00010000:2.0:1787857697.956770:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857697.956773:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956780:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956797:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956803:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956809:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956835:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857697.956839:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956846:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956853:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:2.0:1787857697.956856:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857697.956864:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.956871:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857697.956957:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23311:x1874704171567360:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 1961us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857697.956967:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 766 00000100:00100000:0.0:1787857697.980022:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857697.981972:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171567616 00000100:00100000:2.0:1787857697.981989:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171567616 00000100:00100000:2.0:1787857697.982075:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 767 00000100:00100000:2.0:1787857697.982085:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23311:x1874704171567616:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857697.982104:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857697.982123:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3522 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982227:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982242:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982253:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857697.982265:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:2.0:1787857697.982387:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982395:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982415:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982421:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857697.982425:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982433:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982446:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:2.0:1787857697.982448:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857697.982454:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982459:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52c00/0xd3f183cab4a7b4ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982503:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3522 expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982513:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857697.982515:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857697.982519:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b4e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3522 expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857697.982540:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52400, rc 0) 00000100:00100000:2.0:1787857697.982611:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23311:x1874704171567616:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 527us (2599us total) trans 4294967799 rc 301/301 00000100:00100000:2.0:1787857697.982628:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 767 00000100:00100000:2.0:1787857697.994124:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857697.994427:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171567744 00000100:00100000:1.0:1787857697.994437:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171567744 00000100:00100000:1.0:1787857697.994606:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 768 00000100:00100000:1.0:1787857697.994619:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23311:x1874704171567744:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857697.994661:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857697.994799:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23311:x1874704171567744:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 182us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857697.994806:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 768 00000100:00100000:1.0:1787857698.001808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857698.001882:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171568000 00000100:00100000:1.0:1787857698.001891:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171568000 00000100:00100000:1.0:1787857698.001961:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 769 00000100:00100000:1.0:1787857698.001972:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23311:x1874704171568000:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857698.001993:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857698.001997:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787857698.002027:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b4c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd351b expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.002046:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316400) 00010000:00010000:1.0:1787857698.002053:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857698.002077:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b4fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3529 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857698.004796:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:1.0:1787857698.006252:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b503 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.006272:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.006348:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.006468:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b4fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3529 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.006486:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3529 expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.006495:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857698.006498:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857698.006500:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94800, rc 0) 00000100:00100000:1.0:1787857698.008050:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23311:x1874704171568000:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6071us (6244us total) trans 4294967800 rc 0/0 00000100:00100000:1.0:1787857698.008071:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 769 00000100:00080000:1.0:1787857698.008112:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857698.016596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.016733:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171568256 00000100:00100000:2.0:1787857698.016744:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171568256 00000100:00100000:2.0:1787857698.016835:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 770 00000100:00100000:2.0:1787857698.016847:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23311:x1874704171568256:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857698.017024:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857698.017053:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b503 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3529 expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017084:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984400) 00010000:00010000:2.0:1787857698.017096:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857698.017122:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017136:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017146:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017162:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017169:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017176:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017278:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017592:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017599:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017606:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857698.017610:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017618:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017628:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316400) 00010000:00010000:2.0:1787857698.017631:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857698.017635:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017640:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b511 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017652:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017659:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017664:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017677:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857698.017680:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017687:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017694:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xf62c1e3f (ffff9998e18d9400) 00010000:00010000:2.0:1787857698.017697:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857698.017699:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.017704:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b518 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xf62c1e3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857698.018018:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23311:x1874704171568256:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1171us (1430us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857698.018026:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 770 00000100:00100000:2.0:1787857698.021178:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857698.021251:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171568384 00000100:00100000:1.0:1787857698.021260:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171568384 00000100:00100000:1.0:1787857698.021329:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 771 00000100:00100000:1.0:1787857698.021338:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23311:x1874704171568384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857698.021474:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857698.021500:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b51f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3530 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.021638:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.021654:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.021666:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.022147:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b51f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.022167:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.022176:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:1.0:1787857698.022179:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857698.022183:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94c00, rc 0) 00000100:00100000:1.0:1787857698.022261:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23311:x1874704171568384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 923us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857698.022269:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 771 00000100:00100000:1.0:1787857698.051188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857698.051280:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171568640 00000100:00100000:0.0:1787857698.051298:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171568640 00000100:00100000:0.0:1787857698.051362:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 772 00000100:00100000:0.0:1787857698.051373:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23311:x1874704171568640:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857698.051451:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.051468:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.051480:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857698.051788:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8600 00000004:00080000:0.0:1787857698.051799:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 522101981253ns, next at 523101978585ns, rc = 0 00000004:00010000:0.0:1787857698.051921:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ace5eb6 reply state 00000000a94d2170 transno 4294967801 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857698.051931:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857698.052021:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:23311:x1874704171568640:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 650us (843us total) trans 4294967801 rc 0/0 00000100:00100000:0.0:1787857698.052029:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 772 00010000:00010000:2.0:1787857698.059230:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.059250:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.059259:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.059265:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857698.059269:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.059301:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.059320:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:2.0:1787857698.059323:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787857698.059328:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.059334:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7b52d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857698.064754:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.065039:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171568768 00000100:00100000:3.0:1787857698.065049:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171568768 00000100:00100000:3.0:1787857698.065134:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 773 00000100:00100000:3.0:1787857698.065143:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:23311:x1874704171568768:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857698.065173:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857698.065191:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3537 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.065254:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 40 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.065268:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 40 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.065292:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:3.0:1787857698.065296:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857698.065299:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6200, rc 0) 00000100:00100000:3.0:1787857698.065363:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:23311:x1874704171568768:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 221us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857698.065387:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 773 00000100:00100000:0.0:1787857698.068851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857698.068992:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171568896 00000100:00100000:1.0:1787857698.069007:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171568896 00000100:00100000:1.0:1787857698.069087:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 186 00000100:00100000:1.0:1787857698.069096:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171568896:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787857698.069432:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171568896:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 336us (620us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787857698.069439:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 186 00000100:00080000:3.0:1787857698.069908:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857698.077919:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.078098:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171569152 00000100:00100000:3.0:1787857698.078109:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171569152 00000100:00100000:3.0:1787857698.078166:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 157 00000100:00100000:3.0:1787857698.078176:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:23311:x1874704171569152:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857698.078432:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23311:x1874704171569152:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 255us (521us total) trans 4294967802 rc 0/0 00000100:00100000:3.0:1787857698.078441:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 157 00000100:00100000:2.0:1787857698.091688:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857698.091780:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171569408 00000100:00100000:0.0:1787857698.091791:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171569408 00000100:00100000:0.0:1787857698.091875:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 774 00000100:00100000:0.0:1787857698.091886:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23311:x1874704171569408:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857698.092000:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23311:x1874704171569408:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 116us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857698.092008:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 774 00000100:00100000:1.0:1787857698.095377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.095928:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171569536 00000100:00100000:3.0:1787857698.095939:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171569536 00000100:00100000:3.0:1787857698.095996:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 775 00000100:00100000:3.0:1787857698.096006:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23311:x1874704171569536:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857698.096026:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857698.096048:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b53b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd353e expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.096131:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b542 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.096145:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.096156:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857698.096193:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857698.096227:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.096252:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b53b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd353e expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.096267:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd353e expref: 42 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.096276:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:3.0:1787857698.096279:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787857698.096283:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00100000:3.0:1787857698.096358:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23311:x1874704171569536:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 353us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857698.096365:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 775 00000100:00100000:1.0:1787857698.104092:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.104810:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171569664 00000100:00100000:2.0:1787857698.104839:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171569664 00000100:00100000:2.0:1787857698.104902:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 187 00000100:00100000:2.0:1787857698.104915:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171569664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857698.104937:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857698.104960:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3545 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857698.104989:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908b21, blocks: 0x1 00010000:00010000:2.0:1787857698.105011:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1787857698.105015:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857698.105025:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.105043:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.105077:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:2.0:1787857698.105144:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171569664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 231us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.105152:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 187 00000100:00100000:1.0:1787857698.109007:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.109139:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171569920 00000100:00100000:2.0:1787857698.109149:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171569920 00000100:00100000:2.0:1787857698.109242:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 776 00000100:00100000:2.0:1787857698.109252:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23311:x1874704171569920:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857698.109378:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23311:x1874704171569920:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 126us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.109385:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 776 00000100:00100000:1.0:1787857698.111962:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.112067:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171570048 00000100:00100000:2.0:1787857698.112076:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171570048 00000100:00100000:2.0:1787857698.112130:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 188 00000100:00100000:2.0:1787857698.112140:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:23311:x1874704171570048:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857698.112159:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857698.112236:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd354c expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.112266:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.112275:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857698.112280:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857698.112300:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.112334:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.112348:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 11 pid: 6713 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857698.112363:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188211072:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857698.112469:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857698.114442:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188211072:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857698.114475:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.114495:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53800, rc 0) 00000100:00100000:2.0:1787857698.114592:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:23311:x1874704171570048:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2453us (2638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.114601:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 188 00000100:00100000:1.0:1787857698.115568:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857698.115663:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171570176 00000100:00100000:0.0:1787857698.115670:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171570176 00010000:00010000:0.0:1787857698.115705:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 11 pid: 6713 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857698.115980:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 247 00000100:00100000:0.0:1787857698.116086:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171570176:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857698.116101:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857698.116121:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 11 pid: 6713 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.116131:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 11 pid: 6713 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.116151:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7b549 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3545 expref: 11 pid: 6713 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.116163:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857698.116166:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857698.116187:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.116198:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.116235:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857698.116249:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188211200:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857698.116454:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857698.121597:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188211200:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857698.121626:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857698.121686:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171570176:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5696us (6120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857698.121698:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 247 00000100:00100000:1.0:1787857698.125615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.125982:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171570304 00000100:00100000:2.0:1787857698.126097:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171570304 00002000:00100000:2.0:1787857698.126152:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (0->157) req@ffff9998ffa85e00 x1874704171570304/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:344/0 lens 648/0 e 0 to 0 dl 1787857709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857698.126163:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa85e00 with x1874704171570304 ext(0->157) 00002000:00010000:2.0:1787857698.126169:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998ffa85e00 00000100:00100000:2.0:1787857698.126245:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:2.0:1787857698.126255:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171570304:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787857698.126769:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171570304:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 513us (1163us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787857698.126777:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00002000:00100000:2.0:1787857698.126784:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (0->157) req@ffff9998ffa85e00 x1874704171570304/t4294967329(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:344/0 lens 648/448 e 0 to 0 dl 1787857709 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857698.126792:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa85e00 with x1874704171570304 ext(0->157) 00002000:00010000:2.0:1787857698.126795:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998ffa85e00 00000100:00100000:3.0:1787857698.132077:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857698.132211:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171570432 00000100:00100000:0.0:1787857698.132220:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171570432 00000100:00100000:0.0:1787857698.132283:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 777 00000100:00100000:0.0:1787857698.132293:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23311:x1874704171570432:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787857698.158091:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188211584:0@lo:400:kworker.0 00000100:00100000:3.0:1787857698.158164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857698.158201:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857698.158208:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188211712:0@lo:400:kworker.0 00000100:00100000:3.0:1787857698.158232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857698.158382:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188211328:0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.158416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857698.158456:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188211840:0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.158479:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857698.158500:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857698.158505:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188211456:0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.158529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857698.158547:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188211968:0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.158570:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857698.158769:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188211584 00000100:00100000:2.0:1787857698.158777:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188211584 00000100:00100000:2.0:1787857698.158845:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188211840 00000100:00100000:2.0:1787857698.158848:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188211840 00000100:00100000:2.0:1787857698.158866:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188211456 00000100:00100000:2.0:1787857698.158868:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188211456 00000100:00100000:2.0:1787857698.158882:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787857698.158889:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188211584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.158950:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188211584:12345-0@lo:400:kworker.0 Request processed in 60us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.158957:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787857698.158973:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787857698.158978:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188211840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.159020:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188211840:12345-0@lo:400:kworker.0 Request processed in 42us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.159026:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787857698.159036:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787857698.159041:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188211456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.159078:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188211456:12345-0@lo:400:kworker.0 Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.159084:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787857698.159102:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188211712 00000100:00100000:2.0:1787857698.159105:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188211712 00000100:00100000:2.0:1787857698.159128:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188211968 00000100:00100000:2.0:1787857698.159130:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188211968 00000100:00100000:2.0:1787857698.159148:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787857698.159153:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188211712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.159181:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188211712:12345-0@lo:400:kworker.0 Request processed in 28us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.159187:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787857698.159197:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787857698.159202:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188211968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.159225:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188211968:12345-0@lo:400:kworker.0 Request processed in 24us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.159239:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:2.0:1787857698.159254:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857698.159257:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857698.159260:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857698.159449:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188211456:0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.159463:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188211968:0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.159471:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188211840:0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.159509:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188211712:0@lo:400:kworker.0 00000100:00100000:2.0:1787857698.159518:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188211584:0@lo:400:kworker.0 00000100:00100000:3.0:1787857698.159650:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188211328 00000100:00100000:3.0:1787857698.159654:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188211328 00000100:00100000:3.0:1787857698.159694:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1787857698.159701:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188211328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857698.159735:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188211328:12345-0@lo:400:kworker.0 Request processed in 35us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857698.159741:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1787857698.159915:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188211328:0@lo:400:kworker.0 00000100:00100000:1.0:1787857698.224032:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23311:x1874704171570432:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 91728us (91951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857698.224047:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 777 00000001:00080000:1.0:1787857698.225963:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967801 is committed 00000004:00080000:1.0:1787857698.225978:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1787857698.226005:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967793 is committed 00000001:00080000:1.0:1787857698.226025:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967796 is committed 00000001:00080000:1.0:1787857698.226048:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967802 is committed 00000100:00100000:1.0:1787857698.226517:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188212096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787857698.226582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857698.226768:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188212096 00000100:00100000:2.0:1787857698.226776:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188212096 00000100:00100000:2.0:1787857698.226845:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787857698.226854:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188212096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787857698.227003:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787857698.227007:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1787857697 00002000:00010000:2.0:1787857698.227009:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787857698.227012:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 1787857697 -> 1787857697 00002000:00010000:2.0:1787857698.227014:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787857698.227066:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188212096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (471us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787857698.227074:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000004:00080000:1.0:1787857698.227172:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c26e7c00/2, rc 0, transno 4294967330 00000100:00100000:1.0:1787857698.227178:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188212096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787857698.230500:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.230655:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171570560 00000100:00100000:3.0:1787857698.230666:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171570560 00000100:00100000:3.0:1787857698.230731:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 190 00000100:00100000:3.0:1787857698.230741:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171570560:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787857698.295677:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00000001:00080000:1.0:1787857698.295696:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00000001:00080000:1.0:1787857698.295702:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000100:00100000:2.0:1787857698.299137:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171570560:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 68388us (68637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.299162:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 190 00000100:00100000:2.0:1787857698.317260:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.317357:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171570816 00000100:00100000:3.0:1787857698.317366:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171570816 00000100:00100000:3.0:1787857698.317430:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 778 00000100:00100000:3.0:1787857698.317440:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23311:x1874704171570816:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857698.317493:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857698.317520:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b542 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd353e expref: 36 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.317540:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:3.0:1787857698.317545:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857698.317572:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.317586:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.317596:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857698.317893:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000612959b2 reply state 0000000028bb406a transno 4294967803 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857698.317903:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857698.317991:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23311:x1874704171570816:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 553us (740us total) trans 4294967803 rc 0/0 00000100:00100000:3.0:1787857698.318013:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 778 00000100:00100000:0.0:1787857698.326983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857698.330045:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.330076:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.330084:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.330091:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857698.330095:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.330103:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.330121:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:2.0:1787857698.330125:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857698.330129:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.330136:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b557 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857698.330977:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171570944 00000100:00100000:3.0:1787857698.330990:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171570944 00000100:00100000:3.0:1787857698.331077:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00100000:3.0:1787857698.331088:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171570944:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787857698.331363:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:3.0:1787857698.331367:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 1787857697 -> 1536580263 00002000:00010000:3.0:1787857698.331369:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb atime from disk: 0 -> 1787857200 00002000:00010000:3.0:1787857698.331372:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 1787857697 -> 1787857696 00002000:00010000:3.0:1787857698.331374:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787857698.331449:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171570944:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 362us (4474us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787857698.331458:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00100000:1.0:1787857698.338983:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.339058:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171571200 00000100:00100000:2.0:1787857698.339067:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171571200 00000100:00100000:2.0:1787857698.339123:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 779 00000100:00100000:2.0:1787857698.339133:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23311:x1874704171571200:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787857698.339216:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.339232:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.339242:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.339273:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.339285:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 36 pid: 5856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857698.339299:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188212224:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857698.339394:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857698.341112:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188212224:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857698.341137:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857698.343161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.343246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171571328 00000100:00100000:2.0:1787857698.343256:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171571328 00010000:00010000:2.0:1787857698.343310:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 37 pid: 5856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857698.343363:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 248 00000100:00100000:2.0:1787857698.343373:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:2350:x1874704171571328:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857698.343403:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857698.343410:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 37 pid: 5856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.343422:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 37 pid: 5856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.343447:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3530 expref: 37 pid: 5856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.343468:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:2.0:1787857698.343473:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.343482:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.343491:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.343522:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857698.343576:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171571328:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 205us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.343584:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 248 00010000:00010000:1.0:1787857698.343807:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.343848:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.343877:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.343884:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.343890:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.343897:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857698.343901:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.343908:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.343917:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:1.0:1787857698.343920:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787857698.343924:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.343941:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7b55e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857698.343988:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23311:x1874704171571200:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 4856us (5013us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787857698.343997:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 779 00000100:00100000:1.0:1787857698.355857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.355963:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171571456 00000100:00100000:2.0:1787857698.355974:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171571456 00000100:00100000:2.0:1787857698.356024:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 192 00000100:00100000:2.0:1787857698.356033:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171571456:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857698.356112:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.356133:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.356141:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857698.356146:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857698.356150:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.356185:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.356200:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 10 pid: 8490 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857698.356215:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188212352:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857698.356301:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857698.360487:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.360599:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188212352:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857698.360628:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857698.367786:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171571584 00000100:00100000:1.0:1787857698.367801:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171571584 00010000:00010000:1.0:1787857698.367883:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 11 pid: 8490 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857698.367928:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 249 00000100:00100000:1.0:1787857698.367938:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171571584:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857698.367955:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857698.367978:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 11 pid: 8490 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.367992:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 11 pid: 8490 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.368017:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb10d986/0xd3f183cab4a7b550 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd354c expref: 11 pid: 8490 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.368034:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857698.368038:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857698.368070:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.368081:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.368110:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857698.368174:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171571584:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 236us (7696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857698.368183:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 249 00010000:00010000:2.0:1787857698.368393:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.368415:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.368441:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.368451:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.368460:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.368467:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857698.368472:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.368480:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.368492:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.368499:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b565 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857698.368577:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171571456:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 12544us (12730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.368586:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 192 00000100:00100000:3.0:1787857698.373255:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.373383:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171571840 00000100:00100000:2.0:1787857698.373394:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171571840 00000100:00100000:2.0:1787857698.373464:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 780 00000100:00100000:2.0:1787857698.373474:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23311:x1874704171571840:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857698.373558:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.373576:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.373589:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.374153:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.374166:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 36 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.374175:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.374209:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 36 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.374241:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 36 pid: 7656 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857698.374256:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e5680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188212480:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857698.374702:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857698.379627:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e5680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188212480:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857698.379656:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857698.379932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857698.380239:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171571968 00000100:00100000:0.0:1787857698.380246:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171571968 00010000:00010000:0.0:1787857698.380285:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 37 pid: 7656 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857698.380332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 250 00000100:00100000:0.0:1787857698.380363:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:2350:x1874704171571968:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857698.380377:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857698.380385:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 37 pid: 7656 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.380397:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 37 pid: 7656 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.380419:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b534 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3537 expref: 37 pid: 7656 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.380432:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:0.0:1787857698.380438:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.380446:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.380455:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.380478:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857698.380539:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171571968:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 177us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857698.380546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 250 00010000:00010000:3.0:1787857698.385670:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.385690:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857698.386134:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967804 00000001:00080000:3.0:1787857698.388156:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967805 00000001:00080000:3.0:1787857698.388253:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967806 00000100:00100000:3.0:1787857698.388430:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188212608:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787857698.388523:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857698.388555:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c788f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857698.389074:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188212608 00000100:00100000:2.0:1787857698.389083:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188212608 00000100:00100000:2.0:1787857698.389173:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857698.389191:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188212608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787857698.389301:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188212608:12345-0@lo:1000:mdt00_003.0 Request processed in 111us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.389310:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787857698.389379:0:7656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:3.0:1787857698.389385:0:7656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c26e7c00, transno 4294967330 00000100:00100000:3.0:1787857698.389405:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188212608:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787857698.389775:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967807 00000100:00100000:3.0:1787857698.389870:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3043c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188212736:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787857698.389903:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857698.391013:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857698.391150:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188212736 00000100:00100000:1.0:1787857698.391158:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188212736 00000100:00100000:1.0:1787857698.391207:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787857698.391216:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188212736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787857698.391645:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7656:x1874704188212736:12345-0@lo:1000:mdt00_003.0 Request processed in 429us (1739us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787857698.391654:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787857698.391733:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3043c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188212736:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787857698.391925:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.391936:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.391943:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.391949:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857698.391954:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.391960:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.391977:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998c3984d00) 00010000:00010000:3.0:1787857698.391981:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857698.391985:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.391991:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b573 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392032:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392039:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392045:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392061:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857698.392064:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392070:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392078:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:3.0:1787857698.392081:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857698.392084:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392090:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b4cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392110:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392122:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392132:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392145:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392151:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392157:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392162:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857698.392164:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392170:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392238:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:3.0:1787857698.392240:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857698.392244:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392250:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b57a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392260:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392266:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392271:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392282:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857698.392285:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392452:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392462:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984600) 00010000:00010000:3.0:1787857698.392464:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857698.392467:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.392473:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b56c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857698.392872:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:23311:x1874704171571840:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 19395us (19624us total) trans 4294967808 rc 0/0 00000100:00100000:3.0:1787857698.392881:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 780 00000020:00080000:3.0:1787857698.392886:0:7656:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787857698.398908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.398947:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171572224 00000100:00100000:3.0:1787857698.398957:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171572224 00000100:00100000:3.0:1787857698.399003:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:3.0:1787857698.399012:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:23311:x1874704171572224:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787857698.399744:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787857698.399883:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967809 00010000:00010000:3.0:1787857698.399932:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.399959:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.399971:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.399980:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.399988:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.399995:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.400016:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857698.400113:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23311:x1874704171572224:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1100us (1216us total) trans 4294967810 rc 0/0 00000100:00100000:3.0:1787857698.400122:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 158 00000020:00080000:3.0:1787857698.400127:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857698.402553:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857698.402565:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.402594:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857698.402598:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.402608:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.402625:0:17404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9998d1291200) 00010000:00010000:0.0:1787857698.402628:0:17404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857698.402633:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.402639:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b581 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857698.402665:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857698.402667:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857698.402669:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857698.403227:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857698.403233:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857698.403737:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787857698.403748:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857698.542950:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857698.565806:0:17925:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857698.565838:0:17925:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857698.565886:0:17925:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:0.0:1787857698.565892:0:17925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857698.640924:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857698.641133:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171572480 00000100:00100000:1.0:1787857698.641142:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171572480 00000100:00100000:1.0:1787857698.641213:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 781 00000100:00100000:1.0:1787857698.641224:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23315:x1874704171572480:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857698.641251:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857698.641281:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b588 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3553 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641361:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641376:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641388:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641402:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641409:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641416:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641850:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b59d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641859:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641867:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857698.641877:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:1.0:1787857698.641975:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.641993:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642000:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642006:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857698.642010:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642018:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642031:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316400) 00010000:00010000:1.0:1787857698.642034:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857698.642039:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642056:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b58f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642068:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642074:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642079:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642084:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857698.642093:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642099:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642107:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff9998c3984f00) 00010000:00010000:1.0:1787857698.642110:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857698.642112:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642117:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642158:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b588 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3553 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642172:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95e00/0xd3f183cab4a7b59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3553 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.642180:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984100) 00010000:00010000:1.0:1787857698.642181:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857698.642184:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95e00, rc 0) 00000100:00100000:1.0:1787857698.642251:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:23315:x1874704171572480:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1029us (1336us total) trans 4294967811 rc 0/0 00000100:00100000:1.0:1787857698.642259:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 781 00000100:00100000:0.0:1787857698.647764:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857698.649291:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171572608 00000100:00100000:1.0:1787857698.649306:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171572608 00000100:00100000:1.0:1787857698.649385:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 782 00000100:00100000:1.0:1787857698.649397:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:23315:x1874704171572608:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1787857698.649490:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649506:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649518:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649544:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649553:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649560:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649567:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857698.649572:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649580:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649591:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984100) 00010000:00010000:1.0:1787857698.649595:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857698.649600:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.649617:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857698.649764:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:23315:x1874704171572608:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 368us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857698.649772:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 782 00000100:00100000:1.0:1787857698.658280:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.658476:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171572864 00000100:00100000:3.0:1787857698.658487:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171572864 00000100:00100000:3.0:1787857698.658547:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:3.0:1787857698.658559:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:23315:x1874704171572864:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1787857698.658902:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:23315:x1874704171572864:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 345us (631us total) trans 4294967812 rc 0/0 00000100:00100000:3.0:1787857698.658911:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:1.0:1787857698.670019:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857698.670058:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188212864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857698.670132:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857698.670212:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188212864 00000100:00100000:1.0:1787857698.670220:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188212864 00000100:00100000:1.0:1787857698.670271:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787857698.670281:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188212864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857698.670322:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857698.670365:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188212864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857698.670373:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787857698.670433:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188212864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857698.887053:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857698.887149:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171572992 00000100:00100000:1.0:1787857698.887159:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171572992 00000100:00080000:2.0:1787857698.887299:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857698.887800:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 783 00000100:00100000:1.0:1787857698.887858:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+74:23331:x1874704171572992:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:1.0:1787857698.887888:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857698.887911:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b5b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd355a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.887973:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.888000:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.888012:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.888028:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.888035:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.888052:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.888811:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889054:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889064:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857698.889155:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 7680 00000004:00200000:1.0:1787857698.889159:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857698.889239:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889252:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889382:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889389:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889396:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857698.889400:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889407:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889419:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:1.0:1787857698.889422:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857698.889426:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889432:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7b5b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889444:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889450:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889456:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889461:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857698.889470:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889477:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889484:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff9998c3984f00) 00010000:00010000:1.0:1787857698.889487:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857698.889489:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889494:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7b5c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889529:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7b5b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd355a expref: 76 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889543:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94400/0xd3f183cab4a7b5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd355a expref: 75 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.889550:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316400) 00010000:00010000:1.0:1787857698.889552:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857698.889555:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94400, rc 0) 00000100:00100000:1.0:1787857698.889711:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+75:23331:x1874704171572992:12345-192.168.204.36@tcp:101:diff.0 Request processed in 1900us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857698.889719:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 783 00000100:00100000:2.0:1787857698.893413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857698.893543:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171573120 00000100:00100000:1.0:1787857698.893555:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171573120 00000100:00100000:1.0:1787857698.893629:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 784 00000100:00100000:1.0:1787857698.893640:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+75:23331:x1874704171573120:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:1.0:1787857698.893676:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857698.893714:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b5ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3561 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.893797:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.893853:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.893866:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.893881:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.893888:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.893895:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894245:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0a00/0xd3f183cab4a7b5e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894255:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0a00/0xd3f183cab4a7b5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894272:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0a00/0xd3f183cab4a7b5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857698.894306:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00000004:00200000:1.0:1787857698.894316:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857698.894337:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0a00/0xd3f183cab4a7b5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894348:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0a00/0xd3f183cab4a7b5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894356:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894363:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894369:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894375:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857698.894379:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894386:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894398:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9998d5316400) 00010000:00010000:1.0:1787857698.894401:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857698.894405:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894411:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b5d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894423:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894439:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894445:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894451:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a1200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857698.894453:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894461:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894469:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff9998c3984e00) 00010000:00010000:1.0:1787857698.894471:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857698.894474:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894480:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894511:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b5ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3561 expref: 77 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894524:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0a00/0xd3f183cab4a7b5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3561 expref: 76 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.894531:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984100) 00010000:00010000:1.0:1787857698.894533:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857698.894542:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a0a00, rc 0) 00000100:00100000:1.0:1787857698.894604:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+76:23331:x1874704171573120:12345-192.168.204.36@tcp:101:diff.0 Request processed in 966us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857698.894612:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 784 00000100:00100000:3.0:1787857698.901009:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857698.901181:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171573248 00000100:00100000:2.0:1787857698.901191:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171573248 00000100:00100000:2.0:1787857698.901281:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00100000:2.0:1787857698.901292:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171573248:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:2.0:1787857698.901312:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857698.901345:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000839b62ee/0xd3f183cab4a7b5ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3568 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857698.901395:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a908930, ctime: 0x6a908b20, blocks: 0xb 00010000:00010000:2.0:1787857698.901416:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1787857698.901421:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857698.901431:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000839b62ee/0xd3f183cab4a7b5ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3568 expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.901451:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000839b62ee/0xd3f183cab4a7b5ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3568 expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857698.901464:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52c00, rc 0) 00000100:00100000:2.0:1787857698.901527:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171573248:12345-192.168.204.36@tcp:101:diff.0 Request processed in 237us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857698.901534:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00080000:3.0:1787857698.902678:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857698.907348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857698.907475:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171573504 00000100:00100000:1.0:1787857698.907487:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171573504 00000100:00100000:1.0:1787857698.907553:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 785 00000100:00100000:1.0:1787857698.907564:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+76:23331:x1874704171573504:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:1.0:1787857698.907594:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857698.907632:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b5f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd356f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.907778:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.907796:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.907809:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857698.907875:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:1.0:1787857698.908034:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b5f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd356f expref: 79 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.908066:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd356f expref: 78 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857698.908074:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984100) 00010000:00010000:1.0:1787857698.908091:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857698.908095:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a1200, rc 0) 00000100:00100000:1.0:1787857698.908161:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+78:23331:x1874704171573504:12345-192.168.204.36@tcp:101:diff.0 Request processed in 598us (837us total) trans 4294967813 rc 0/0 00000100:00100000:1.0:1787857698.908169:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 785 00000100:00100000:0.0:1787857698.915059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.915168:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171573632 00000100:00100000:3.0:1787857698.915179:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171573632 00000100:00100000:3.0:1787857698.915254:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:3.0:1787857698.915266:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+78:2349:x1874704171573632:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857698.915283:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857698.915310:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b5f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd356f expref: 78 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857698.915332:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9998c3984100) 00010000:00010000:3.0:1787857698.915337:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857698.915400:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+77:2349:x1874704171573632:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 137us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857698.915407:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:3.0:1787857698.917373:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857698.917486:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171573760 00000100:00100000:0.0:1787857698.917495:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171573760 00002000:00100000:0.0:1787857698.917544:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->4095) req@ffff9997c3a203c0 x1874704171573760/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:344/0 lens 488/0 e 0 to 0 dl 1787857709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857698.917574:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c3a203c0 with x1874704171573760 ext(0->4095) 00002000:00010000:0.0:1787857698.917580:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c3a203c0 00000100:00100000:0.0:1787857698.917617:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:0.0:1787857698.917625:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171573760:12345-192.168.204.36@tcp:3:diff.0 00000100:00100000:0.0:1787857698.917890:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171573760:12345-192.168.204.36@tcp:3:diff.0 Request processed in 265us (526us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857698.917898:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 62 00002000:00100000:0.0:1787857698.917905:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->4095) req@ffff9997c3a203c0 x1874704171573760/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:344/0 lens 488/4536 e 0 to 0 dl 1787857709 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857698.917913:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c3a203c0 with x1874704171573760 ext(0->4095) 00002000:00010000:0.0:1787857698.917916:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c3a203c0 00000100:00100000:0.0:1787857698.926069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857698.926496:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171574016 00000100:00100000:3.0:1787857698.926507:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171574016 00000100:00100000:3.0:1787857698.926574:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 160 00000100:00100000:3.0:1787857698.926585:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+77:23331:x1874704171574016:12345-192.168.204.36@tcp:35:diff.0 00000001:00080000:3.0:1787857698.927162:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967814 00000100:00100000:3.0:1787857698.927463:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+79:23331:x1874704171574016:12345-192.168.204.36@tcp:35:diff.0 Request processed in 877us (1403us total) trans 4294967815 rc 0/0 00000100:00100000:3.0:1787857698.927473:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 160 00000020:00080000:3.0:1787857698.927478:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787857699.566180:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857699.926597:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857699.926645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857699.926758:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171574144 00000100:00100000:1.0:1787857699.926768:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171574144 00000100:00100000:1.0:1787857699.926847:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 534 00000100:00100000:1.0:1787857699.926859:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171574144:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857699.926931:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171574144:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857699.926939:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 534 00000100:00100000:2.0:1787857699.928170:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857699.928205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857699.928230:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171574656 00000100:00100000:1.0:1787857699.928237:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171574656 00000100:00100000:1.0:1787857699.928296:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 333 00000100:00100000:1.0:1787857699.928305:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2347:x1874704171574656:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857699.928686:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2347:x1874704171574656:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 381us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857699.928695:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 333 00000100:00100000:2.0:1787857699.930277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857699.930311:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857699.930359:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171574272 00000100:00100000:0.0:1787857699.930368:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171574272 00000100:00100000:0.0:1787857699.930417:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 334 00000100:00100000:0.0:1787857699.930427:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+79:2347:x1874704171574272:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857699.930491:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+79:2347:x1874704171574272:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857699.930498:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 334 00000100:00100000:3.0:1787857699.933635:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171574400 00000100:00100000:3.0:1787857699.933650:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171574400 00000100:00100000:3.0:1787857699.933751:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171574912 00000100:00100000:3.0:1787857699.933755:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171574912 00000100:00100000:3.0:1787857699.933800:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:3.0:1787857699.933810:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171574400:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857699.933905:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171574400:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 96us (7259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857699.933913:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:3.0:1787857699.933931:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 307 00000100:00100000:3.0:1787857699.933937:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171574912:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857699.933960:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171574912:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (5756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857699.933967:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 307 00000100:00080000:3.0:1787857699.933994:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857699.935880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857699.936574:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171574528 00000100:00100000:0.0:1787857699.936584:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171574528 00000100:00100000:0.0:1787857699.936665:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171574784 00000100:00100000:0.0:1787857699.936669:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171574784 00000100:00080000:2.0:1787857699.936677:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857699.936702:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 308 00000100:00100000:0.0:1787857699.936740:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171574528:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857699.936839:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2347:x1874704171574528:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 80us (6505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857699.936846:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 308 00000100:00100000:0.0:1787857699.936862:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 309 00000100:00100000:0.0:1787857699.936868:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171574784:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857699.936894:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171574784:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857699.936900:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 309 00010000:00010000:3.0:1787857700.590205:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857701.614756:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857701.742677:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188212992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857701.742758:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857701.750622:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188212992 00000100:00100000:1.0:1787857701.750642:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188212992 00000100:00100000:1.0:1787857701.750847:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787857701.750862:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188212992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857701.750909:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857701.751016:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188212992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (8258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857701.751043:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787857701.751102:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188212992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787857701.751115:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857702.643317:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857703.279054:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188213504:0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.279125:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857703.279981:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787857703.279993:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188213120:0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.280034:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857703.280059:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188213632:0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.280083:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857703.280114:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188213248:0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.280138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857703.280158:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188213760:0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.280180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857703.280212:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857703.280219:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188213376:0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.280239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857703.280269:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188213504 00000100:00100000:0.0:1787857703.280276:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188213504 00000100:00100000:0.0:1787857703.280329:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188213760 00000100:00100000:0.0:1787857703.280333:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188213760 00000100:00100000:0.0:1787857703.280360:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787857703.280368:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188213504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.280416:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188213504:12345-0@lo:400:kworker.0 Request processed in 48us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857703.280423:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787857703.280438:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787857703.280444:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188213760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.280473:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188213760:12345-0@lo:400:kworker.0 Request processed in 29us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857703.280479:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787857703.280495:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188213632 00000100:00100000:3.0:1787857703.282087:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188213248 00000100:00100000:3.0:1787857703.282100:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188213248 00000100:00100000:3.0:1787857703.282141:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188213376 00000100:00100000:3.0:1787857703.282144:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188213376 00000100:00100000:3.0:1787857703.282162:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787857703.282170:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188213248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857703.282237:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188213248:12345-0@lo:400:kworker.0 Request processed in 67us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857703.282244:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787857703.282260:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787857703.282266:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857703.282296:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188213376:12345-0@lo:400:kworker.0 Request processed in 30us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857703.282312:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787857703.282368:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188213504:0@lo:400:kworker.0 00000100:00100000:3.0:1787857703.282422:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188213376:0@lo:400:kworker.0 00000100:00100000:3.0:1787857703.282433:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188213248:0@lo:400:kworker.0 00000100:00100000:3.0:1787857703.282442:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188213760:0@lo:400:kworker.0 00000100:00100000:2.0:1787857703.282660:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188213120 00000100:00100000:2.0:1787857703.282665:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188213120 00000100:00100000:2.0:1787857703.282711:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1787857703.282718:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188213120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857703.282758:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188213120:12345-0@lo:400:kworker.0 Request processed in 40us (2723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857703.282764:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00080000:2.0:1787857703.282795:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857703.282799:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857703.282802:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857703.282848:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188213120:0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.283087:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188213632 00000100:00100000:0.0:1787857703.283130:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787857703.283138:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188213632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857703.283173:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188213632:12345-0@lo:400:kworker.0 Request processed in 37us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857703.283180:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787857703.285035:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188213632:0@lo:400:kworker.0 00000100:00080000:2.0:1787857703.285969:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787857703.359435:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967332 is committed 00000001:00080000:1.0:1787857703.359454:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00000001:00080000:0.0:1787857703.375968:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967813 is committed 00000001:00080000:0.0:1787857703.375984:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967811 is committed 00000001:00080000:0.0:1787857703.375995:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967815 is committed 00000001:00080000:0.0:1787857703.376003:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967812 is committed 00000020:00080000:0.0:1787857703.376031:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998f0df4180 refcount 2 committed 0 result 0 batchid 11 00000020:00080000:0.0:1787857703.376036:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c1e50300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998d1d1f240 00000020:00080000:0.0:1787857703.376040:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c1e50e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c1ec1400 00000020:00080000:2.0:1787857703.376110:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 11 committed batchid 10 00000020:00080000:2.0:1787857703.376315:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00000040:00080000:0.0:1787857703.534343:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857703.534354:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857703.534390:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:0.0:1787857703.534398:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857703.665142:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857703.791388:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188213888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857703.791460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857703.791538:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188213888 00000100:00100000:1.0:1787857703.791546:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188213888 00000100:00100000:1.0:1787857703.791592:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787857703.791602:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188213888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857703.791640:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857703.791688:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188213888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857703.791696:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787857703.791741:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188213888:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787857704.686084:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857704.734370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857704.734470:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171575040 00000100:00100000:3.0:1787857704.734481:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171575040 00000100:00100000:3.0:1787857704.734562:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 786 00000100:00100000:3.0:1787857704.734572:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:23246:x1874704171575040:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787857704.734758:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857704.734974:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:23246:x1874704171575040:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 402us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857704.734982:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 786 00000100:00100000:3.0:1787857705.041651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857705.041704:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857705.041733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857705.041761:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857705.041783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857705.041807:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857705.041872:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171575424 00000100:00100000:3.0:1787857705.041883:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171575424 00000100:00100000:3.0:1787857705.041953:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171575680 00000100:00100000:3.0:1787857705.041956:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171575680 00000100:00100000:3.0:1787857705.042001:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171575552 00000100:00100000:3.0:1787857705.042005:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171575552 00000100:00100000:3.0:1787857705.042019:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171575808 00000100:00100000:3.0:1787857705.042021:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171575808 00000100:00100000:3.0:1787857705.042037:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 312 00000100:00100000:3.0:1787857705.042046:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171575424:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857705.042125:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171575424:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 79us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857705.042323:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 312 00000100:00100000:3.0:1787857705.042343:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 313 00000100:00100000:3.0:1787857705.042351:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171575680:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857705.042381:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171575680:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857705.042388:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 313 00000100:00100000:3.0:1787857705.042400:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 314 00000100:00100000:3.0:1787857705.042406:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171575552:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857705.042429:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+10:2348:x1874704171575552:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857705.042434:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 314 00000100:00100000:3.0:1787857705.042446:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 315 00000100:00100000:3.0:1787857705.042453:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171575808:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857705.042473:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171575808:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857705.042479:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 315 00000100:00100000:3.0:1787857705.042507:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171575296 00000100:00100000:3.0:1787857705.042511:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171575296 00000100:00100000:3.0:1787857705.042545:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00100000:3.0:1787857705.042551:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+76:2348:x1874704171575296:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857705.042579:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+76:2348:x1874704171575296:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857705.042585:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00080000:3.0:1787857705.042623:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857705.042628:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857705.042630:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857705.044186:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171575168 00000100:00100000:0.0:1787857705.044198:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171575168 00000100:00100000:0.0:1787857705.044252:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 536 00000100:00100000:0.0:1787857705.044262:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171575168:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857705.044341:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171575168:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 81us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857705.044349:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 536 00010000:00010000:0.0:1787857705.710222:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857706.735235:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857706.782523:0:18123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 15:08:24 (1787857704) 00000100:00100000:0.0:1787857706.862965:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857706.862991:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188214016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857706.863063:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857706.863239:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188214016 00000100:00100000:3.0:1787857706.863248:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188214016 00000100:00100000:3.0:1787857706.863316:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787857706.863326:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188214016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857706.863361:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857706.863414:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188214016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857706.863421:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1787857706.863465:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857706.863509:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967332 gen 2 00000004:00080000:0.0:1787857706.863516:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967332 committed transno 4294967332 00000100:00100000:0.0:1787857706.863545:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188214016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857707.035741:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.035894:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171575936 00000100:00100000:0.0:1787857707.035905:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171575936 00000100:00100000:0.0:1787857707.035992:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 787 00000100:00100000:0.0:1787857707.036004:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:23945:x1874704171575936:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857707.036143:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:23945:x1874704171575936:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 142us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857707.036152:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 787 00000100:00080000:2.0:1787857707.037504:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857707.051533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.052094:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171576064 00000100:00100000:0.0:1787857707.052111:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171576064 00000100:00100000:0.0:1787857707.052235:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 788 00000100:00100000:0.0:1787857707.052250:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+76:23946:x1874704171576064:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857707.052282:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857707.052311:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3576 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.052409:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.052428:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.052443:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.052462:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.052471:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.052478:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053020:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053038:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053046:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053053:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857707.053059:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053069:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053085:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857707.053089:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857707.053095:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053102:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b60d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053117:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053124:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053130:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053135:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857707.053145:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053152:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053160:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff9998d5316d00) 00010000:00010000:0.0:1787857707.053163:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857707.053166:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053172:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b614 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053218:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b606 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3576 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053231:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857707.053234:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857707.053238:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3576 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.053248:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4400, rc 0) 00000100:00100000:0.0:1787857707.053350:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+76:23946:x1874704171576064:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1103us (1831us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857707.053359:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 788 00000100:00080000:2.0:1787857707.054224:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857707.058388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857707.058641:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171576320 00000100:00100000:1.0:1787857707.058669:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171576320 00000100:00100000:1.0:1787857707.058802:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 789 00000100:00100000:1.0:1787857707.058853:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+76:23946:x1874704171576320:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:1.0:1787857707.058959:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857707.058999:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b3f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34e3 expref: 76 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.059025:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:1.0:1787857707.059031:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857707.059456:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.059483:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.059495:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.059543:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.059562:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 33 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857707.059581:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188214144:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857707.059733:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990155ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857707.062956:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188214144:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857707.063002:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857707.067094:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.067568:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171576448 00000100:00100000:0.0:1787857707.067594:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171576448 00010000:00010000:0.0:1787857707.067725:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 34 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857707.067845:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 251 00000100:00100000:0.0:1787857707.067860:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:2349:x1874704171576448:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857707.067892:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857707.067902:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 34 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.067918:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 34 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.067949:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b423 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd34f1 expref: 34 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.067971:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857707.067978:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.067989:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.067998:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.068026:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857707.068114:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:2349:x1874704171576448:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 258us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857707.068122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 251 00010000:00010000:3.0:1787857707.068490:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.068501:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.068535:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.068548:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.068558:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857707.074943:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00010000:00010000:3.0:1787857707.074974:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.074986:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.074994:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.075001:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857707.075006:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.075014:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.075048:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316300) 00010000:00010000:3.0:1787857707.075051:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857707.075057:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.075063:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b61b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857707.075089:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009015505b reply state 00000000bd50235c transno 4294967816 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857707.075099:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857707.075520:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+77:23946:x1874704171576320:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 16701us (17343us total) trans 4294967816 rc 0/0 00000100:00100000:3.0:1787857707.075531:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 789 00010000:00010000:2.0:1787857707.077966:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.077991:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.077999:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.078006:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857707.078028:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.078038:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.078064:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff9998d1291c00) 00010000:00010000:2.0:1787857707.078068:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857707.078076:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.078083:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b622 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857707.482226:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.484276:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171576576 00000100:00100000:0.0:1787857707.484461:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171576576 00000100:00100000:0.0:1787857707.484638:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 790 00000100:00100000:0.0:1787857707.484651:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+76:23983:x1874704171576576:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787857707.484686:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857707.484728:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd357d expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.484841:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b630 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.484859:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.484880:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857707.484966:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857707.484972:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857707.485006:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.485038:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd357d expref: 78 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.485063:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd357d expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.485072:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:0.0:1787857707.485075:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857707.485078:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4400, rc 0) 00000100:00100000:0.0:1787857707.485205:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+77:23983:x1874704171576576:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 556us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857707.485213:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 790 00000100:00100000:3.0:1787857707.488075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857707.489005:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171576832 00000100:00100000:1.0:1787857707.489024:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171576832 00000100:00100000:1.0:1787857707.489123:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 791 00000100:00100000:1.0:1787857707.489135:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+77:23983:x1874704171576832:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:1.0:1787857707.489230:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857707.489274:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b630 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd357d expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.489310:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:1.0:1787857707.489323:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857707.489550:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+76:23983:x1874704171576832:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 416us (1490us total) trans 0 rc -17/-17 00000100:00100000:1.0:1787857707.489586:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 791 00000100:00100000:1.0:1787857707.492199:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857707.492328:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171576960 00000100:00100000:3.0:1787857707.492341:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171576960 00000100:00100000:3.0:1787857707.492414:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 792 00000100:00100000:3.0:1787857707.492425:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+76:23983:x1874704171576960:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:3.0:1787857707.492450:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857707.492483:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3584 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.492586:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b63e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.492605:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b63e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.492636:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b63e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857707.492715:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857707.492720:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857707.492751:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b63e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.492780:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3584 expref: 78 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.492802:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b63e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3584 expref: 77 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.492812:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857707.492856:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857707.492861:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:3.0:1787857707.492956:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+77:23983:x1874704171576960:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 532us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857707.492964:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 792 00000100:00100000:2.0:1787857707.496703:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.496894:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171577088 00000100:00100000:0.0:1787857707.496907:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171577088 00000100:00100000:0.0:1787857707.497020:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 793 00000100:00100000:0.0:1787857707.497033:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+77:23983:x1874704171577088:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787857707.497062:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857707.497093:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b645 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd358b expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497197:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497219:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497234:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497252:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497260:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497267:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497414:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b65a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497446:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b65a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497453:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b65a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857707.497511:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00000004:00200000:0.0:1787857707.497515:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857707.497543:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b65a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497559:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497567:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497589:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497596:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857707.497601:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497611:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497626:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:0.0:1787857707.497630:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857707.497635:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497655:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b64c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497671:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497678:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497684:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497689:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857707.497693:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497699:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497706:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff9998d5316900) 00010000:00010000:0.0:1787857707.497709:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857707.497712:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497718:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b653 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497752:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd358b expref: 79 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497765:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b65a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd358b expref: 78 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.497781:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998d5316b00) 00010000:00010000:0.0:1787857707.497783:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857707.497785:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857707.497920:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+78:23983:x1874704171577088:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 889us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857707.497928:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 793 00000100:00100000:0.0:1787857707.558797:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857707.559118:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171577216 00000100:00100000:3.0:1787857707.559131:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171577216 00000100:00100000:3.0:1787857707.559227:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 794 00000100:00100000:3.0:1787857707.559242:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+33:23989:x1874704171577216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857707.559273:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857707.559314:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3592 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.559440:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.559458:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.559473:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857707.559561:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857707.559577:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857707.559615:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.559646:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 35 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.559669:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.559678:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857707.559681:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857707.559686:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6e00, rc 0) 00000100:00100000:3.0:1787857707.559772:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:23989:x1874704171577216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 534us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857707.559780:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 794 00000100:00100000:1.0:1787857707.570865:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857707.571138:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171577472 00000100:00100000:3.0:1787857707.571154:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171577472 00000100:00100000:3.0:1787857707.571266:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 795 00000100:00100000:3.0:1787857707.571281:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+78:23989:x1874704171577472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857707.571320:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857707.571324:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787857707.571364:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b65a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd358b expref: 78 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.571389:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998d5316b00) 00010000:00010000:3.0:1787857707.571403:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857707.571424:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b66f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3599 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.571919:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.571940:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.571952:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.571967:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.571975:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.571981:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.573878:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.573901:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.573913:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857707.573927:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00010000:00010000:2.0:1787857707.573965:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.573973:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.573981:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.574011:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857707.574017:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.574025:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.574042:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998d1291600) 00010000:00010000:2.0:1787857707.574046:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857707.574052:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.574058:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7b676 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857707.574078:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e46af2a reply state 000000002035e444 transno 4294967817 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857707.574089:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857707.574156:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7b66f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 80 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.574187:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 79 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.574195:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998e18d9e00) 00010000:00010000:2.0:1787857707.574197:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857707.574200:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52200, rc 0) 00000100:00100000:2.0:1787857707.574773:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:23989:x1874704171577472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3493us (3964us total) trans 4294967817 rc 0/0 00000100:00100000:2.0:1787857707.574793:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 795 00000100:00100000:2.0:1787857707.580276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.581000:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171577728 00000100:00100000:0.0:1787857707.581016:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171577728 00010000:00010000:3.0:1787857707.581059:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.581092:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857707.581100:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 796 00010000:00010000:3.0:1787857707.581101:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.581108:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6600 already unused, calling callback (ffffffffc20cb4f0) 00000100:00100000:0.0:1787857707.581113:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+80:23989:x1874704171577728:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857707.581114:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.581124:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.581147:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff9998d1291200) 00010000:00010000:3.0:1787857707.581151:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857707.581158:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.581166:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b67d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.581271:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857707.581355:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35a0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.581550:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.581570:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 80 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.581580:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.581629:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 80 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.581660:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 80 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857707.581680:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188214272:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857707.581856:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d13f50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857707.586236:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188214272:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857707.586282:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857707.588706:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857707.590762:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171577856 00000100:00100000:3.0:1787857707.590784:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171577856 00010000:00010000:3.0:1787857707.591066:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 81 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857707.591181:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 252 00000100:00100000:3.0:1787857707.591195:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+81:2349:x1874704171577856:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857707.591218:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857707.591250:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 81 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.591265:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 81 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.591311:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7b684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3599 expref: 81 pid: 5857 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.591329:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998e18d9e00) 00010000:00010000:3.0:1787857707.591337:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.591348:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.591357:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857707.591394:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857707.591494:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+80:2349:x1874704171577856:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 302us (2805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857707.591503:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 252 00010000:00010000:0.0:1787857707.592000:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592012:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857707.592040:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00010000:00010000:0.0:1787857707.592456:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592467:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592474:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592481:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857707.592487:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592514:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592530:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998e18d9e00) 00010000:00010000:0.0:1787857707.592533:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857707.592537:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592543:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b699 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592643:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b692 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35a0 expref: 80 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592655:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998d5316900) 00010000:00010000:0.0:1787857707.592657:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857707.592662:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35a0 expref: 80 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.592675:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4000, rc 0) 00000100:00100000:0.0:1787857707.592755:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+79:23989:x1874704171577728:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 11644us (12495us total) trans 4294967818 rc 301/301 00000100:00100000:0.0:1787857707.592765:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 796 00000100:00100000:1.0:1787857707.596350:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857707.596534:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171578112 00000100:00100000:3.0:1787857707.596548:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171578112 00000100:00100000:3.0:1787857707.596634:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:3.0:1787857707.596647:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6121c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+79:23989:x1874704171578112:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857707.597195:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6121c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:23989:x1874704171578112:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 549us (861us total) trans 4294967819 rc 0/0 00000100:00100000:3.0:1787857707.597233:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:1.0:1787857707.600402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.600509:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171578240 00000100:00100000:0.0:1787857707.600522:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171578240 00000100:00100000:0.0:1787857707.600705:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 797 00000100:00100000:0.0:1787857707.600717:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+80:23989:x1874704171578240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857707.600776:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857707.600810:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b6a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35a7 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.601145:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35a7 expref: 81 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.601275:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35a7 expref: 81 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.601315:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998d5316c00) 00010000:00010000:0.0:1787857707.601319:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857707.601325:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857707.601405:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+81:23989:x1874704171578240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 691us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857707.601415:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 797 00000100:00100000:2.0:1787857707.604193:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857707.604303:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171578496 00000100:00100000:1.0:1787857707.604315:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171578496 00000100:00100000:1.0:1787857707.604393:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 798 00000100:00100000:1.0:1787857707.604405:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+81:23989:x1874704171578496:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787857707.604498:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604522:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604537:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604890:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604898:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604905:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604912:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857707.604939:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604948:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604963:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998d5316c00) 00010000:00010000:1.0:1787857707.604967:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787857707.604973:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.604981:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857707.605078:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:23989:x1874704171578496:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 673us (896us total) trans 4294967820 rc 0/0 00000100:00100000:1.0:1787857707.605087:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 798 00000100:00100000:1.0:1787857707.608138:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857707.608331:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171578752 00000100:00100000:2.0:1787857707.608345:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171578752 00000100:00100000:2.0:1787857707.608422:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 799 00000100:00100000:2.0:1787857707.608435:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:23989:x1874704171578752:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857707.609025:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.609050:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857707.609063:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857707.609180:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967821 00000004:00010000:2.0:1787857707.609227:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082f0f86c reply state 00000000a3e75628 transno 4294967822 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857707.609239:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857707.609546:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+85:23989:x1874704171578752:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1111us (1419us total) trans 4294967822 rc 0/0 00000100:00100000:2.0:1787857707.609556:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 799 00000020:00080000:2.0:1787857707.609562:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787857707.613072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.613167:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171579008 00000100:00100000:0.0:1787857707.613190:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171579008 00000100:00100000:0.0:1787857707.613267:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00100000:0.0:1787857707.613279:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:23989:x1874704171579008:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857707.613651:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+86:23989:x1874704171579008:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 373us (592us total) trans 4294967823 rc 0/0 00000100:00100000:0.0:1787857707.613660:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 162 00010000:00010000:1.0:1787857707.616489:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.616516:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.616526:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.616534:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857707.616540:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.616551:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.616670:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998d5316c00) 00010000:00010000:1.0:1787857707.616674:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857707.616681:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.616688:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b6b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857707.631653:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857707.631672:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857707.633393:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787857707.633445:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857707.644128:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857707.644252:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171579136 00000100:00100000:1.0:1787857707.644269:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171579136 00000100:00100000:1.0:1787857707.644515:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 800 00000100:00100000:1.0:1787857707.644530:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:23992:x1874704171579136:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857707.644579:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857707.644609:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35ae expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.644709:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.644729:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.644744:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.644765:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.644773:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.644811:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645094:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b6d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645103:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645111:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857707.645153:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00000004:00200000:1.0:1787857707.645158:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857707.645183:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645198:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645204:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645211:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645217:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857707.645222:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645230:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645253:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857707.645256:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857707.645262:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645269:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b6c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645286:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645752:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645759:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645764:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857707.645768:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645774:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645785:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff9998c3984e00) 00010000:00010000:1.0:1787857707.645787:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857707.645790:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645796:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b6ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645931:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b6bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35ae expref: 87 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645948:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0200/0xd3f183cab4a7b6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35ae expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.645958:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998c3984f00) 00010000:00010000:1.0:1787857707.645960:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857707.645963:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a0200, rc 0) 00000100:00100000:1.0:1787857707.646064:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+86:23992:x1874704171579136:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1537us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857707.646072:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 800 00000100:00100000:2.0:1787857707.650447:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.650974:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171579392 00000100:00100000:0.0:1787857707.650989:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171579392 00000100:00100000:0.0:1787857707.651082:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 801 00000100:00100000:0.0:1787857707.651096:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+86:23992:x1874704171579392:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857707.651128:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857707.651159:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b6d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35b5 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651269:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651304:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651319:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651339:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651347:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651353:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651527:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b6ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651537:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651558:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857707.651583:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:0.0:1787857707.651724:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651733:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651741:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651747:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857707.651752:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651760:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651776:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998c3984f00) 00010000:00010000:0.0:1787857707.651780:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857707.651786:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651793:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b6df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651809:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651884:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651890:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651895:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857707.651898:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651905:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651914:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff9998d5316900) 00010000:00010000:0.0:1787857707.651917:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857707.651920:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651926:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b6e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651978:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b6d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35b5 expref: 89 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.651994:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b6ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35b5 expref: 88 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.652002:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998d5316c00) 00010000:00010000:0.0:1787857707.652005:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857707.652013:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5800, rc 0) 00000100:00100000:0.0:1787857707.652112:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+88:23992:x1874704171579392:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1019us (1686us total) trans 4294967824 rc 0/0 00000100:00100000:0.0:1787857707.652121:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 801 00000100:00100000:3.0:1787857707.655728:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.655856:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171579520 00000100:00100000:0.0:1787857707.655880:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171579520 00000100:00100000:0.0:1787857707.655954:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 802 00000100:00100000:0.0:1787857707.655966:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+88:23992:x1874704171579520:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:0.0:1787857707.656061:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656085:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656101:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656139:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656148:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656154:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656161:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857707.656176:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656187:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656224:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998d5316c00) 00010000:00010000:0.0:1787857707.656227:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857707.656233:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.656241:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b6fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857707.656333:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+88:23992:x1874704171579520:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 369us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857707.656342:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 802 00000100:00100000:2.0:1787857707.659186:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.659269:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171579776 00000100:00100000:0.0:1787857707.659283:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171579776 00000100:00100000:0.0:1787857707.659372:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:0.0:1787857707.659384:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+88:23992:x1874704171579776:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1787857707.659927:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:23992:x1874704171579776:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 543us (763us total) trans 4294967825 rc 0/0 00000100:00100000:0.0:1787857707.659936:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:2.0:1787857707.700075:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.700589:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171580032 00000100:00100000:0.0:1787857707.700604:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171580032 00000100:00100000:0.0:1787857707.700689:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 803 00000100:00100000:0.0:1787857707.700702:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+89:23997:x1874704171580032:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857707.700743:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857707.700774:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b702 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35bc expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.701010:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b709 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.701049:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b709 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.701067:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b709 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857707.701083:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:0.0:1787857707.701302:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b702 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35bc expref: 92 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.701328:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b709 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35bc expref: 91 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.701339:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998d5316c00) 00010000:00010000:0.0:1787857707.701342:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787857707.701347:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4000, rc 0) 00000100:00100000:0.0:1787857707.701448:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+91:23997:x1874704171580032:12345-192.168.204.36@tcp:101:cat.0 Request processed in 749us (1388us total) trans 4294967826 rc 0/0 00000100:00100000:0.0:1787857707.701458:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 803 00000100:00100000:2.0:1787857707.708757:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857707.708880:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171580288 00000100:00100000:1.0:1787857707.708893:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171580288 00000100:00100000:1.0:1787857707.708983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:1.0:1787857707.708997:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+91:23997:x1874704171580288:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:1.0:1787857707.709018:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787857707.709054:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b6ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35b5 expref: 91 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.709082:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7b709 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35bc expref: 90 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.709093:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7b6a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35a7 expref: 89 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.709131:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998d5316c00) 00010000:00010000:1.0:1787857707.709146:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857707.709236:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+88:23997:x1874704171580288:12345-192.168.204.36@tcp:103:cat.0 Request processed in 241us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857707.709245:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:3.0:1787857707.713415:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857707.713528:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171580416 00000100:00100000:1.0:1787857707.713543:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171580416 00000100:00100000:1.0:1787857707.713636:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 804 00000100:00100000:1.0:1787857707.713648:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+88:23997:x1874704171580416:12345-192.168.204.36@tcp:58:cat.0 00010000:00010000:1.0:1787857707.713805:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.713877:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857707.713894:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857707.714171:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 136 off10776 00000100:00100000:1.0:1787857707.714286:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+88:23997:x1874704171580416:12345-192.168.204.36@tcp:58:cat.0 Request processed in 639us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857707.714296:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 804 00000100:00100000:2.0:1787857707.717254:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857707.717376:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171580544 00000100:00100000:0.0:1787857707.717390:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171580544 00000100:00100000:0.0:1787857707.717473:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 805 00000100:00100000:0.0:1787857707.717484:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+88:23997:x1874704171580544:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857707.717511:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857707.717540:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b71e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35c3 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.717656:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.717669:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b71e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35c3 expref: 89 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.717694:0:7656:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.717710:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b71e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35c3 expref: 89 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.717726:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:0.0:1787857707.717730:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857707.717734:0:7656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b71e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35c3 expref: 89 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857707.717742:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4400, rc 0) 00000100:00100000:0.0:1787857707.717856:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+89:23997:x1874704171580544:12345-192.168.204.36@tcp:101:cat.0 Request processed in 373us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857707.717863:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 805 00010000:00010000:2.0:1787857707.758172:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857708.398383:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188214656:0@lo:400:kworker.0 00000100:00100000:2.0:1787857708.398510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857708.398752:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787857708.398760:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188214528:0@lo:400:kworker.0 00000100:00100000:2.0:1787857708.398788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857708.398805:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188215040:0@lo:400:kworker.0 00000100:00100000:2.0:1787857708.398881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857708.398984:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188214656 00000100:00100000:1.0:1787857708.398995:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188214656 00000100:00100000:1.0:1787857708.399070:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188214528 00000100:00100000:1.0:1787857708.399074:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188214528 00000100:00100000:1.0:1787857708.399102:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787857708.399113:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188214656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857708.399212:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188214656:12345-0@lo:400:kworker.0 Request processed in 100us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.399220:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787857708.399240:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787857708.399246:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188214528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857708.399276:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188214528:12345-0@lo:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.399282:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787857708.399412:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188214400:0@lo:400:kworker.0 00000100:00100000:0.0:1787857708.399457:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857708.399496:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188214912:0@lo:400:kworker.0 00000100:00100000:0.0:1787857708.399531:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857708.399563:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857708.399579:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188214784:0@lo:400:kworker.0 00000100:00100000:0.0:1787857708.399607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857708.399637:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188214912 00000100:00100000:0.0:1787857708.399641:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188214912 00000100:00100000:0.0:1787857708.399669:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787857708.399676:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188214912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857708.399713:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188214912:12345-0@lo:400:kworker.0 Request processed in 38us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857708.399720:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787857708.399758:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188214912:0@lo:400:kworker.0 00000100:00100000:3.0:1787857708.402050:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188215040 00000100:00100000:3.0:1787857708.402073:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188215040 00000100:00100000:3.0:1787857708.402152:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188214784 00000100:00100000:3.0:1787857708.402156:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188214784 00000100:00100000:3.0:1787857708.402200:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787857708.402211:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188215040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857708.402321:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188215040:12345-0@lo:400:kworker.0 Request processed in 111us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857708.402329:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787857708.402347:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787857708.402354:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188214784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857708.402394:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188214784:12345-0@lo:400:kworker.0 Request processed in 41us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857708.402400:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:2.0:1787857708.403141:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857708.403150:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857708.403153:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857708.403216:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188214528:0@lo:400:kworker.0 00000100:00100000:2.0:1787857708.403234:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188215040:0@lo:400:kworker.0 00000100:00100000:2.0:1787857708.403248:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188214656:0@lo:400:kworker.0 00000100:00100000:2.0:1787857708.403345:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188214784:0@lo:400:kworker.0 00000100:00100000:1.0:1787857708.403451:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188214400 00000100:00100000:1.0:1787857708.403458:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188214400 00000100:00100000:1.0:1787857708.403517:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1787857708.403526:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188214400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857708.403602:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188214400:12345-0@lo:400:kworker.0 Request processed in 77us (4143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.403610:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1787857708.404281:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188214400:0@lo:400:kworker.0 00000001:00080000:3.0:1787857708.475328:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967826 is committed 00000020:00080000:3.0:1787857708.475411:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 11 batchid updated 00000020:00080000:2.0:1787857708.475669:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00000020:00080000:2.0:1787857708.475686:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00000040:00080000:0.0:1787857708.654632:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857708.654648:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857708.654804:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 20 count 3 00000040:00080000:0.0:1787857708.654814:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857708.655023:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188215168:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857708.655930:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857708.664267:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857708.665882:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171580672 00000100:00100000:3.0:1787857708.665899:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171580672 00000100:00100000:3.0:1787857708.665993:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 806 00000100:00100000:3.0:1787857708.666018:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23999:x1874704171580672:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857708.666063:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857708.666231:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23999:x1874704171580672:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 215us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857708.666261:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 806 00000100:00100000:0.0:1787857708.666537:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188215168:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857708.685243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857708.685565:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171580800 00000100:00100000:0.0:1787857708.685582:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171580800 00000100:00100000:0.0:1787857708.685669:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 807 00000100:00100000:0.0:1787857708.685681:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:23999:x1874704171580800:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787857708.686615:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.686641:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.686685:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.686704:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.686713:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.686719:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.686752:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.686761:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.686767:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857708.686970:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00000004:00200000:0.0:1787857708.686977:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857708.687067:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687082:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687089:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687107:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687114:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857708.687118:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687127:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687144:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:0.0:1787857708.687148:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857708.687155:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687162:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b725 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687189:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687196:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687202:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687207:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857708.687210:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687226:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687236:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3d0032c8 (ffff9998d5316900) 00010000:00010000:0.0:1787857708.687238:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857708.687241:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687246:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b72c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687263:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687270:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687276:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687282:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857708.687286:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687293:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687301:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:0.0:1787857708.687304:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857708.687307:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.687322:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857708.687460:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:23999:x1874704171580800:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 1776us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857708.687471:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 807 00000100:00100000:2.0:1787857708.691990:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857708.692308:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171581056 00000100:00100000:3.0:1787857708.692321:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171581056 00000100:00100000:3.0:1787857708.692392:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 808 00000100:00100000:3.0:1787857708.692404:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:23999:x1874704171581056:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857708.692432:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857708.692462:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b73a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35ca expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.692668:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.692688:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.692703:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857708.692717:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:3.0:1787857708.692937:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.692948:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.692956:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.692963:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857708.692968:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.692987:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.693473:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:3.0:1787857708.693479:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857708.693486:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.693493:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b741 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.693621:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b73a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35ca expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.693635:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857708.693638:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857708.693643:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b73a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35ca expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.693654:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00100000:3.0:1787857708.693788:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23999:x1874704171581056:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1385us (1811us total) trans 4294967827 rc 301/301 00000100:00100000:3.0:1787857708.693798:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 808 00000100:00100000:2.0:1787857708.715328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857708.716328:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171581184 00000100:00100000:0.0:1787857708.716346:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171581184 00000100:00100000:0.0:1787857708.716445:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 809 00000100:00100000:0.0:1787857708.716458:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23999:x1874704171581184:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857708.716507:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857708.717866:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23999:x1874704171581184:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 1360us (2505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.717881:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 809 00000100:00100000:2.0:1787857708.720915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857708.721078:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171581312 00000100:00100000:1.0:1787857708.721091:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171581312 00000100:00100000:1.0:1787857708.721228:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 810 00000100:00100000:1.0:1787857708.721242:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23999:x1874704171581312:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857708.721273:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857708.721302:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b74f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35d1 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.721450:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.721470:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.721485:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.721504:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.721511:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.721518:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722105:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b764 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722118:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722126:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857708.722222:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 7680 00000004:00200000:1.0:1787857708.722227:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857708.722309:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722336:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722343:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722352:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722358:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857708.722369:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722377:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722393:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857708.722396:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857708.722402:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722408:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722423:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722429:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722435:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722447:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857708.722450:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722456:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722465:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff9998c3984600) 00010000:00010000:1.0:1787857708.722468:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857708.722470:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722477:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b75d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722518:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b74f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35d1 expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722534:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1200/0xd3f183cab4a7b764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35d1 expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.722542:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998c3984f00) 00010000:00010000:1.0:1787857708.722545:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857708.722548:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a1200, rc 0) 00000100:00100000:1.0:1787857708.722642:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23999:x1874704171581312:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1403us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.722650:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 810 00000100:00100000:2.0:1787857708.731798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857708.732026:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171581568 00000100:00100000:0.0:1787857708.732040:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171581568 00000100:00100000:0.0:1787857708.732260:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 811 00000100:00100000:0.0:1787857708.732274:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:23999:x1874704171581568:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857708.732307:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857708.732335:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b76b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35d8 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857708.735645:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11:0x0], index 1: 0 00010000:00010000:0.0:1787857708.743914:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b772 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.743944:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.743961:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.744542:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b76b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35d8 expref: 39 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.744647:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b772 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35d8 expref: 38 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.744658:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d5316900) 00010000:00010000:0.0:1787857708.744661:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857708.744666:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4e00, rc 0) 00000100:00100000:0.0:1787857708.747961:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23999:x1874704171581568:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 15671us (16161us total) trans 4294967828 rc 0/0 00000100:00100000:0.0:1787857708.747978:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 811 00000100:00100000:2.0:1787857708.752648:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857708.752859:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171581824 00000100:00100000:3.0:1787857708.752872:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171581824 00000100:00100000:3.0:1787857708.752954:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 812 00000100:00100000:3.0:1787857708.752966:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23999:x1874704171581824:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857708.753073:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857708.753111:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b772 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35d8 expref: 38 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.753135:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d5316900) 00010000:00010000:3.0:1787857708.753158:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857708.753190:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.753208:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.753219:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.753236:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.753243:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.753249:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.753980:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.753993:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754000:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754014:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857708.754019:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754027:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754039:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998c3984f00) 00010000:00010000:3.0:1787857708.754042:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857708.754046:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754053:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b780 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754064:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754070:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754075:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754080:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857708.754082:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754088:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754107:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x2efd8383 (ffff9998d1291200) 00010000:00010000:3.0:1787857708.754110:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857708.754113:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.754119:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b787 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x2efd8383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857708.754239:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23999:x1874704171581824:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1273us (1604us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857708.754248:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 812 00000100:00100000:2.0:1787857708.759524:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857708.759960:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171581952 00000100:00100000:3.0:1787857708.759975:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171581952 00000100:00100000:3.0:1787857708.760055:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 813 00000100:00100000:3.0:1787857708.760068:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23999:x1874704171581952:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857708.760097:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857708.760130:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b78e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35df expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.760194:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.760213:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.760238:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.760750:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b78e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.760782:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.760792:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:3.0:1787857708.760795:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857708.760800:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6200, rc 0) 00000100:00100000:3.0:1787857708.760998:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23999:x1874704171581952:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 933us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857708.761007:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 813 00000100:00100000:2.0:1787857708.769626:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857708.769783:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171582208 00000100:00100000:1.0:1787857708.769864:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171582208 00000100:00100000:1.0:1787857708.769949:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 814 00000100:00100000:1.0:1787857708.769961:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23999:x1874704171582208:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857708.770078:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.770100:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.770114:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857708.770734:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].9, 88 off8840 00000004:00080000:1.0:1787857708.770750:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 532820931811ns, next at 533820927865ns, rc = 0 00000004:00010000:1.0:1787857708.770894:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061be7d65 reply state 00000000a0606ba3 transno 4294967829 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857708.770906:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857708.771048:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:23999:x1874704171582208:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1086us (1435us total) trans 4294967829 rc 0/0 00000100:00100000:1.0:1787857708.771057:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 814 00000100:00100000:2.0:1787857708.775423:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857708.776012:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171582336 00000100:00100000:1.0:1787857708.776028:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171582336 00000100:00100000:1.0:1787857708.776165:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 815 00000100:00100000:1.0:1787857708.776178:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:23999:x1874704171582336:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857708.776227:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857708.776263:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35e6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.776383:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.776401:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.776428:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857708.776432:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857708.776437:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a0600, rc 0) 00000100:00100000:1.0:1787857708.776525:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23999:x1874704171582336:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 350us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.776534:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 815 00010000:00010000:3.0:1787857708.777096:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.777107:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.777115:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.777123:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857708.777128:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.777138:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.777154:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:3.0:1787857708.777157:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857708.777162:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.777178:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b79c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857708.780133:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857708.780398:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171582464 00000100:00100000:1.0:1787857708.780413:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171582464 00000100:00100000:1.0:1787857708.780505:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:1.0:1787857708.780517:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171582464:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787857708.781036:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171582464:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 519us (915us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787857708.781047:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00080000:2.0:1787857708.781617:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787857708.783604:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857708.786674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857708.786786:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171582720 00000100:00100000:0.0:1787857708.786798:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171582720 00000100:00100000:0.0:1787857708.786920:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 164 00000100:00100000:0.0:1787857708.786931:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:23999:x1874704171582720:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857708.787217:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23999:x1874704171582720:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 288us (558us total) trans 4294967830 rc 0/0 00000100:00100000:0.0:1787857708.787331:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 164 00000100:00100000:0.0:1787857708.795205:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857708.795385:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171582976 00000100:00100000:1.0:1787857708.795397:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171582976 00000100:00100000:1.0:1787857708.795489:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 816 00000100:00100000:1.0:1787857708.795501:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23999:x1874704171582976:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857708.795667:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23999:x1874704171582976:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 168us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.795695:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 816 00000100:00100000:2.0:1787857708.800022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857708.800139:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171583104 00000100:00100000:0.0:1787857708.800162:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171583104 00000100:00100000:1.0:1787857708.800649:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 817 00000100:00100000:1.0:1787857708.800666:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23999:x1874704171583104:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857708.800696:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857708.800725:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35ed expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.800874:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b7b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.800894:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.800909:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857708.800970:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857708.800995:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.801025:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35ed expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.801047:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35ed expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.801056:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857708.801059:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787857708.801085:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a1c00, rc 0) 00000100:00100000:1.0:1787857708.801177:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23999:x1874704171583104:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 515us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.801198:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 817 00000100:00100000:2.0:1787857708.810811:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857708.811003:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171583232 00000100:00100000:0.0:1787857708.811017:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171583232 00000100:00100000:0.0:1787857708.811094:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:0.0:1787857708.811106:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171583232:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857708.811161:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857708.811189:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35f4 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857708.811237:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908b2c, blocks: 0x1 00010000:00010000:0.0:1787857708.811268:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1787857708.811275:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857708.811288:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.811311:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.811328:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5600, rc 0) 00000100:00100000:0.0:1787857708.811400:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171583232:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 296us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857708.811408:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:2.0:1787857708.816983:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857708.817121:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171583488 00000100:00100000:1.0:1787857708.817135:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171583488 00000100:00100000:1.0:1787857708.817239:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 818 00000100:00100000:1.0:1787857708.817252:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23999:x1874704171583488:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857708.817395:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23999:x1874704171583488:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 145us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.817403:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 818 00000100:00100000:2.0:1787857708.823015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857708.825270:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171583616 00000100:00100000:3.0:1787857708.825290:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171583616 00000100:00100000:3.0:1787857708.825389:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:3.0:1787857708.825401:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:23999:x1874704171583616:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857708.825426:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857708.825452:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd35fb expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.825494:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.825505:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857708.825510:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857708.825516:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.825561:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.825577:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 12 pid: 6711 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857708.825621:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188215296:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857708.825772:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2f500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857708.835764:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857708.835893:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171583744 00000100:00100000:0.0:1787857708.835906:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171583744 00010000:00010000:0.0:1787857708.835975:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 13 pid: 6711 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857708.836036:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 253 00000100:00100000:0.0:1787857708.836047:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171583744:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857708.836072:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857708.836128:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 13 pid: 6711 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.836163:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 13 pid: 6711 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.836214:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857708.836220:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857708.836232:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.836247:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.836305:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857708.836326:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188215424:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857708.836506:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c73a69c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787857708.837448:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c572eeb2/0xd3f183cab4a7b7b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35f4 expref: 13 pid: 6711 timeout: 632 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857708.837475:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188215296:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857708.837509:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.837524:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7a00, rc 0) 00000100:00100000:3.0:1787857708.837684:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:23999:x1874704171583616:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 12284us (14685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857708.837695:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:2.0:1787857708.845175:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857708.845329:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188215424:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857708.845364:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857708.845442:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171583744:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 9395us (9694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857708.845456:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 253 00000100:00100000:1.0:1787857708.847301:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171583872 00000100:00100000:1.0:1787857708.847321:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171583872 00002000:00100000:1.0:1787857708.847396:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->157) req@ffff9997c2716d00 x1874704171583872/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:354/0 lens 648/0 e 0 to 0 dl 1787857719 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857708.847409:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2716d00 with x1874704171583872 ext(0->157) 00002000:00010000:1.0:1787857708.847415:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c2716d00 00000100:00100000:1.0:1787857708.847460:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:1.0:1787857708.847472:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171583872:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787857708.848396:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171583872:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 919us (3230us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787857708.848409:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 63 00002000:00100000:1.0:1787857708.848419:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->157) req@ffff9997c2716d00 x1874704171583872/t4294967337(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:354/0 lens 648/448 e 0 to 0 dl 1787857719 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857708.848431:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2716d00 with x1874704171583872 ext(0->157) 00002000:00010000:1.0:1787857708.848442:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c2716d00 00000100:00100000:2.0:1787857708.854883:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857708.855121:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171584000 00000100:00100000:1.0:1787857708.855135:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171584000 00000100:00100000:1.0:1787857708.855327:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 819 00000100:00100000:1.0:1787857708.855340:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2715680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:23999:x1874704171584000:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787857708.908413:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967830 is committed 00000004:00080000:0.0:1787857708.908458:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000100:00100000:0.0:1787857708.908653:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188215552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787857708.908751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857708.908878:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188215552 00000100:00100000:0.0:1787857708.908891:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188215552 00000100:00100000:0.0:1787857708.908953:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787857708.908963:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188215552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787857708.909212:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787857708.909226:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1787857708 00002000:00010000:0.0:1787857708.909229:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787857708.909232:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 1787857708 -> 1787857708 00002000:00010000:0.0:1787857708.909235:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787857708.909289:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188215552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 326us (537us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787857708.909297:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000004:00080000:0.0:1787857708.909354:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998ffaa21c0/2, rc 0, transno 4294967338 00000100:00100000:0.0:1787857708.909360:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188215552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787857708.909739:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2715680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23999:x1874704171584000:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 54397us (54866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857708.909749:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 819 00000100:00100000:1.0:1787857708.912657:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857708.912689:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188215680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857708.912788:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857708.912922:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188215680 00000100:00100000:0.0:1787857708.912934:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188215680 00000100:00100000:0.0:1787857708.913083:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787857708.913097:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188215680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857708.913130:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857708.913204:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188215680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857708.913223:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787857708.913315:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188215680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857708.914668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857708.915302:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171584128 00000100:00100000:3.0:1787857708.915313:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171584128 00000100:00100000:3.0:1787857708.915401:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:3.0:1787857708.915412:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171584128:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787857708.971692:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967338 is committed 00000001:00080000:0.0:1787857708.971715:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00000100:00100000:1.0:1787857708.972655:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171584128:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 57233us (57984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857708.972669:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:3.0:1787857708.978966:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857708.979113:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171584384 00000100:00100000:1.0:1787857708.979128:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171584384 00000100:00100000:1.0:1787857708.979226:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 820 00000100:00100000:1.0:1787857708.979239:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23999:x1874704171584384:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857708.979331:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857708.979374:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b7b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35ed expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.979399:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857708.979406:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857708.979451:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.979470:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857708.979484:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857708.979778:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065244007 reply state 000000008fe928d9 transno 4294967831 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857708.979790:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857708.979973:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:23999:x1874704171584384:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 735us (1023us total) trans 4294967831 rc 0/0 00000100:00100000:1.0:1787857708.979982:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 820 00010000:00010000:3.0:1787857708.984004:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.984028:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.984037:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.984045:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857708.984051:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.984061:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.984083:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:3.0:1787857708.984087:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857708.984094:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857708.984102:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b7c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857708.984628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857708.985396:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171584512 00000100:00100000:3.0:1787857708.985412:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171584512 00000100:00100000:3.0:1787857708.985508:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 199 00000100:00100000:3.0:1787857708.985521:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171584512:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787857708.985939:0:14028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:3.0:1787857708.985944:0:14028:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 1787857708 -> 1536580263 00002000:00010000:3.0:1787857708.985948:0:14028:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 0 -> 1787857200 00002000:00010000:3.0:1787857708.985950:0:14028:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 1787857708 -> 1787857707 00002000:00010000:3.0:1787857708.985953:0:14028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787857708.986159:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171584512:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 640us (1536us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1787857708.986168:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 199 00000100:00100000:0.0:1787857708.993746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857708.993890:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171584768 00000100:00100000:2.0:1787857708.993904:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171584768 00000100:00100000:2.0:1787857708.993987:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 821 00000100:00100000:2.0:1787857708.993999:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23999:x1874704171584768:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787857708.994100:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.994123:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.994168:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.994213:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.994231:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 38 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857708.994249:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c27143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188215808:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857708.994367:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998da923e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857708.998610:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857708.999183:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171584896 00000100:00100000:0.0:1787857708.999197:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171584896 00010000:00010000:0.0:1787857708.999254:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 39 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857708.999308:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 254 00000100:00100000:0.0:1787857708.999336:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2350:x1874704171584896:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857708.999355:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857708.999364:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 39 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.999379:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 39 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.999411:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:0.0:1787857708.999418:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.999429:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.999439:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857708.999462:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857708.999521:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2350:x1874704171584896:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 186us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857708.999529:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 254 00010000:00010000:2.0:1787857708.999839:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35df expref: 39 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857708.999869:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c27143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188215808:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857708.999894:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.999905:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.999913:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.999956:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.999965:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.999980:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857708.999988:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857708.999993:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.000002:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.000012:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:2.0:1787857709.000016:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787857709.000020:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.000027:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b7cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857709.000075:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:23999:x1874704171584768:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 6079us (6346us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787857709.000084:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 821 00000100:00100000:1.0:1787857709.003467:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857709.003643:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171585024 00000100:00100000:0.0:1787857709.003657:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171585024 00000100:00100000:0.0:1787857709.003773:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 200 00000100:00100000:0.0:1787857709.003787:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171585024:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857709.003883:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.003937:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.003948:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787857709.003953:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857709.003959:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.004009:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.004027:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 11 pid: 14028 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857709.004047:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188215936:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857709.004220:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857709.010757:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857709.010925:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188215936:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857709.010963:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857709.011505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171585152 00000100:00100000:1.0:1787857709.011516:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171585152 00010000:00010000:1.0:1787857709.011582:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 12 pid: 14028 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857709.011631:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 255 00000100:00100000:1.0:1787857709.011643:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171585152:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857709.011664:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857709.011698:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 12 pid: 14028 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.011713:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 12 pid: 14028 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.011750:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ca83442/0xd3f183cab4a7b7bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35fb expref: 12 pid: 14028 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.011801:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857709.011807:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857709.011814:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.012268:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.013864:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857709.013996:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171585152:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2343us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857709.014012:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 255 00010000:00010000:2.0:1787857709.019006:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.019067:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.019122:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.019132:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.019489:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.019499:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857709.019505:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.019516:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.019984:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.019999:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bc9a564/0xd3f183cab4a7b7d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857709.020676:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171585024:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 16879us (17213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857709.020693:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 200 00000100:00100000:0.0:1787857709.033721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857709.033987:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171585408 00000100:00100000:1.0:1787857709.034001:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171585408 00000100:00100000:1.0:1787857709.034342:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 822 00000100:00100000:1.0:1787857709.034356:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:23999:x1874704171585408:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787857709.034483:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.034507:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.034522:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.034876:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.034909:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.034918:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.034962:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.034978:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 38 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857709.034996:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188216064:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857709.035123:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8600 going to sleep for 11 seconds 00000100:00080000:2.0:1787857709.036888:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857709.043665:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188216064:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857709.043706:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857709.044528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857709.045081:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171585536 00000100:00100000:3.0:1787857709.045094:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171585536 00010000:00010000:3.0:1787857709.045282:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 39 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857709.045443:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 256 00000100:00100000:3.0:1787857709.045457:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2349:x1874704171585536:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857709.045480:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857709.045489:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 39 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.045505:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 39 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.045537:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0600/0xd3f183cab4a7b7a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35e6 expref: 39 pid: 5857 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.045570:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:3.0:1787857709.045595:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.045607:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.045616:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.045651:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857709.045740:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:2349:x1874704171585536:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 286us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857709.045750:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 256 00010000:00010000:1.0:1787857709.045814:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.045861:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857709.046104:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967832 00000001:00080000:1.0:1787857709.046302:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967833 00000001:00080000:1.0:1787857709.046354:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967834 00000100:00100000:1.0:1787857709.046456:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188216192:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857709.046546:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857709.046586:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857709.046891:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188216192 00000100:00100000:2.0:1787857709.046900:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188216192 00000100:00100000:2.0:1787857709.046950:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787857709.046959:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188216192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787857709.047051:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188216192:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857709.047058:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787857709.048096:0:5856:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967338 gen 2 00000004:00080000:1.0:1787857709.048106:0:5856:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9998ffaa21c0, transno 4294967338 00000100:00100000:1.0:1787857709.048144:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188216192:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787857709.049409:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967835 00000100:00100000:1.0:1787857709.049615:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188216320:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857709.049740:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857709.049785:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857709.050783:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188216320 00000100:00100000:2.0:1787857709.050797:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188216320 00000100:00100000:2.0:1787857709.050904:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787857709.050916:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188216320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787857709.051217:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1874704188216320:12345-0@lo:1000:mdt00_000.0 Request processed in 302us (1477us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787857709.051227:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787857709.051476:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188216320:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787857709.051528:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.051884:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.051897:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.051904:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857709.051909:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.051918:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.051939:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857709.051942:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857709.051949:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.051974:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b7e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052017:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052024:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052029:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052034:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857709.052037:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052042:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052050:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:1.0:1787857709.052052:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857709.052060:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b71e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35c3 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052073:0:5856:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b71e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35c3 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052084:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b71e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35c3 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.052241:0:5856:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4400/0xd3f183cab4a7b71e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd35c3 expref: 77 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857709.052262:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa80780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188216448:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857709.052386:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857709.061620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857709.061731:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171585664 00000100:00100000:2.0:1787857709.061744:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171585664 00000100:00100000:2.0:1787857709.061888:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 165 00000100:00100000:2.0:1787857709.061901:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+78:23997:x1874704171585664:12345-192.168.204.36@tcp:49:cat.0 00000100:00100000:2.0:1787857709.062096:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+78:23997:x1874704171585664:12345-192.168.204.36@tcp:49:cat.0 Request processed in 198us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857709.062105:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 165 00000100:00080000:3.0:1787857709.062331:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857709.063558:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa80780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188216448:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857709.063598:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063612:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b717 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063664:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063686:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063702:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063715:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063723:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063730:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063757:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a1a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857709.063761:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063769:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063784:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:1.0:1787857709.063788:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857709.063793:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063799:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b7e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063810:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063860:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063866:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063872:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a1000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857709.063875:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063881:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063900:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:1.0:1787857709.063902:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857709.063906:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.063911:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b7db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857709.064454:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857709.064461:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857709.064972:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787857709.064985:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857709.066033:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23999:x1874704171585408:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 31669us (32317us total) trans 4294967836 rc 0/0 00000100:00100000:1.0:1787857709.066048:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 822 00000020:00080000:1.0:1787857709.066057:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787857709.067622:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857709.068200:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171585792 00000100:00100000:1.0:1787857709.068212:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171585792 00000100:00100000:1.0:1787857709.068311:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 201 00000100:00100000:1.0:1787857709.068323:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+10:23997:x1874704171585792:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857709.068346:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857709.068371:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a3e6982/0xd3f183cab4a7b7f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3602 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857709.068405:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a908930, ctime: 0x6a908b2b, blocks: 0xb 00010000:00010000:1.0:1787857709.068433:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1787857709.068439:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857709.068450:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a3e6982/0xd3f183cab4a7b7f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3602 expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.068469:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a3e6982/0xd3f183cab4a7b7f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3602 expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857709.068496:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a1600, rc 0) 00000100:00100000:1.0:1787857709.068560:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:23997:x1874704171585792:12345-192.168.204.36@tcp:101:cat.0 Request processed in 240us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857709.068567:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 201 00000100:00080000:3.0:1787857709.068755:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857709.074185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857709.074291:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171586048 00000100:00100000:2.0:1787857709.074304:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171586048 00000100:00100000:2.0:1787857709.074382:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 166 00000100:00100000:2.0:1787857709.074396:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:23999:x1874704171586048:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787857709.075307:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787857709.075444:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967837 00010000:00010000:2.0:1787857709.075514:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.075537:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.075553:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.075563:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.075570:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.075578:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.075608:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857709.075762:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:23999:x1874704171586048:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1364us (1588us total) trans 4294967838 rc 0/0 00000100:00100000:2.0:1787857709.075773:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 166 00000020:00080000:2.0:1787857709.075780:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857709.076495:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857709.076509:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.076522:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857709.076527:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.076549:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.076570:0:17404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9998e18d9200) 00010000:00010000:0.0:1787857709.076575:0:17404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857709.076582:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.076591:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b7f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857709.076618:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857709.076620:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857709.076622:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857709.087511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857709.091260:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171586176 00000100:00100000:2.0:1787857709.091286:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171586176 00002000:00100000:2.0:1787857709.091414:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x11:0x0] (0->4095) req@ffff9998f9d1e1c0 x1874704171586176/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:355/0 lens 488/0 e 0 to 0 dl 1787857720 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857709.091429:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d1e1c0 with x1874704171586176 ext(0->4095) 00002000:00010000:2.0:1787857709.091436:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f9d1e1c0 00000100:00100000:2.0:1787857709.091498:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:2.0:1787857709.091509:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171586176:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:2.0:1787857709.092249:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171586176:12345-192.168.204.36@tcp:3:cat.0 Request processed in 736us (4755us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857709.092260:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 64 00002000:00100000:2.0:1787857709.092270:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x11:0x0] (0->4095) req@ffff9998f9d1e1c0 x1874704171586176/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:355/0 lens 488/4536 e 0 to 0 dl 1787857720 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857709.092279:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d1e1c0 with x1874704171586176 ext(0->4095) 00002000:00010000:2.0:1787857709.092284:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f9d1e1c0 00000100:00100000:3.0:1787857709.097354:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857709.100899:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171586432 00000100:00100000:0.0:1787857709.100926:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171586432 00000100:00100000:0.0:1787857709.101034:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 167 00000100:00100000:0.0:1787857709.101047:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6123c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+78:23997:x1874704171586432:12345-192.168.204.36@tcp:35:cat.0 00000001:00080000:0.0:1787857709.101422:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967839 00000100:00100000:0.0:1787857709.101606:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6123c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:23997:x1874704171586432:12345-192.168.204.36@tcp:35:cat.0 Request processed in 560us (4269us total) trans 4294967840 rc 0/0 00000100:00100000:0.0:1787857709.101640:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 167 00000020:00080000:0.0:1787857709.101647:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787857709.141041:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857709.141563:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171586688 00000100:00100000:3.0:1787857709.141579:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171586688 00000100:00100000:3.0:1787857709.141669:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 823 00000100:00100000:3.0:1787857709.141681:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+80:24002:x1874704171586688:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857709.141718:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857709.141747:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b7fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3609 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.141969:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.141989:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142004:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142043:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142052:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142060:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142562:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142575:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142584:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857709.142597:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:3.0:1787857709.142729:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142738:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142746:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142753:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857709.142758:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142778:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142794:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9998c3984f00) 00010000:00010000:3.0:1787857709.142798:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857709.142804:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142810:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b805 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142872:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142879:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142885:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142890:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857709.142892:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142898:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142905:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff9998d1291200) 00010000:00010000:3.0:1787857709.142907:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857709.142910:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142925:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b80c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.142986:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b7fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3609 expref: 83 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.143002:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7a00/0xd3f183cab4a7b813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3609 expref: 82 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.143009:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:3.0:1787857709.143011:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857709.143014:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7a00, rc 0) 00000100:00100000:3.0:1787857709.143102:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:24002:x1874704171586688:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1423us (2078us total) trans 4294967841 rc 0/0 00000100:00100000:3.0:1787857709.143113:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 823 00000100:00100000:1.0:1787857709.147099:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857709.147211:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171586816 00000100:00100000:3.0:1787857709.147227:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171586816 00000100:00100000:3.0:1787857709.147309:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 824 00000100:00100000:3.0:1787857709.147320:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+82:24002:x1874704171586816:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:3.0:1787857709.147407:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147429:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147444:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147509:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147517:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147525:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147532:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857709.147549:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147559:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147575:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:3.0:1787857709.147578:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857709.147585:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857709.147591:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857709.147693:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+82:24002:x1874704171586816:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 373us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857709.147701:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 824 00000100:00100000:0.0:1787857709.151158:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857709.151299:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171587072 00000100:00100000:2.0:1787857709.151312:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171587072 00000100:00100000:2.0:1787857709.151384:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 168 00000100:00100000:2.0:1787857709.151397:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:24002:x1874704171587072:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1787857709.151745:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+83:24002:x1874704171587072:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 350us (615us total) trans 4294967842 rc 0/0 00000100:00100000:2.0:1787857709.151753:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 168 00000100:00100000:0.0:1787857709.282483:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857709.282909:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171587328 00000100:00100000:2.0:1787857709.282922:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171587328 00000100:00100000:2.0:1787857709.283009:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 825 00000100:00100000:2.0:1787857709.283022:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+83:24018:x1874704171587328:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:2.0:1787857709.283077:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857709.283105:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b828 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3610 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.283274:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b82f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.283476:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b82f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.283494:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b82f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857709.283509:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:2.0:1787857709.283763:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b828 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3610 expref: 86 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.283790:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52800/0xd3f183cab4a7b82f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3610 expref: 85 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857709.283801:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9998c3984e00) 00010000:00010000:2.0:1787857709.283806:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787857709.283811:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52800, rc 0) 00000100:00100000:2.0:1787857709.284086:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+85:24018:x1874704171587328:12345-192.168.204.36@tcp:101:diff.0 Request processed in 1065us (1619us total) trans 4294967843 rc 0/0 00000100:00100000:2.0:1787857709.284095:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 825 00010000:00010000:3.0:1787857709.806144:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857710.162799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857710.162914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857710.162950:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857710.162993:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857710.163026:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857710.163058:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857710.163093:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857710.163133:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171587456 00000100:00100000:1.0:1787857710.163133:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171587840 00000100:00100000:2.0:1787857710.163145:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171587456 00000100:00100000:1.0:1787857710.163145:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171587840 00000100:00100000:1.0:1787857710.163211:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171588096 00000100:00100000:1.0:1787857710.163216:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171588096 00000100:00100000:2.0:1787857710.163222:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 538 00000100:00100000:1.0:1787857710.163243:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171587712 00000100:00100000:1.0:1787857710.163248:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171587712 00000100:00100000:2.0:1787857710.163257:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171587456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857710.163264:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171588224 00000100:00100000:1.0:1787857710.163268:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171588224 00000100:00100000:1.0:1787857710.163286:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:1.0:1787857710.163294:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171587840:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857710.163367:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171587456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 114us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857710.163375:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 538 00000100:00100000:2.0:1787857710.163428:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00100000:2.0:1787857710.163436:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171588096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857710.163523:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 320 00000100:00100000:0.0:1787857710.163535:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171587712:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857710.163589:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171587840:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 296us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857710.163597:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:1.0:1787857710.163612:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 321 00000100:00100000:1.0:1787857710.163627:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171588224:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857710.163656:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171588224:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857710.163662:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 321 00000100:00100000:1.0:1787857710.163684:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171587584 00000100:00100000:1.0:1787857710.163688:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171587584 00000100:00100000:1.0:1787857710.163719:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171587968 00000100:00100000:1.0:1787857710.163722:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171587968 00000100:00100000:1.0:1787857710.163741:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:1.0:1787857710.163748:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:2347:x1874704171587584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857710.163788:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:2347:x1874704171587584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857710.163794:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:1.0:1787857710.163806:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00100000:1.0:1787857710.163812:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2347:x1874704171587968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857710.163882:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2347:x1874704171587968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 70us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857710.163888:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00080000:3.0:1787857710.164697:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857710.164917:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857710.170446:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171588096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 6988us (7472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857710.170468:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00100000:0.0:1787857710.173378:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171587712:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 9825us (10329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857710.173398:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 320 00010000:00010000:2.0:1787857710.832441:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857711.857137:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857711.982172:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857711.982208:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188216576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857711.982310:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857711.987276:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188216576 00000100:00100000:0.0:1787857711.987300:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188216576 00000100:00100000:0.0:1787857711.987717:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787857711.987732:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188216576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857711.987802:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857711.988070:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188216576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 341us (5759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857711.988080:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787857711.990045:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188216576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787857711.992001:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787857712.888734:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857713.200321:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857713.200335:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857713.203373:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 20 count 2 00000040:00080000:0.0:1787857713.203393:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857713.518723:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188217088:0@lo:400:kworker.0 00000100:00100000:1.0:1787857713.518872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857713.518959:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857713.518978:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188216960:0@lo:400:kworker.0 00000100:00100000:1.0:1787857713.519011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857713.519052:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188216960 00000100:00100000:1.0:1787857713.519078:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188216960 00000100:00100000:1.0:1787857713.519150:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787857713.519162:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188216960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857713.519224:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188216960:12345-0@lo:400:kworker.0 Request processed in 65us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857713.519231:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787857713.519887:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188217088 00000100:00100000:0.0:1787857713.519895:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188217088 00000100:00100000:0.0:1787857713.519940:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787857713.519967:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188217088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857713.520012:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188217088:12345-0@lo:400:kworker.0 Request processed in 57us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857713.520019:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:0.0:1787857713.520037:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857713.520042:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857713.520098:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188216960:0@lo:400:kworker.0 00000100:00100000:0.0:1787857713.520109:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188217088:0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.521601:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188216704:0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.521691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857713.521740:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188217216:0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.521782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857713.521813:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787857713.521843:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188216832:0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.521879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857713.521899:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188217344:0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.521924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857713.521960:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188216704 00000100:00100000:2.0:1787857713.522065:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188216704 00000100:00100000:2.0:1787857713.522114:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1787857713.522122:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188216704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.522191:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188216704:12345-0@lo:400:kworker.0 Request processed in 69us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857713.522200:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1787857713.522236:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188217216 00000100:00100000:2.0:1787857713.522240:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188217216 00000100:00100000:2.0:1787857713.522276:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188216832 00000100:00100000:2.0:1787857713.522278:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188216832 00000100:00100000:2.0:1787857713.522294:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787857713.522299:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188217216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.522328:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188217216:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857713.522334:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787857713.522343:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787857713.522348:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188216832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.522367:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188216832:12345-0@lo:400:kworker.0 Request processed in 19us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857713.522373:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787857713.522387:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188217344 00000100:00100000:2.0:1787857713.522390:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188217344 00000100:00100000:2.0:1787857713.522415:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787857713.522423:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188217344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857713.522451:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188217344:12345-0@lo:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857713.522457:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:3.0:1787857713.532410:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857713.532428:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857713.532528:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188216832:0@lo:400:kworker.0 00000100:00100000:3.0:1787857713.532555:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188217344:0@lo:400:kworker.0 00000100:00100000:3.0:1787857713.532569:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188216704:0@lo:400:kworker.0 00000100:00100000:3.0:1787857713.532585:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188217216:0@lo:400:kworker.0 00010000:00010000:3.0:1787857713.906936:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857714.037772:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188217472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857714.040145:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857714.040243:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188217472 00000100:00100000:2.0:1787857714.040251:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188217472 00000100:00100000:2.0:1787857714.040302:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787857714.040313:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188217472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857714.040351:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857714.040402:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188217472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857714.040410:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787857714.040545:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188217472:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787857714.119591:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967840 is committed 00000001:00080000:0.0:1787857714.119616:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967836 is committed 00000020:00080000:0.0:1787857714.119624:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998f70f8a80 refcount 2 committed 0 result 0 batchid 12 00000020:00080000:0.0:1787857714.119630:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f715d600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998f70f8f00 00000020:00080000:0.0:1787857714.119634:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f715dd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff999900d52c00 00000001:00080000:0.0:1787857714.119661:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967843 is committed 00000001:00080000:0.0:1787857714.119669:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967838 is committed 00000020:00080000:0.0:1787857714.119688:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12 committed batchid 11 00000020:00080000:0.0:1787857714.119936:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00000001:00080000:3.0:1787857714.136129:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967340 is committed 00000001:00080000:3.0:1787857714.136156:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00010000:00010000:2.0:1787857714.926214:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857714.941884:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857714.942086:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171588352 00000100:00100000:2.0:1787857714.942100:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171588352 00000100:00100000:2.0:1787857714.942201:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 826 00000100:00100000:2.0:1787857714.942216:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23945:x1874704171588352:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787857714.942368:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:23945:x1874704171588352:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 155us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857714.942378:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 826 00000100:00080000:3.0:1787857714.943012:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857715.299688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857715.299752:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857715.299787:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857715.299881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857715.299939:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857715.299972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857715.300012:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171588480 00000100:00100000:2.0:1787857715.300040:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171588480 00000100:00100000:2.0:1787857715.300122:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 540 00000100:00100000:2.0:1787857715.300134:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171588480:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857715.300250:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171588480:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 118us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857715.300259:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 540 00000100:00100000:0.0:1787857715.300389:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171588864 00000100:00100000:0.0:1787857715.300394:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171588864 00000100:00100000:0.0:1787857715.300449:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171589120 00000100:00100000:0.0:1787857715.300452:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171589120 00000100:00100000:0.0:1787857715.300465:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171588736 00000100:00100000:0.0:1787857715.300467:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171588736 00000100:00100000:0.0:1787857715.300477:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171588992 00000100:00100000:0.0:1787857715.300480:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171588992 00000100:00100000:0.0:1787857715.300495:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 324 00000100:00100000:0.0:1787857715.300501:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171588864:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857715.300541:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171588864:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857715.300548:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 324 00000100:00100000:0.0:1787857715.300561:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 325 00000100:00100000:0.0:1787857715.300567:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171589120:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857715.300593:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171589120:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857715.300599:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 325 00000100:00100000:0.0:1787857715.300610:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 326 00000100:00100000:0.0:1787857715.300615:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171588736:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857715.300636:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171588736:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857715.300642:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 326 00000100:00100000:0.0:1787857715.300651:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 327 00000100:00100000:0.0:1787857715.300657:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171588992:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857715.300679:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171588992:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857715.300684:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 327 00000100:00100000:3.0:1787857715.301132:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171588608 00000100:00100000:3.0:1787857715.301142:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171588608 00000100:00100000:3.0:1787857715.301200:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00100000:3.0:1787857715.301209:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+80:2349:x1874704171588608:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857715.301249:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+80:2349:x1874704171588608:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 42us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857715.301255:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00080000:3.0:1787857715.301277:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857715.301282:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857715.301285:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857715.950155:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857716.823115:0:18326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12c: Restore a file with stripe of 2 == 15:08:34 (1787857714) 00010000:00010000:1.0:1787857716.976068:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857717.102836:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857717.102864:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188217600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857717.102947:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857717.103079:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188217600 00000100:00100000:3.0:1787857717.103097:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188217600 00000100:00100000:3.0:1787857717.103219:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787857717.103969:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188217600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857717.104041:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857717.104160:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188217600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857717.104171:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1787857717.107121:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857717.107225:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188217600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857717.114654:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857717.116170:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171589248 00000100:00100000:2.0:1787857717.116193:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171589248 00000100:00080000:0.0:1787857717.116275:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857717.116299:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 827 00000100:00100000:2.0:1787857717.116313:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:24632:x1874704171589248:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787857717.116470:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:24632:x1874704171589248:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 160us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857717.116479:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 827 00000100:00100000:1.0:1787857717.135959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.136001:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171589376 00000100:00100000:1.0:1787857717.136011:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171589376 00000100:00100000:1.0:1787857717.136080:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 828 00000100:00100000:1.0:1787857717.136091:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+80:24633:x1874704171589376:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857717.136113:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857717.136136:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b83d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3617 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136209:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136226:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136238:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136254:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136261:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136277:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136566:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136574:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136579:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136584:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857717.136588:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136595:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136608:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857717.136610:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857717.136615:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136622:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136632:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136638:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136649:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136654:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a1e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857717.136657:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136662:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136670:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff9998c3984a00) 00010000:00010000:1.0:1787857717.136683:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857717.136696:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136702:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b84b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136735:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b83d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3617 expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136745:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857717.136748:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857717.136751:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0c00/0xd3f183cab4a7b83d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3617 expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.136761:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a0c00, rc 0) 00000100:00100000:1.0:1787857717.136832:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+80:24633:x1874704171589376:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 728us (867us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857717.136848:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 828 00000100:00080000:1.0:1787857717.136873:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857717.146403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857717.146461:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171589632 00000100:00100000:3.0:1787857717.146475:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171589632 00000100:00100000:3.0:1787857717.146559:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 829 00000100:00100000:3.0:1787857717.146571:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+80:24633:x1874704171589632:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:3.0:1787857717.146660:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857717.146711:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b63e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3584 expref: 80 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.146738:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857717.146745:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857717.147435:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.147459:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.147471:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.147531:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.147567:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 34 pid: 5858 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857717.147588:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188217728:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857717.147746:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857717.162080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.162127:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171589760 00000100:00100000:1.0:1787857717.162136:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171589760 00010000:00010000:1.0:1787857717.162175:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 35 pid: 5858 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857717.162210:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 257 00000100:00100000:1.0:1787857717.162220:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2349:x1874704171589760:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857717.162364:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857717.162374:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 35 pid: 5858 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.162389:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 35 pid: 5858 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.162413:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857717.162431:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.162441:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.162448:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.162469:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857717.163678:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b668 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3592 expref: 35 pid: 5858 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857717.163724:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188217728:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857717.163755:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.163766:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.163773:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.163807:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.163927:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.163941:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857717.165408:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:2349:x1874704171589760:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3174us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857717.165507:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 257 00000004:00200000:3.0:1787857717.166971:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00010000:00010000:3.0:1787857717.167084:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.167097:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.167105:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.167113:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857717.167118:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.167128:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.167152:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857717.167157:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857717.167165:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.167171:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b852 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857717.167197:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043949c69 reply state 000000009d0e76c1 transno 4294967844 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857717.167209:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857717.167494:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+81:24633:x1874704171589632:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 20919us (21112us total) trans 4294967844 rc 0/0 00000100:00100000:3.0:1787857717.167505:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 829 00010000:00010000:3.0:1787857717.173949:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.175644:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.175659:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.175668:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857717.175676:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.175698:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.175728:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff9998d1291200) 00010000:00010000:3.0:1787857717.175733:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857717.175740:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.175749:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b859 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857717.202868:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857717.203227:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171589888 00000100:00100000:3.0:1787857717.203245:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171589888 00000100:00100000:3.0:1787857717.203336:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 830 00000100:00100000:3.0:1787857717.203350:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+80:24634:x1874704171589888:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857717.203400:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857717.203433:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b860 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd361e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.203559:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b867 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.203578:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.203593:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857717.203677:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857717.203808:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857717.203888:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.203922:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b860 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd361e expref: 82 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.203945:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b867 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd361e expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.203954:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:3.0:1787857717.203958:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857717.203962:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00100000:3.0:1787857717.204059:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+81:24634:x1874704171589888:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 712us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857717.204067:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 830 00000100:00100000:1.0:1787857717.207216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857717.207394:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171590016 00000100:00100000:2.0:1787857717.207404:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171590016 00000100:00100000:2.0:1787857717.207470:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 831 00000100:00100000:2.0:1787857717.207478:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+81:24634:x1874704171590016:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857717.207499:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857717.207518:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7b86e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3625 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207580:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207594:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207605:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207632:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207639:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207646:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207769:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207776:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207782:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857717.207809:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:2.0:1787857717.207812:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857717.207982:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.207996:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208003:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208010:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208025:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857717.208029:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208037:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208049:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:2.0:1787857717.208052:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857717.208057:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208063:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208078:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208083:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208089:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208095:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857717.208097:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208103:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208117:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff9998e18d9f00) 00010000:00010000:2.0:1787857717.208119:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857717.208122:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208128:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b87c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208157:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7b86e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3625 expref: 83 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208169:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3625 expref: 82 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.208176:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:2.0:1787857717.208178:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857717.208180:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53000, rc 0) 00000100:00100000:2.0:1787857717.208396:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+82:24634:x1874704171590016:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 917us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857717.208404:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 831 00000100:00100000:3.0:1787857717.226613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.231613:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171590272 00000100:00100000:1.0:1787857717.231632:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171590272 00000100:00100000:1.0:1787857717.231739:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 832 00000100:00100000:1.0:1787857717.231751:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:24634:x1874704171590272:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857717.232001:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857717.232026:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b88a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd362c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.232189:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.232206:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.232218:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.232950:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.232967:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.232976:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234042:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234059:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234069:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857717.234080:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00010000:00010000:1.0:1787857717.234106:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234113:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234119:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234125:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a1c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857717.234130:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234138:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234150:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857717.234153:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857717.234157:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234175:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b891 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857717.234189:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d7fa89e reply state 000000001b590255 transno 4294967845 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857717.234198:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857717.234496:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b88a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 85 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234516:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 84 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.234525:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9998c3984300) 00010000:00010000:1.0:1787857717.234527:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857717.234530:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a1a00, rc 0) 00000100:00100000:1.0:1787857717.234612:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:24634:x1874704171590272:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2864us (8011us total) trans 4294967845 rc 0/0 00000100:00100000:1.0:1787857717.234620:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 832 00000100:00100000:3.0:1787857717.254398:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857717.254632:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171590528 00000100:00100000:0.0:1787857717.254645:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171590528 00000100:00100000:0.0:1787857717.254725:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 833 00000100:00100000:0.0:1787857717.254735:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+85:24634:x1874704171590528:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857717.254758:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857717.254778:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b8ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3633 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.254917:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.254935:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.254946:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.254984:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.254999:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 86 pid: 5856 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857717.255014:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d11a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188217856:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857717.255123:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee900 going to sleep for 11 seconds 00010000:00010000:2.0:1787857717.257785:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.257804:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.257811:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.257855:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a1000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857717.257860:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.257868:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.257886:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff9998c3984a00) 00010000:00010000:2.0:1787857717.257889:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857717.257893:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857717.257900:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1000/0xd3f183cab4a7b898 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857717.258191:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d11a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188217856:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857717.258224:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857717.260488:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857717.260668:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171590656 00000100:00100000:0.0:1787857717.260692:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171590656 00010000:00010000:0.0:1787857717.260745:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 86 pid: 5856 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857717.260784:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 258 00000100:00100000:0.0:1787857717.260794:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+86:2350:x1874704171590656:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857717.260810:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857717.260860:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 86 pid: 5856 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.260874:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 86 pid: 5856 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.260899:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1a00/0xd3f183cab4a7b89f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd362c expref: 86 pid: 5856 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.260919:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9998c3984300) 00010000:00010000:0.0:1787857717.260924:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.260933:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.260941:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.260993:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857717.261064:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+85:2350:x1874704171590656:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 270us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857717.261073:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 258 00010000:00010000:1.0:1787857717.261152:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.261160:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857717.261192:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00000004:00080000:1.0:1787857717.261885:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00000004:00080000:1.0:1787857717.261899:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:1.0:1787857717.262055:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262065:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262072:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262078:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857717.262083:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262091:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262105:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9998c3984300) 00010000:00010000:1.0:1787857717.262109:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857717.262113:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262120:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b8b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262173:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b8ad lrc: 1/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3633 expref: 85 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262184:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857717.262187:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857717.262191:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b8ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3633 expref: 85 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.262213:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857717.262728:0:7958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d11a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1874704188217984:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787857717.262791:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+84:24634:x1874704171590528:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 8057us (8415us total) trans 4294967846 rc 301/301 00000100:00100000:1.0:1787857717.262800:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 833 00000100:00100000:1.0:1787857717.271079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857717.271373:0:7958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857717.271426:0:7958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee900 going to sleep for 11 seconds 00000100:00100000:1.0:1787857717.271576:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188217984 00000100:00100000:1.0:1787857717.271585:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188217984 00000100:00100000:1.0:1787857717.271663:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787857717.271673:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:7958:x1874704188217984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787857717.271734:0:8490:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787857717.273556:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171590912 00000100:00100000:3.0:1787857717.273566:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171590912 00000100:00100000:3.0:1787857717.273613:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 169 00000100:00100000:3.0:1787857717.273621:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+84:24634:x1874704171590912:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1787857717.274000:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+85:24634:x1874704171590912:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 378us (2930us total) trans 4294967847 rc 0/0 00000100:00100000:3.0:1787857717.274008:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 169 00000100:00080000:0.0:1787857717.276473:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857717.277551:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857717.277864:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171591040 00000100:00100000:3.0:1787857717.277877:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171591040 00000100:00100000:3.0:1787857717.277951:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 834 00000100:00100000:3.0:1787857717.277963:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+85:24634:x1874704171591040:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857717.278007:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857717.278038:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b8c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd363a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.278120:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b8c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd363a expref: 86 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.278137:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b8c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd363a expref: 86 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.278159:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857717.278163:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857717.278168:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:3.0:1787857717.278248:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+86:24634:x1874704171591040:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 287us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857717.278275:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 834 00000100:00100000:2.0:1787857717.281308:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857717.281673:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171591296 00000100:00100000:3.0:1787857717.281700:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171591296 00000100:00100000:3.0:1787857717.281793:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 170 00000100:00100000:3.0:1787857717.281807:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+86:24634:x1874704171591296:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1787857717.282339:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+87:24634:x1874704171591296:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 534us (1046us total) trans 4294967848 rc 0/0 00000100:00100000:3.0:1787857717.282349:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 170 00000040:00080000:3.0:1787857717.294197:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857717.294209:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857717.294695:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787857717.294707:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857717.349470:0:7958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967340 gen 2 00000004:00080000:0.0:1787857717.349487:0:7958:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967340 committed transno 4294967340 00000100:00100000:0.0:1787857717.349525:0:7958:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9998f9d11a40 x1874704188217984/t4294967341(4294967341) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787857733 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857717.349542:0:7958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d11a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1874704188217984:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787857717.349562:0:7958:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1787857717.356966:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7958:x1874704188217984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 85274us (85572us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787857717.356999:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787857717.407238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.407363:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171591424 00000100:00100000:1.0:1787857717.407380:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171591424 00000100:00100000:1.0:1787857717.407485:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 835 00000100:00100000:1.0:1787857717.407496:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+87:24640:x1874704171591424:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:1.0:1787857717.407525:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857717.407547:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b8c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3641 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.407624:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b8d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.407640:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.407654:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857717.407755:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:1.0:1787857717.407759:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857717.407783:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.407811:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b8c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3641 expref: 89 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.407879:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3641 expref: 88 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.407888:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857717.407892:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857717.407896:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a1c00, rc 0) 00000100:00100000:0.0:1787857717.408059:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+88:24640:x1874704171591424:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 558us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857717.408072:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 835 00000100:00100000:2.0:1787857717.416328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857717.416521:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171591552 00000100:00100000:3.0:1787857717.416537:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171591552 00000100:00100000:3.0:1787857717.416623:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 836 00000100:00100000:3.0:1787857717.416635:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+88:24641:x1874704171591552:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857717.416664:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857717.416705:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b8d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3648 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.416800:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.416862:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.416879:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.416916:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.416924:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.416932:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417164:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b8ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417174:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417180:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857717.417228:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00000004:00200000:3.0:1787857717.417234:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857717.417262:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417277:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417287:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417294:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417314:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417321:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857717.417325:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417335:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417351:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:3.0:1787857717.417354:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857717.417360:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417368:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7b8de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417749:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417759:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417764:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417769:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857717.417772:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417793:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417802:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff9998d1291d00) 00010000:00010000:3.0:1787857717.417805:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857717.417809:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417865:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7b8e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417920:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7b8d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3648 expref: 90 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417939:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b8ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3648 expref: 89 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.417948:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857717.417951:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857717.417954:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6600, rc 0) 00000100:00100000:3.0:1787857717.418064:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:24641:x1874704171591552:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1430us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857717.418073:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 836 00000100:00100000:2.0:1787857717.421493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857717.421541:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857717.421667:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171591680 00000100:00100000:0.0:1787857717.421694:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171591680 00000100:00100000:0.0:1787857717.421802:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171591808 00000100:00100000:0.0:1787857717.421806:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171591808 00000100:00100000:0.0:1787857717.421875:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:0.0:1787857717.421886:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171591680:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857717.421908:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857717.421932:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd364f expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857717.421982:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857717.422004:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1787857717.422009:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857717.422020:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.422040:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.422054:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857717.422124:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171591680:12345-192.168.204.36@tcp:101:rm.0 Request processed in 240us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857717.422131:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:0.0:1787857717.422151:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:0.0:1787857717.422158:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2347:x1874704171591808:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857717.422165:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857717.422189:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3656 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857717.422206:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857717.422220:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1787857717.422222:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857717.422227:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.422257:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.422266:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4000, rc 0) 00000100:00100000:0.0:1787857717.422287:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171591808:12345-192.168.204.36@tcp:101:rm.0 Request processed in 131us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857717.422294:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00080000:2.0:1787857717.422667:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857717.422673:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857717.430749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857717.430923:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171592064 00000100:00100000:0.0:1787857717.430935:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171592064 00000100:00100000:0.0:1787857717.431004:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 837 00000100:00100000:0.0:1787857717.431015:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+89:24641:x1874704171592064:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:0.0:1787857717.431076:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787857717.431107:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7b8ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3648 expref: 89 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431129:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7b8c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd363a expref: 88 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431140:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:0.0:1787857717.431159:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1c00/0xd3f183cab4a7b8d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3641 expref: 87 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431169:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:0.0:1787857717.431173:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857717.431350:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431364:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431374:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431389:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431396:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431403:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431702:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431711:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.431718:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857717.435627:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].10, 64 off8904 00000004:00080000:0.0:1787857717.435646:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 541485828263ns, next at 542485824739ns, rc = 0 00000040:00080000:0.0:1787857717.435720:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8664 00000004:00080000:0.0:1787857717.435728:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 541485910416ns, next at 542485908921ns, rc = 0 00010000:00010000:0.0:1787857717.436859:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.436903:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.436917:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.436926:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.436933:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.436940:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.436963:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857717.436986:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.436993:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.436999:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437006:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857717.437010:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437017:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437041:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:0.0:1787857717.437044:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857717.437049:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437055:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7b90f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437079:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437085:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437091:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437097:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857717.437100:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437106:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437114:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:0.0:1787857717.437116:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857717.437119:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.437125:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7b901 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857717.437146:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fddd6be4 reply state 00000000d5387951 transno 4294967849 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857717.437156:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857717.437265:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+88:24641:x1874704171592064:12345-192.168.204.36@tcp:36:rm.0 Request processed in 6247us (6525us total) trans 4294967849 rc 0/0 00000100:00100000:0.0:1787857717.437275:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 837 00010000:00010000:3.0:1787857717.437591:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857717.437599:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.437606:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857717.437615:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.437622:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.437631:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:3.0:1787857717.437634:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857717.437637:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.437642:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7b916 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.437658:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857717.437660:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857717.437662:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857717.440117:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.440136:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.440143:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.440150:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857717.440154:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.440162:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.440195:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff9998d5316900) 00010000:00010000:3.0:1787857717.440198:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857717.440202:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.440208:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7b908 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857717.454051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.454248:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171592320 00000100:00100000:1.0:1787857717.454259:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171592320 00000100:00100000:1.0:1787857717.454322:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 838 00000100:00100000:1.0:1787857717.454332:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+87:24642:x1874704171592320:12345-192.168.204.36@tcp:101:dd.0 00010000:00010000:1.0:1787857717.454357:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857717.454390:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b91d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd365d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.454550:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.454564:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.454590:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.454606:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.454613:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.454618:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857717.455169:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:1.0:1787857717.455346:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455357:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455366:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455397:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455403:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455409:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455415:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857717.455427:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455435:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455448:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857717.455451:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857717.455455:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455462:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b924 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857717.455475:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007417950f reply state 00000000b9b1bc9d transno 4294967850 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857717.455484:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857717.455511:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b91d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 90 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455524:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 89 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.455532:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857717.455534:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857717.455536:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a1800, rc 0) 00000100:00100000:1.0:1787857717.455612:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+90:24642:x1874704171592320:12345-192.168.204.36@tcp:101:dd.0 Request processed in 1282us (1571us total) trans 4294967850 rc 0/0 00000100:00100000:1.0:1787857717.455621:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 838 00010000:00010000:3.0:1787857717.457857:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.457874:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.457883:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.457889:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c31a0800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857717.457893:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.457900:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.457917:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff9998c3984300) 00010000:00010000:3.0:1787857717.457920:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857717.457924:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857717.457930:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0800/0xd3f183cab4a7b92b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857717.462626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857717.462807:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171592448 00000100:00100000:0.0:1787857717.462871:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171592448 00000100:00100000:0.0:1787857717.462955:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 205 00000100:00100000:0.0:1787857717.462969:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:24642:x1874704171592448:12345-192.168.204.36@tcp:101:dd.0 00010000:00010000:0.0:1787857717.463005:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857717.463036:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3664 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857717.463074:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857717.463108:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1787857717.463114:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857717.463127:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 13 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.463148:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 13 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857717.463164:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5800, rc 0) 00000100:00100000:0.0:1787857717.463248:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:24642:x1874704171592448:12345-192.168.204.36@tcp:101:dd.0 Request processed in 282us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857717.463265:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 205 00000100:00100000:0.0:1787857717.484659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.484902:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171592576 00000100:00100000:1.0:1787857717.484917:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171592576 00002000:00100000:1.0:1787857717.485021:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff9998f9d103c0 x1874704171592576/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/0 e 0 to 0 dl 1787857728 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.485035:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d103c0 with x1874704171592576 ext(0->1048575) 00002000:00010000:1.0:1787857717.485043:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f9d103c0 00000100:00100000:1.0:1787857717.485093:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:1.0:1787857717.485105:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171592576:12345-192.168.204.36@tcp:4:dd.0 00000100:00100000:1.0:1787857717.529855:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+15:2350:x1874704171592576:12345-192.168.204.36@tcp:4:dd.0 Request processed in 44700us (45163us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1787857717.529876:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 65 00002000:00100000:1.0:1787857717.529896:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff9998f9d103c0 x1874704171592576/t4294967342(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/448 e 0 to 0 dl 1787857728 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.529909:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d103c0 with x1874704171592576 ext(0->1048575) 00002000:00010000:1.0:1787857717.529917:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f9d103c0 00000100:00100000:2.0:1787857717.530458:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.531092:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171592704 00000100:00100000:1.0:1787857717.531108:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171592704 00002000:00100000:1.0:1787857717.531176:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff9997c1b412c0 x1874704171592704/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/0 e 0 to 0 dl 1787857728 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.531189:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c1b412c0 with x1874704171592704 ext(1048576->2097151) 00002000:00010000:1.0:1787857717.531194:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c1b412c0 00000100:00100000:1.0:1787857717.531232:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00100000:1.0:1787857717.531245:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171592704:12345-192.168.204.36@tcp:4:dd.0 00000100:00100000:1.0:1787857717.559430:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171592704:12345-192.168.204.36@tcp:4:dd.0 Request processed in 28169us (28957us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787857717.559465:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 66 00002000:00100000:1.0:1787857717.559482:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff9997c1b412c0 x1874704171592704/t4294967343(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/448 e 0 to 0 dl 1787857728 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.559494:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c1b412c0 with x1874704171592704 ext(1048576->2097151) 00002000:00010000:1.0:1787857717.559501:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c1b412c0 00000100:00100000:3.0:1787857717.590945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.591283:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171592832 00000100:00100000:1.0:1787857717.591297:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171592832 00002000:00100000:1.0:1787857717.591367:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff9997c34f21c0 x1874704171592832/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/0 e 0 to 0 dl 1787857728 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.591393:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f21c0 with x1874704171592832 ext(2097152->3145727) 00002000:00010000:1.0:1787857717.591401:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c34f21c0 00000100:00100000:1.0:1787857717.591445:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:1.0:1787857717.591458:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+17:2347:x1874704171592832:12345-192.168.204.36@tcp:4:dd.0 00000100:00100000:1.0:1787857717.624799:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171592832:12345-192.168.204.36@tcp:4:dd.0 Request processed in 33322us (33848us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787857717.624842:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 67 00002000:00100000:1.0:1787857717.624866:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff9997c34f21c0 x1874704171592832/t4294967344(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/448 e 0 to 0 dl 1787857728 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.624881:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f21c0 with x1874704171592832 ext(2097152->3145727) 00002000:00010000:1.0:1787857717.624890:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c34f21c0 00000100:00100000:3.0:1787857717.634891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.635067:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171592960 00000100:00100000:1.0:1787857717.635082:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171592960 00002000:00100000:1.0:1787857717.635156:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff9997c34f30c0 x1874704171592960/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/0 e 0 to 0 dl 1787857728 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.635195:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f30c0 with x1874704171592960 ext(3145728->4194303) 00002000:00010000:1.0:1787857717.635203:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c34f30c0 00000100:00100000:1.0:1787857717.636414:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:1.0:1787857717.636440:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171592960:12345-192.168.204.36@tcp:4:dd.0 00000100:00100000:2.0:1787857717.659372:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857717.659655:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171593344 00000100:00100000:3.0:1787857717.659670:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171593344 00000100:00100000:3.0:1787857717.659758:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 171 00000100:00100000:3.0:1787857717.659772:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:24642:x1874704171593344:12345-192.168.204.36@tcp:35:dd.0 00000100:00100000:3.0:1787857717.660305:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+90:24642:x1874704171593344:12345-192.168.204.36@tcp:35:dd.0 Request processed in 531us (944us total) trans 4294967851 rc 0/0 00000100:00100000:3.0:1787857717.660315:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 171 00000100:00100000:3.0:1787857717.660460:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.661188:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+21:2348:x1874704171592960:12345-192.168.204.36@tcp:4:dd.0 Request processed in 24755us (26309us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787857717.661201:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 68 00002000:00100000:1.0:1787857717.661217:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff9997c34f30c0 x1874704171592960/t4294967345(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/448 e 0 to 0 dl 1787857728 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.661229:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f30c0 with x1874704171592960 ext(3145728->4194303) 00002000:00010000:1.0:1787857717.661238:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c34f30c0 00000100:00100000:1.0:1787857717.662023:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171593088 00000100:00100000:1.0:1787857717.662034:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171593088 00002000:00100000:1.0:1787857717.662081:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff9997c34f12c0 x1874704171593088/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/0 e 0 to 0 dl 1787857728 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857717.662092:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f12c0 with x1874704171593088 ext(4194304->5242879) 00002000:00010000:1.0:1787857717.662097:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c34f12c0 00000100:00100000:1.0:1787857717.662176:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:1.0:1787857717.662187:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+21:2350:x1874704171593088:12345-192.168.204.36@tcp:4:dd.0 00000100:00100000:2.0:1787857717.685352:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+23:2350:x1874704171593088:12345-192.168.204.36@tcp:4:dd.0 Request processed in 23150us (24876us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787857717.685370:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 69 00002000:00100000:2.0:1787857717.685387:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff9997c34f12c0 x1874704171593088/t4294967346(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:363/0 lens 488/448 e 0 to 0 dl 1787857728 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857717.685399:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f12c0 with x1874704171593088 ext(4194304->5242879) 00002000:00010000:2.0:1787857717.685407:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c34f12c0 00000100:00100000:1.0:1787857717.710892:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857717.713604:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171593600 00000100:00100000:2.0:1787857717.713627:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171593600 00000100:00100000:2.0:1787857717.713752:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 839 00000100:00100000:2.0:1787857717.713765:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+90:24645:x1874704171593600:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:2.0:1787857717.713803:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857717.713884:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b947 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd366b expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.717479:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0400/0xd3f183cab4a7b94e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.717545:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0400/0xd3f183cab4a7b94e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.717563:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0400/0xd3f183cab4a7b94e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857717.717589:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:1.0:1787857717.717813:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b947 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd366b expref: 93 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.717865:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0400/0xd3f183cab4a7b94e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd366b expref: 92 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.717876:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857717.717880:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787857717.717884:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a0400, rc 0) 00000100:00100000:1.0:1787857717.718268:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+92:24645:x1874704171593600:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 4502us (7391us total) trans 4294967852 rc 0/0 00000100:00100000:1.0:1787857717.718280:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 839 00000100:00100000:3.0:1787857717.788542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857717.788890:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171593728 00000100:00100000:1.0:1787857717.788905:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171593728 00000100:00100000:1.0:1787857717.789007:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 840 00000100:00100000:1.0:1787857717.789020:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:24646:x1874704171593728:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857717.789061:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857717.789094:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1400/0xd3f183cab4a7b95c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3672 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.789233:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.789252:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.789269:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857717.789380:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:1.0:1787857717.789385:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857717.789416:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.789451:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1400/0xd3f183cab4a7b95c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.789480:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 93 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857717.789491:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857717.789494:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857717.789499:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a0e00, rc 0) 00000100:00100000:1.0:1787857717.789612:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+93:24646:x1874704171593728:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 594us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857717.789620:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 840 00000100:00100000:2.0:1787857717.800009:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857717.800183:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171593984 00000100:00100000:0.0:1787857717.800196:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171593984 00000100:00100000:0.0:1787857717.800285:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 841 00000100:00100000:0.0:1787857717.800299:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+93:24646:x1874704171593984:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857717.800719:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 136 off10912 00000100:00100000:0.0:1787857717.800890:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+93:24646:x1874704171593984:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 593us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857717.800900:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 841 00010000:00010000:3.0:1787857717.998102:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857718.318237:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857718.318253:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857718.318302:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 21 count 3 00000040:00080000:3.0:1787857718.318311:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857718.318695:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188218112:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857718.318969:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857718.327502:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188218112:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857718.339048:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857718.339192:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171594112 00000100:00100000:1.0:1787857718.339210:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171594112 00000100:00100000:1.0:1787857718.339319:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 842 00000100:00100000:1.0:1787857718.339329:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24656:x1874704171594112:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857718.339370:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857718.339500:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24656:x1874704171594112:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 172us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857718.339509:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 842 00000100:00100000:2.0:1787857718.345567:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857718.345771:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171594368 00000100:00100000:1.0:1787857718.345787:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171594368 00000100:00100000:1.0:1787857718.345943:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 843 00000100:00100000:1.0:1787857718.345957:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24656:x1874704171594368:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857718.345987:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857718.346017:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1400/0xd3f183cab4a7b96a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3679 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857718.346176:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857718.346195:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857718.346210:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857718.346225:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:1.0:1787857718.346403:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1400/0xd3f183cab4a7b96a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857718.346423:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857718.346454:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857718.346458:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857718.347572:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c31a1e00, rc 0) 00000100:00100000:1.0:1787857718.347693:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:24656:x1874704171594368:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1734us (2140us total) trans 4294967853 rc 0/0 00000100:00100000:1.0:1787857718.347703:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 843 00000100:00100000:3.0:1787857718.354407:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857718.356764:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171594496 00000100:00100000:2.0:1787857718.356782:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171594496 00000100:00100000:2.0:1787857718.356910:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 206 00000100:00100000:2.0:1787857718.356921:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171594496:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857718.356981:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.357025:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 22 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.357035:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787857718.357039:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857718.357045:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.357101:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 22 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787857718.357125:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857718.357126:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 22 pid: 8490 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857718.357150:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188218240:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857718.357263:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857718.372655:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188218240:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857718.372714:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857718.391705:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857718.391777:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171594624 00000100:00100000:0.0:1787857718.391795:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171594624 00010000:00010000:0.0:1787857718.391903:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 23 pid: 8490 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857718.391954:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 259 00000100:00100000:0.0:1787857718.391969:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+23:2350:x1874704171594624:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857718.391991:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787857718.392025:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:0.0:1787857718.392030:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1787857717 00002000:00010000:0.0:1787857718.392032:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1787857717 00010000:00010000:0.0:1787857718.392040:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 23 pid: 8490 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857718.392054:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 23 pid: 8490 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857718.392102:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7b940 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3664 expref: 23 pid: 8490 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857718.392124:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857718.392130:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857718.392136:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857718.392149:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857718.392194:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857718.392270:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857718.392271:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+22:2350:x1874704171594624:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 305us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857718.392295:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 259 00010000:00010000:3.0:1787857718.392330:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.392389:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.392400:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.392409:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.392418:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857718.392423:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.392433:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.392453:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.392462:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7b97f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857718.392579:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171594496:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 35657us (38187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857718.392590:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 206 00000100:00100000:1.0:1787857718.397938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857718.398235:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171594880 00000100:00100000:3.0:1787857718.398251:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171594880 00000100:00100000:3.0:1787857718.398344:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 844 00000100:00100000:3.0:1787857718.398369:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6138850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:24656:x1874704171594880:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857718.398539:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6138850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:24656:x1874704171594880:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 183us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857718.398548:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 844 00000100:00100000:2.0:1787857718.431969:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857718.432097:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171595008 00000100:00100000:3.0:1787857718.432110:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171595008 00000100:00100000:3.0:1787857718.432193:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 207 00000100:00100000:3.0:1787857718.432206:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171595008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857718.432233:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857718.432262:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3680 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857718.432299:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 5242880, mtime: 0x6a908b35, atime: 0x0, ctime: 0x6a908b35, blocks: 0x1 00010000:00010000:3.0:1787857718.432330:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=542s v=(0 0) 00010000:00010000:3.0:1787857718.432335:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857718.432348:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.432388:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.432406:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6200, rc 0) 00000100:00100000:3.0:1787857718.432491:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171595008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 287us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857718.432501:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 207 00000100:00100000:2.0:1787857718.454363:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857718.454476:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171595264 00000100:00100000:3.0:1787857718.454491:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171595264 00000100:00100000:3.0:1787857718.454581:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 845 00000100:00100000:3.0:1787857718.454596:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:24656:x1874704171595264:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857718.454762:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:24656:x1874704171595264:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 169us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857718.454771:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 845 00000100:00100000:1.0:1787857718.473961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857718.474087:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171595392 00000100:00100000:2.0:1787857718.474101:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171595392 00002000:00100000:2.0:1787857718.474182:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff99990158bc00 x1874704171595392/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/0 e 0 to 0 dl 1787857729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857718.474195:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990158bc00 with x1874704171595392 ext(0->1048575) 00002000:00010000:2.0:1787857718.474202:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99990158bc00 00000100:00100000:2.0:1787857718.474245:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:2.0:1787857718.474257:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171595392:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787857718.541511:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171595392:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 67242us (67552us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787857718.541526:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 70 00002000:00100000:2.0:1787857718.542853:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff99990158bc00 x1874704171595392/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/440 e 0 to 0 dl 1787857729 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857718.542867:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990158bc00 with x1874704171595392 ext(0->1048575) 00002000:00010000:2.0:1787857718.543142:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99990158bc00 00000100:00100000:2.0:1787857718.582094:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857718.582135:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171595520 00000100:00100000:2.0:1787857718.582145:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171595520 00002000:00100000:2.0:1787857718.582200:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff9997c507f0c0 x1874704171595520/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/0 e 0 to 0 dl 1787857729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857718.582212:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507f0c0 with x1874704171595520 ext(1048576->2097151) 00002000:00010000:2.0:1787857718.582229:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c507f0c0 00000100:00100000:2.0:1787857718.582260:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:2.0:1787857718.582270:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171595520:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787857718.624430:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171595520:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 42148us (42346us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787857718.624446:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 71 00002000:00100000:3.0:1787857718.624463:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff9997c507f0c0 x1874704171595520/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/440 e 0 to 0 dl 1787857729 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857718.624476:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507f0c0 with x1874704171595520 ext(1048576->2097151) 00002000:00010000:3.0:1787857718.624484:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c507f0c0 00000100:00100000:0.0:1787857718.638146:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188218624:0@lo:400:kworker.0 00000100:00100000:0.0:1787857718.638267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857718.638354:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857718.638362:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c27170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188218752:0@lo:400:kworker.0 00000100:00100000:0.0:1787857718.638396:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857718.640458:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188218624 00000100:00100000:3.0:1787857718.640480:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188218624 00000100:00100000:3.0:1787857718.640619:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787857718.641266:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188218624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857718.641412:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188218624:12345-0@lo:400:kworker.0 Request processed in 783us (3145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857718.641420:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:3.0:1787857718.641461:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857718.641499:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188218624:0@lo:400:kworker.0 00000100:00100000:1.0:1787857718.641860:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188218496:0@lo:400:kworker.0 00000100:00100000:1.0:1787857718.641910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857718.641941:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2715680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188219008:0@lo:400:kworker.0 00000100:00100000:1.0:1787857718.641970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857718.642005:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787857718.642011:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188218368:0@lo:400:kworker.0 00000100:00100000:1.0:1787857718.642039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857718.642064:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188218880:0@lo:400:kworker.0 00000100:00100000:1.0:1787857718.642085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857718.642116:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188218496 00000100:00100000:1.0:1787857718.642122:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188218496 00000100:00100000:1.0:1787857718.642160:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188218880 00000100:00100000:1.0:1787857718.642163:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188218880 00000100:00100000:1.0:1787857718.642187:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787857718.642195:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188218496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857718.642253:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188218496:12345-0@lo:400:kworker.0 Request processed in 59us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857718.642388:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188218752 00000100:00100000:2.0:1787857718.642401:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188218752 00000100:00100000:2.0:1787857718.642448:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188219008 00000100:00100000:2.0:1787857718.642451:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188219008 00000100:00100000:0.0:1787857718.642492:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787857718.642518:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188218752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857718.642570:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787857718.642604:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787857718.642616:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188218880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857718.642632:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188218752:12345-0@lo:400:kworker.0 Request processed in 126us (4233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857718.642756:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188218880:12345-0@lo:400:kworker.0 Request processed in 71us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857718.642765:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787857718.642774:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c27170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188218752:0@lo:400:kworker.0 00000100:00100000:2.0:1787857718.644972:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787857718.644996:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188219008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857718.645083:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188219008:12345-0@lo:400:kworker.0 Request processed in 98us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857718.645092:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787857718.645641:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787857718.646130:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188218368 00000100:00100000:3.0:1787857718.646143:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188218368 00000100:00100000:3.0:1787857718.646203:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1787857718.646211:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188218368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857718.646275:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188218368:12345-0@lo:400:kworker.0 Request processed in 65us (4235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857718.646282:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:0.0:1787857718.646917:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857718.646983:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188218368:0@lo:400:kworker.0 00000100:00100000:0.0:1787857718.647006:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188218880:0@lo:400:kworker.0 00000100:00100000:0.0:1787857718.647020:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188218496:0@lo:400:kworker.0 00000100:00100000:0.0:1787857718.647035:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2715680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188219008:0@lo:400:kworker.0 00000100:00100000:0.0:1787857718.663846:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857718.666592:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171595648 00000100:00100000:2.0:1787857718.666687:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171595648 00000100:00100000:0.0:1787857718.666842:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00002000:00100000:2.0:1787857718.666876:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff9997c2715680 x1874704171595648/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/0 e 0 to 0 dl 1787857729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857718.666890:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2715680 with x1874704171595648 ext(2097152->3145727) 00002000:00010000:2.0:1787857718.666897:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c2715680 00000100:00100000:2.0:1787857718.666933:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171595776 00000100:00100000:2.0:1787857718.666937:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171595776 00000100:00100000:0.0:1787857718.667000:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:0.0:1787857718.667021:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2715680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171595648:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00002000:00100000:2.0:1787857718.667287:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff9997c2714f00 x1874704171595776/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/0 e 0 to 0 dl 1787857729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857718.667304:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2714f00 with x1874704171595776 ext(3145728->4194303) 00002000:00010000:2.0:1787857718.667308:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c2714f00 00000100:00100000:3.0:1787857718.698301:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2715680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171595648:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 31277us (34476us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787857718.698320:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 72 00002000:00100000:3.0:1787857718.698346:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff9997c2715680 x1874704171595648/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/440 e 0 to 0 dl 1787857729 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857718.698366:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2715680 with x1874704171595648 ext(2097152->3145727) 00002000:00010000:3.0:1787857718.698376:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c2715680 00000100:00100000:3.0:1787857718.698426:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:3.0:1787857718.698439:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171595776:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787857718.720635:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171595776:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 22181us (53802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787857718.720667:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 73 00002000:00100000:2.0:1787857718.720685:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff9997c2714f00 x1874704171595776/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/440 e 0 to 0 dl 1787857729 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857718.720698:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2714f00 with x1874704171595776 ext(3145728->4194303) 00002000:00010000:2.0:1787857718.720728:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c2714f00 00000100:00100000:2.0:1787857718.753633:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857718.753778:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171595904 00000100:00100000:1.0:1787857718.753794:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171595904 00002000:00100000:1.0:1787857718.753914:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff9997c507de00 x1874704171595904/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/0 e 0 to 0 dl 1787857729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857718.753929:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507de00 with x1874704171595904 ext(4194304->5242879) 00002000:00010000:1.0:1787857718.753936:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c507de00 00000100:00100000:1.0:1787857718.753970:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 74 00000100:00100000:1.0:1787857718.753982:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171595904:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787857718.767242:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171595904:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 13250us (13621us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787857718.767258:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 74 00002000:00100000:3.0:1787857718.767272:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff9997c507de00 x1874704171595904/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:364/0 lens 488/440 e 0 to 0 dl 1787857729 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857718.767282:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507de00 with x1874704171595904 ext(4194304->5242879) 00002000:00010000:3.0:1787857718.767290:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c507de00 00000100:00100000:0.0:1787857718.786861:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857718.787004:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171596032 00000100:00100000:3.0:1787857718.787016:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171596032 00000100:00100000:3.0:1787857718.787117:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 846 00000100:00100000:3.0:1787857718.787135:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:24656:x1874704171596032:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857718.787157:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857718.787180:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b98d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3687 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.787224:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.787238:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.787253:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.787588:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b98d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.787640:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.787649:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857718.787663:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857718.787667:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53c00, rc 0) 00000100:00100000:3.0:1787857718.787761:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:24656:x1874704171596032:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 629us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857718.787776:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 846 00000100:00100000:1.0:1787857718.799087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857718.799596:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171596160 00000100:00100000:3.0:1787857718.799612:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171596160 00000100:00100000:3.0:1787857718.799696:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 847 00000100:00100000:3.0:1787857718.799709:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:24656:x1874704171596160:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857718.799751:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857718.799923:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:24656:x1874704171596160:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 216us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857718.799931:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 847 00000100:00100000:3.0:1787857718.822532:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857718.825516:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171596288 00000100:00100000:2.0:1787857718.825538:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171596288 00000100:00100000:2.0:1787857718.825627:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 208 00000100:00100000:2.0:1787857718.825640:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171596288:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857718.825715:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825740:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857718.825746:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857718.825755:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825786:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825859:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825870:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825880:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825890:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5082200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857718.825905:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825917:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825939:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.825948:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051b1a50e/0xd3f183cab4a7b99b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857718.826090:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171596288:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 451us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857718.826099:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 208 00000100:00100000:2.0:1787857718.830910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857718.830983:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171596544 00000100:00100000:3.0:1787857718.831000:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171596544 00000100:00100000:3.0:1787857718.831070:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 848 00000100:00100000:3.0:1787857718.831081:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:24656:x1874704171596544:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857718.831159:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.831192:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.831201:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.831234:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.831247:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 37 pid: 5856 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857718.831261:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188219136:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857718.831384:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085300 going to sleep for 11 seconds 00000100:00100000:2.0:1787857718.837796:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857718.837891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171596672 00000100:00100000:2.0:1787857718.837905:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171596672 00000100:00100000:3.0:1787857718.837956:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188219136:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857718.837976:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 38 pid: 5856 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.837996:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857718.838038:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00100000:2.0:1787857718.838051:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:2349:x1874704171596672:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857718.838088:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857718.838098:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 38 pid: 5856 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.838134:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 38 pid: 5856 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.838167:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7b994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3687 expref: 38 pid: 5856 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.838776:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857718.838784:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.838797:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.838806:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857718.838868:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857718.838952:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:2349:x1874704171596672:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 900us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857718.838962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 260 00010000:00010000:3.0:1787857718.839235:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.839249:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.839494:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.839504:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.839525:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.839533:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857718.839538:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.839547:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.839565:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857718.839569:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857718.839574:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857718.839581:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857718.839783:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:24656:x1874704171596544:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 8699us (8885us total) trans 4294967854 rc 0/0 00000100:00100000:3.0:1787857718.839794:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 848 00000040:00080000:2.0:1787857718.840110:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857718.840118:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857718.840952:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857718.840968:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857718.843800:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857718.846102:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171596928 00000100:00100000:3.0:1787857718.846119:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171596928 00000100:00100000:3.0:1787857718.846198:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 172 00000100:00100000:3.0:1787857718.846212:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:24656:x1874704171596928:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857718.846534:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:24656:x1874704171596928:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 325us (2745us total) trans 4294967855 rc 0/0 00000100:00100000:3.0:1787857718.846543:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 172 00010000:00010000:0.0:1787857719.026053:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857719.087462:0:18375:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857719.087476:0:18375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857719.087521:0:18375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 21 count 3 00000040:00080000:2.0:1787857719.087528:0:18375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1787857719.171102:0:7958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 543221281514ns, next at 544221278710ns, rc = 0 00000100:00100000:0.0:1787857719.171149:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2717c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188219264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857719.171248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857719.171347:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188219264 00000100:00100000:0.0:1787857719.171356:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188219264 00000100:00100000:0.0:1787857719.171433:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787857719.171451:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188219264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857719.172393:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 78184448 pending 8519680 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857719.172471:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188219264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1027us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857719.172480:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1787857719.172532:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857719.185294:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2717c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188219264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857719.199140:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857719.208555:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171597056 00000100:00100000:2.0:1787857719.208572:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171597056 00000100:00100000:2.0:1787857719.210037:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 209 00000100:00100000:2.0:1787857719.210061:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+22:2349:x1874704171597056:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857719.210082:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857719.210100:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd368e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.210200:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787857719.210205:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857719.210216:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 23 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.210237:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 23 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.210252:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5083200, rc 0) 00000100:00100000:2.0:1787857719.210326:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+23:2349:x1874704171597056:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 275us (11212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857719.210334:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 209 00000100:00080000:2.0:1787857719.210491:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857719.231166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.231630:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171597312 00000100:00100000:3.0:1787857719.237342:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171597312 00000100:00100000:3.0:1787857719.237500:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 173 00000100:00100000:3.0:1787857719.237514:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6121050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+93:24658:x1874704171597312:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1787857719.239047:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6121050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+94:24658:x1874704171597312:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 1521us (7877us total) trans 4294967856 rc 0/0 00000100:00100000:3.0:1787857719.239064:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 173 00000100:00080000:2.0:1787857719.239627:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857719.251219:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.251280:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171597568 00000100:00100000:3.0:1787857719.251293:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171597568 00000100:00100000:3.0:1787857719.252591:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 849 00000100:00100000:3.0:1787857719.252611:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+94:24658:x1874704171597568:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857719.252659:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857719.252664:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787857719.252706:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0400/0xd3f183cab4a7b94e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd366b expref: 94 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.252731:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857719.252739:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857719.252758:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3695 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.253084:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7b9b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.253102:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7b9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.253125:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7b9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857719.253141:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1787857719.253318:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3695 expref: 96 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.253338:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7b9b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3695 expref: 95 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.253347:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857719.253351:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857719.253354:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:3.0:1787857719.253453:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+95:24658:x1874704171597568:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 850us (2247us total) trans 4294967857 rc 0/0 00000100:00100000:3.0:1787857719.253469:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 849 00000100:00100000:0.0:1787857719.264384:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857719.264427:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171597696 00000100:00100000:0.0:1787857719.264436:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171597696 00000100:00100000:0.0:1787857719.264509:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 210 00000100:00100000:0.0:1787857719.264522:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+23:2349:x1874704171597696:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:0.0:1787857719.264576:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.264600:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.264612:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 23 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.264621:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857719.264626:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857719.264631:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.264679:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 23 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.264697:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 23 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857719.264734:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2716940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188219392:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857719.264900:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.264912:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 9 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857719.264923:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188219520:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857719.264955:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857719.274615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.276925:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171597824 00000100:00100000:3.0:1787857719.276940:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171597824 00010000:00010000:3.0:1787857719.276993:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 24 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857719.277035:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 261 00000100:00100000:3.0:1787857719.277044:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+24:2349:x1874704171597824:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857719.277060:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787857719.277080:0:8468:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb blocks from disk: 1 -> 10247 00010000:00010000:3.0:1787857719.277099:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 24 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.277112:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 24 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.277139:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857719.277916:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+24:2349:x1874704171597824:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 867us (3305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857719.277926:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 261 00010000:00010000:3.0:1787857719.278006:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6857bbd/0xd3f183cab4a7b9a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd368e expref: 23 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857719.278031:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2716940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188219392:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857719.278048:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188219520:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857719.278087:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857719.311464:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967849 is committed 00000004:00080000:2.0:1787857719.311478:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:2.0:1787857719.311487:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000020:00080000:2.0:1787857719.311497:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 12 batchid updated 00000001:00080000:2.0:1787857719.311507:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967853 is committed 00000001:00080000:2.0:1787857719.311513:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967852 is committed 00000001:00080000:2.0:1787857719.311537:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967855 is committed 00000020:00080000:2.0:1787857719.311951:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12 00000020:00080000:2.0:1787857719.311962:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12 00000100:00100000:0.0:1787857719.312520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857719.312995:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171597952 00000100:00100000:0.0:1787857719.313007:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171597952 00010000:00010000:0.0:1787857719.313062:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 10 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857719.314244:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00100000:0.0:1787857719.314265:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171597952:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857719.314289:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857719.314321:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 10 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.314341:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 10 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.314398:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad872755/0xd3f183cab4a7b986 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3680 expref: 10 pid: 6714 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.314419:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857719.314423:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857719.314430:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.314441:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.314483:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857719.314572:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171597952:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 315us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857719.314581:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 262 00010000:00010000:0.0:1787857719.317275:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.317302:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.317352:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.317363:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.317381:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.317389:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857719.317394:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.317406:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.317431:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.317439:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fffd771/0xd3f183cab4a7b9c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857719.317578:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+22:2349:x1874704171597696:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 53052us (53197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857719.317591:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 210 00000100:00100000:2.0:1787857719.319354:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188219648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787857719.319432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857719.319493:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188219776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787857719.319519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857719.319562:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188219648 00000100:00100000:2.0:1787857719.319570:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188219648 00000100:00100000:2.0:1787857719.319616:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188219776 00000100:00100000:2.0:1787857719.319619:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188219776 00000100:00100000:2.0:1787857719.319639:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787857719.319661:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188219648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787857719.319688:0:6711:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:16 count 1 00010000:00010000:2.0:1787857719.319715:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.319736:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.319745:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787857719.319749:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857719.319754:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.319786:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.321208:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 11 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857719.321233:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188219904:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857719.321339:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f4337840 going to sleep for 11 seconds 00000100:00100000:2.0:1787857719.321364:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787857719.321375:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188219776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787857719.321401:0:6714:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:18 count 1 00010000:00010000:2.0:1787857719.321422:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.321438:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 22 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.321447:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787857719.321451:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857719.321455:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.321485:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 22 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.321496:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 22 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857719.321524:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188220032:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857719.321551:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f4337f00 going to sleep for 11 seconds 00000100:00080000:2.0:1787857719.321564:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857719.330084:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188220032:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857719.330128:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857719.330483:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188219904:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857719.330526:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857719.332774:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857719.332868:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857719.332890:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171598080 00000100:00100000:0.0:1787857719.332904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857719.332908:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171598080 00000100:00100000:0.0:1787857719.332964:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171598464 00000100:00100000:0.0:1787857719.332975:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171598464 00010000:00010000:2.0:1787857719.332996:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 12 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857719.333052:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171598208 00000100:00100000:2.0:1787857719.333057:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171598208 00000100:00100000:0.0:1787857719.333065:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 174 00000100:00100000:0.0:1787857719.333081:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+86:24658:x1874704171598464:12345-192.168.204.36@tcp:35:lfs.0 00010000:00010000:2.0:1787857719.333084:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 22 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857719.333130:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 263 00000100:00100000:2.0:1787857719.333140:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171598080:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857719.333158:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857719.333165:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 12 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857719.333177:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x38:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7b9b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3695 expref: 86 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333187:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 12 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333218:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000148cdeb6/0xd3f183cab4a7b8fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3656 expref: 12 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333252:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857719.333258:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857719.333265:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333278:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333310:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857719.333384:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171598080:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 245us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857719.333394:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 263 00000100:00100000:2.0:1787857719.333422:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 264 00000100:00100000:2.0:1787857719.333430:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+22:2349:x1874704171598208:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857719.333442:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857719.333447:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 22 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333459:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 22 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333475:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7b8f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd364f expref: 22 pid: 6711 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857719.333489:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967858 00010000:00010000:2.0:1787857719.333507:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857719.333511:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857719.333516:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333525:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333549:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857719.333587:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+21:2349:x1874704171598208:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 157us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857719.333595:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 264 00010000:00010000:1.0:1787857719.333854:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.333869:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.333888:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.333896:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.333916:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1787857719.333941:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787857719.333971:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333983:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.333994:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.334002:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.334038:0:6714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787857719.334634:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188219648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14971us (15197us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787857719.334660:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00010000:00010000:1.0:1787857719.334701:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787857719.334708:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334718:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5083400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857719.334723:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334733:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334753:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334761:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f87aaacc/0xd3f183cab4a7b9cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334793:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857719.334797:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334804:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5082400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857719.334807:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334841:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334853:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334860:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca368f95/0xd3f183cab4a7b9d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.334872:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857719.334873:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857719.334875:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787857719.334915:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c507d680/2, rc 0, transno 4294967333 00000100:00100000:1.0:1787857719.334922:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188219648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787857719.338070:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188219776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16681us (18533us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787857719.338086:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00010000:00010000:2.0:1787857719.338690:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857719.338852:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c507e940/2, rc 0, transno 4294967347 00000100:00100000:2.0:1787857719.338865:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188219776:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787857719.338933:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967859 00010000:00010000:1.0:1787857719.339498:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.339537:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 89 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.339547:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.339555:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 5/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.339598:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.339615:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 34 pid: 5858 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857719.339631:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188220160:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857719.339739:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 89 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.339749:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 89 pid: 5856 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857719.339757:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188220288:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857719.339782:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857719.343872:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857719.343909:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171598592 00000100:00100000:1.0:1787857719.343932:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171598592 00010000:00010000:1.0:1787857719.343972:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 90 pid: 5856 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857719.344022:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:1.0:1787857719.344030:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+90:2349:x1874704171598592:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857719.344045:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857719.344053:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 90 pid: 5856 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.344068:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 90 pid: 5856 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.344094:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857719.344100:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.344318:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.344327:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857719.344395:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+90:2349:x1874704171598592:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 364us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857719.344403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 265 00010000:00010000:0.0:1787857719.344729:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1800/0xd3f183cab4a7b932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd365d expref: 89 pid: 5856 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857719.344747:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188220288:192.168.204.36@tcp:104: 00000001:00080000:3.0:1787857719.353375:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00000001:00080000:3.0:1787857719.355431:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000001:00080000:3.0:1787857719.355466:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967341 is committed 00000100:00100000:2.0:1787857719.356382:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857719.356423:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171598720 00000100:00100000:2.0:1787857719.356435:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171598720 00010000:00010000:2.0:1787857719.356512:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 35 pid: 5858 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857719.356574:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:2.0:1787857719.356589:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2349:x1874704171598720:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857719.356863:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857719.356875:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 35 pid: 5858 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.356896:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 35 pid: 5858 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.356929:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857719.356945:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.356976:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.356985:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.357011:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857719.357085:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2349:x1874704171598720:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 499us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857719.357093:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00080000:2.0:1787857719.357184:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857719.362934:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a1e00/0xd3f183cab4a7b971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3679 expref: 34 pid: 5858 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857719.363232:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188220160:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857719.363274:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.363705:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857719.363715:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857719.365076:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967860 00000001:00080000:2.0:1787857719.367327:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967861 00000100:00100000:2.0:1787857719.369192:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188220416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787857719.369299:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857719.369702:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857719.370457:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188220416 00000100:00100000:1.0:1787857719.370476:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188220416 00000100:00100000:1.0:1787857719.370593:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787857719.370605:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188220416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857719.370766:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188220416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 163us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857719.370773:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787857719.370852:0:5859:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000100:00100000:1.0:1787857719.370876:0:5859:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9997c507e940 x1874704188219776/t4294967347(4294967347) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787857735 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857719.370889:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188220416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787857719.371629:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967862 00000100:00100000:1.0:1787857719.371726:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188220544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857719.371773:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857719.371811:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5aa2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857719.371903:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188220544 00000100:00100000:3.0:1787857719.371918:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188220544 00000100:00100000:3.0:1787857719.372019:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787857719.372030:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188220544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787857719.372483:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5859:x1874704188220544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 454us (707us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787857719.372493:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787857719.373427:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188220544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787857719.373526:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967863 00010000:00010000:1.0:1787857719.373576:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.373587:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.373595:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.373602:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857719.373606:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.373615:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.373638:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857719.373653:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787857719.373659:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.373666:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7b9da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857719.374004:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x39:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787857719.375336:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].11, 64 off8968 00000001:00080000:1.0:1787857719.375359:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967864 00010000:00010000:1.0:1787857719.375428:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857719.375434:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857719.375445:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7b9b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3695 expref: 93 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857719.375600:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:24658:x1874704171598464:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 42523us (42695us total) trans 4294967865 rc 0/0 00000100:00100000:1.0:1787857719.375610:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 174 00000020:00080000:1.0:1787857719.375615:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1787857719.414494:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.414695:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171598976 00000100:00100000:3.0:1787857719.414705:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171598976 00000100:00100000:3.0:1787857719.414773:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 850 00000100:00100000:3.0:1787857719.414784:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:24660:x1874704171598976:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:3.0:1787857719.414810:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857719.414854:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd369c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.414930:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.414944:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.414955:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.414971:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.414978:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.414995:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415443:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b9f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415453:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415461:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857719.415471:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1787857719.415565:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415573:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415580:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415586:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857719.415590:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415598:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415609:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:3.0:1787857719.415612:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857719.415622:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415628:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7b9e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415942:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415952:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415959:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415964:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857719.415967:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415974:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415982:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff9998d1291e00) 00010000:00010000:3.0:1787857719.415985:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857719.415988:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.415994:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7b9ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.416057:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7b9e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd369c expref: 95 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.416086:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd369c expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.416094:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857719.416096:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857719.416099:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:3.0:1787857719.416233:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+94:24660:x1874704171598976:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 1449us (1744us total) trans 4294967866 rc 0/0 00000100:00100000:3.0:1787857719.416242:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 850 00000100:00100000:0.0:1787857719.420324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.420470:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171599232 00000100:00100000:3.0:1787857719.420481:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171599232 00000100:00100000:3.0:1787857719.420547:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:3.0:1787857719.420557:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+94:24660:x1874704171599232:12345-192.168.204.36@tcp:103:md5sum.0 00010000:00010000:3.0:1787857719.420575:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857719.420601:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7b9f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd369c expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.420625:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857719.420636:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857719.420707:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+93:24660:x1874704171599232:12345-192.168.204.36@tcp:103:md5sum.0 Request processed in 152us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857719.420715:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:1.0:1787857719.425501:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.425579:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171599360 00000100:00100000:3.0:1787857719.425590:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171599360 00000100:00100000:3.0:1787857719.425658:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 851 00000100:00100000:3.0:1787857719.425678:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:24660:x1874704171599360:12345-192.168.204.36@tcp:58:md5sum.0 00010000:00010000:3.0:1787857719.425785:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.425802:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.425840:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857719.428402:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 136 off11048 00000100:00100000:3.0:1787857719.428544:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:24660:x1874704171599360:12345-192.168.204.36@tcp:58:md5sum.0 Request processed in 2862us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857719.428557:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 851 00000100:00100000:2.0:1787857719.433065:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.434196:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171599488 00000100:00100000:3.0:1787857719.434208:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171599488 00000100:00100000:3.0:1787857719.434281:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 852 00000100:00100000:3.0:1787857719.434292:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+93:24660:x1874704171599488:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:3.0:1787857719.434313:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857719.434332:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36a3 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.434390:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.434525:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36a3 expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.434546:0:5856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.434584:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36a3 expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.434597:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857719.434600:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857719.434604:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36a3 expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.434612:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:3.0:1787857719.434691:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+94:24660:x1874704171599488:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 400us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857719.434699:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 852 00000040:00080000:2.0:1787857719.854181:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857719.854194:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857719.854236:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 4 00000040:00080000:2.0:1787857719.854245:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857719.854402:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507e1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188220672:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857719.854509:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295300 going to sleep for 11 seconds 00000100:00100000:2.0:1787857719.859624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.859869:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507e1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188220672:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857719.861495:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171599616 00000100:00100000:0.0:1787857719.861508:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171599616 00000100:00100000:0.0:1787857719.861584:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 853 00000100:00100000:0.0:1787857719.861595:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24661:x1874704171599616:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857719.861641:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857719.861754:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24661:x1874704171599616:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 161us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857719.861762:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 853 00000100:00100000:1.0:1787857719.878241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.878327:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171599744 00000100:00100000:3.0:1787857719.878338:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171599744 00000100:00100000:3.0:1787857719.878403:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 854 00000100:00100000:3.0:1787857719.878412:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24661:x1874704171599744:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857719.878487:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878504:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878516:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878530:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878549:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878556:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878578:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878586:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878592:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857719.878628:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00000004:00200000:3.0:1787857719.878642:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857719.878654:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878671:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878678:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878684:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878690:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857719.878694:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878707:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878719:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857719.878722:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857719.878727:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878733:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878754:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878760:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878765:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878771:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857719.878774:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878780:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878786:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb1925f2 (ffff9998d1291100) 00010000:00010000:3.0:1787857719.878788:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857719.878790:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878804:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878862:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878868:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878874:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878879:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857719.878882:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878888:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878895:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857719.878897:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857719.878900:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.878906:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857719.879465:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24661:x1874704171599744:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 1049us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857719.879474:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 854 00000100:00100000:2.0:1787857719.889744:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857719.889864:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171600000 00000100:00100000:0.0:1787857719.889874:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171600000 00000100:00100000:3.0:1787857719.889991:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 855 00000100:00100000:3.0:1787857719.890004:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24661:x1874704171600000:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857719.890027:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857719.890047:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36aa expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890154:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890169:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890180:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857719.890193:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1787857719.890302:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890310:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890317:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890323:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857719.890327:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890346:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890377:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857719.890379:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857719.890385:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890391:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890435:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba27 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36aa expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890445:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857719.890447:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857719.890450:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36aa expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.890461:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52a00, rc 0) 00000100:00100000:3.0:1787857719.890533:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:24661:x1874704171600000:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 532us (797us total) trans 4294967867 rc 301/301 00000100:00100000:3.0:1787857719.890540:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 855 00000100:00100000:2.0:1787857719.898168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857719.898283:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171600128 00000100:00100000:0.0:1787857719.898295:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171600128 00000100:00100000:0.0:1787857719.898391:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 856 00000100:00100000:0.0:1787857719.898401:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:24661:x1874704171600128:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857719.898436:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857719.898544:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:24661:x1874704171600128:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 144us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857719.898553:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 856 00000100:00100000:0.0:1787857719.905705:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857719.911426:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171600256 00000100:00100000:3.0:1787857719.911441:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171600256 00000100:00100000:3.0:1787857719.911519:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 857 00000100:00100000:3.0:1787857719.911528:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:24661:x1874704171600256:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857719.911548:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857719.911568:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36b1 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.911668:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.911682:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.911693:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857719.913617:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857719.913626:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857719.913753:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.913796:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.913856:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857719.913866:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:3.0:1787857719.913869:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857719.913873:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52e00, rc 0) 00000100:00100000:3.0:1787857719.913936:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:24661:x1874704171600256:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2408us (8240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857719.913955:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 857 00000100:00100000:2.0:1787857719.926676:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857719.926853:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171600384 00000100:00100000:0.0:1787857719.926863:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171600384 00000100:00100000:0.0:1787857719.926926:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 858 00000100:00100000:0.0:1787857719.926945:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:24661:x1874704171600384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857719.926966:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857719.926987:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36b8 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927070:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927085:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927098:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927112:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927119:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927147:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927575:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927584:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927591:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857719.927690:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00000004:00200000:0.0:1787857719.927694:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857719.927773:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927788:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927795:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927801:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927807:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857719.927811:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927852:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927871:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:0.0:1787857719.927873:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857719.927878:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927884:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7ba51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927895:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927900:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927904:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927909:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857719.927911:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927916:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927923:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff9998d8aea200) 00010000:00010000:0.0:1787857719.927925:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857719.927927:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927933:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927974:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 38 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927987:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 37 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.927995:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:0.0:1787857719.927997:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857719.928000:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4200, rc 0) 00000100:00100000:0.0:1787857719.928064:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:24661:x1874704171600384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1128us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857719.928072:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 858 00000100:00100000:2.0:1787857719.944886:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857719.944978:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171600640 00000100:00100000:0.0:1787857719.944989:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171600640 00000100:00100000:0.0:1787857719.945059:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 859 00000100:00100000:0.0:1787857719.945070:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:24661:x1874704171600640:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857719.945093:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857719.945116:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.947811:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.947847:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.947860:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857719.947887:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00010000:00010000:0.0:1787857719.947963:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36bf expref: 40 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.947986:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36bf expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.947995:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d8aea200) 00010000:00010000:0.0:1787857719.947998:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857719.948013:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5600, rc 0) 00000100:00100000:0.0:1787857719.948094:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:24661:x1874704171600640:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3025us (3219us total) trans 4294967868 rc 0/0 00000100:00100000:0.0:1787857719.948103:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 859 00000100:00100000:2.0:1787857719.963974:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857719.964194:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171600896 00000100:00100000:0.0:1787857719.964206:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171600896 00000100:00100000:0.0:1787857719.964287:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 860 00000100:00100000:0.0:1787857719.964309:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:24661:x1874704171600896:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857719.964384:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857719.964413:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36bf expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.964434:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d8aea200) 00010000:00010000:0.0:1787857719.964445:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857719.964465:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.964495:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 93 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.964504:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.964537:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 93 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.964552:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 93 pid: 5856 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857719.964567:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2716580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188220800:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857719.964689:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857719.978752:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2716580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188220800:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857719.978790:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857719.979930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857719.980046:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171601024 00000100:00100000:1.0:1787857719.980055:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171601024 00010000:00010000:1.0:1787857719.980100:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 94 pid: 5856 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857719.980144:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 267 00000100:00100000:1.0:1787857719.980170:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+94:2349:x1874704171601024:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857719.980187:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857719.980195:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 94 pid: 5856 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.980210:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 94 pid: 5856 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.980239:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c31a0e00/0xd3f183cab4a7b963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3672 expref: 94 pid: 5856 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.980261:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857719.980267:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.980278:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.980287:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857719.980355:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857719.980405:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+93:2349:x1874704171601024:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 237us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857719.980414:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 267 00010000:00010000:0.0:1787857719.981700:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.981719:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.981749:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.981763:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.981787:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982258:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982267:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982275:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982281:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857719.982287:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982295:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982485:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:0.0:1787857719.982488:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857719.982493:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982499:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7ba7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982510:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982517:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982528:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982533:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857719.982536:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982542:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982549:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xadf35b2f (ffff9998d8aea200) 00010000:00010000:0.0:1787857719.982551:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857719.982554:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857719.982559:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7ba82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xadf35b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857719.984505:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:24661:x1874704171600896:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 20197us (20530us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857719.984517:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 860 00000100:00100000:2.0:1787857720.007378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.007538:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171601152 00000100:00100000:3.0:1787857720.007548:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171601152 00000100:00100000:3.0:1787857720.007622:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 861 00000100:00100000:3.0:1787857720.007642:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:24661:x1874704171601152:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857720.007662:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857720.007684:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36c6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.007719:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.007732:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.007743:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.007878:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 40 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.007896:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.007904:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857720.007906:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857720.007910:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53400, rc 0) 00000100:00100000:3.0:1787857720.007985:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:24661:x1874704171601152:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 354us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.007993:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 861 00000100:00100000:1.0:1787857720.020993:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.021491:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171601408 00000100:00100000:3.0:1787857720.021501:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171601408 00000100:00100000:3.0:1787857720.021579:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 862 00000100:00100000:3.0:1787857720.021588:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:24661:x1874704171601408:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857720.021690:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.021708:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.021720:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857720.021984:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069080a7d reply state 000000009d0e76c1 transno 4294967869 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857720.021994:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857720.022406:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:24661:x1874704171601408:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 817us (1422us total) trans 4294967869 rc 0/0 00000100:00100000:3.0:1787857720.022415:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 862 00010000:00010000:3.0:1787857720.044811:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.044871:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.044879:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.044886:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857720.044890:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.044919:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.044956:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857720.044960:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857720.044965:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.044972:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7ba97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.046649:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857720.047858:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.047969:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171601536 00000100:00100000:3.0:1787857720.047979:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171601536 00000100:00100000:3.0:1787857720.048239:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 863 00000100:00100000:3.0:1787857720.048250:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:24661:x1874704171601536:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857720.048283:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857720.048319:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36cd expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.048388:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.048403:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.048413:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857720.048415:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857720.048433:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52200, rc 0) 00000100:00100000:3.0:1787857720.048500:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:24661:x1874704171601536:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 252us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.048507:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 863 00000100:00100000:2.0:1787857720.056602:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.057047:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171601664 00000100:00100000:1.0:1787857720.057058:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171601664 00000100:00100000:1.0:1787857720.057130:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:1.0:1787857720.057139:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:24661:x1874704171601664:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787857720.057290:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:24661:x1874704171601664:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 151us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857720.058161:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:1.0:1787857720.063235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857720.065620:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171601920 00000100:00100000:2.0:1787857720.065650:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171601920 00000100:00100000:2.0:1787857720.065735:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 176 00000100:00100000:2.0:1787857720.065747:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:24661:x1874704171601920:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857720.066429:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:24661:x1874704171601920:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 681us (3501us total) trans 4294967870 rc 0/0 00000100:00100000:2.0:1787857720.066439:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 176 00000100:00100000:3.0:1787857720.080534:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.083848:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171602176 00000100:00100000:0.0:1787857720.083864:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171602176 00000100:00100000:0.0:1787857720.083944:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 864 00000100:00100000:0.0:1787857720.083955:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:24661:x1874704171602176:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857720.084096:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:24661:x1874704171602176:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 143us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857720.084104:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 864 00000100:00100000:1.0:1787857720.092407:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.092582:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171602432 00000100:00100000:3.0:1787857720.092592:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171602432 00000100:00100000:3.0:1787857720.092663:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 865 00000100:00100000:3.0:1787857720.092674:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:24661:x1874704171602432:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857720.092695:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857720.092718:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7baa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36d4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.092847:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.092862:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.092872:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 4/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.092904:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.092917:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 43 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857720.093155:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188220928:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857720.093260:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70850c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857720.105150:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188220928:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857720.105181:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.108724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857720.109813:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171602560 00000100:00100000:2.0:1787857720.109867:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171602560 00010000:00010000:2.0:1787857720.109939:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 44 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857720.109988:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 268 00000100:00100000:2.0:1787857720.110011:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171602560:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857720.110027:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857720.110050:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 44 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.110064:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 44 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.110088:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7ba9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36cd expref: 44 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.110106:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:2.0:1787857720.110111:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.110120:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.110128:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.110156:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857720.110227:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2349:x1874704171602560:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 230us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857720.110235:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 268 00010000:00010000:3.0:1787857720.110993:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.111018:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857720.111039:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00000004:00080000:3.0:1787857720.111723:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:3.0:1787857720.111890:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.111900:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.111906:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.111912:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857720.111917:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.111939:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.111956:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857720.111959:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857720.111977:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.111984:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7baac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.116071:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7baa5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36d4 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.116150:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857720.116154:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857720.116161:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7baa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36d4 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.116177:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52a00, rc 0) 00000100:00100000:1.0:1787857720.116258:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:24661:x1874704171602432:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 23584us (23859us total) trans 4294967871 rc 301/301 00000100:00100000:1.0:1787857720.116267:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 865 00000100:00100000:1.0:1787857720.122116:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857720.122295:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171602816 00000100:00100000:2.0:1787857720.122306:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171602816 00000100:00100000:2.0:1787857720.122372:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 177 00000100:00100000:2.0:1787857720.122383:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:24661:x1874704171602816:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857720.122764:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:24661:x1874704171602816:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 382us (657us total) trans 4294967872 rc 0/0 00000100:00100000:2.0:1787857720.122788:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 177 00000100:00100000:3.0:1787857720.142499:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.142674:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171602944 00000100:00100000:0.0:1787857720.142686:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171602944 00000100:00100000:0.0:1787857720.142758:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 866 00000100:00100000:0.0:1787857720.142785:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:24661:x1874704171602944:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857720.142812:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857720.142893:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7baba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36db expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.143203:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.143219:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.143231:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857720.143270:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00000004:00200000:0.0:1787857720.143274:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857720.143294:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.143319:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7baba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36db expref: 45 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.143337:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36db expref: 44 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.143345:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857720.143348:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787857720.143352:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857720.143410:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:24661:x1874704171602944:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 628us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857720.143431:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 866 00000100:00100000:0.0:1787857720.148589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857720.148671:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171603072 00000100:00100000:2.0:1787857720.148680:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171603072 00000100:00100000:2.0:1787857720.148760:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 213 00000100:00100000:2.0:1787857720.148771:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171603072:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857720.148788:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857720.148809:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36e2 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857720.148878:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857720.148899:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1787857720.148904:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857720.148914:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.148937:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.148950:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5083000, rc 0) 00000100:00100000:2.0:1787857720.149022:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171603072:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 253us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857720.149029:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 213 00000100:00080000:0.0:1787857720.149209:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857720.154251:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.154365:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171603328 00000100:00100000:0.0:1787857720.154374:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171603328 00000100:00100000:0.0:1787857720.154435:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 867 00000100:00100000:0.0:1787857720.154444:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:24661:x1874704171603328:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857720.154566:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:24661:x1874704171603328:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 122us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857720.154574:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 867 00000100:00100000:1.0:1787857720.168289:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.168456:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171603456 00000100:00100000:0.0:1787857720.168469:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171603456 00000100:00100000:0.0:1787857720.168535:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 214 00000100:00100000:0.0:1787857720.168546:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:24661:x1874704171603456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857720.168567:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857720.168588:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36e9 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.168622:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.168645:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857720.168649:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857720.168655:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.168708:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.168723:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 10 pid: 6713 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857720.168737:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2717480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188221056:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857720.168866:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857720.172777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.172857:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171603584 00000100:00100000:3.0:1787857720.172865:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171603584 00010000:00010000:3.0:1787857720.172904:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 11 pid: 6713 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857720.172948:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 269 00000100:00100000:3.0:1787857720.172958:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171603584:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857720.172972:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857720.173115:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 11 pid: 6713 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.173134:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 11 pid: 6713 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.173161:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857720.173166:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857720.173175:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.173185:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.173247:0:17347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857720.173261:0:17347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17347:1874704188221184:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857720.173358:0:17347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085000 going to sleep for 11 seconds 00010000:00010000:0.0:1787857720.174398:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6490560/0xd3f183cab4a7bac8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e2 expref: 11 pid: 6713 timeout: 644 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857720.174418:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2717480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188221056:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857720.174446:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.174457:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857720.174507:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:24661:x1874704171603456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 5963us (6231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857720.174516:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 214 00000100:00100000:3.0:1787857720.184231:0:17347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17347:1874704188221184:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857720.184261:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857720.184340:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171603584:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 11382us (11571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.184351:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 269 00000100:00100000:3.0:1787857720.222653:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857720.223040:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171603712 00000100:00100000:2.0:1787857720.223052:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171603712 00002000:00100000:2.0:1787857720.223116:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff9997c34f1680 x1874704171603712/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857720.223127:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f1680 with x1874704171603712 ext(0->1048575) 00002000:00010000:2.0:1787857720.223132:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f1680 00000100:00100000:2.0:1787857720.223176:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:2.0:1787857720.223185:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171603712:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787857720.256168:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.256399:0:6719:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787857720.256411:0:6719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787857720.257226:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171603840 00000100:00100000:3.0:1787857720.257237:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171603840 00002000:00100000:3.0:1787857720.257294:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff9998efa6cf00 x1874704171603840/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857720.257305:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6cf00 with x1874704171603840 ext(1048576->2097151) 00002000:00010000:3.0:1787857720.257311:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6cf00 00000100:00100000:1.0:1787857720.258423:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:1.0:1787857720.258440:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171603840:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787857720.292199:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171603712:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 67429us (67974us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787857720.292224:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 75 00002000:00100000:0.0:1787857720.292240:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff9997c34f1680 x1874704171603712/t4294967334(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/448 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.292267:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f1680 with x1874704171603712 ext(0->1048575) 00002000:00010000:0.0:1787857720.292273:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f1680 00000100:00100000:3.0:1787857720.293042:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.293569:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171603968 00000100:00100000:0.0:1787857720.293579:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171603968 00002000:00100000:0.0:1787857720.293640:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff9997c34f03c0 x1874704171603968/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.293652:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f03c0 with x1874704171603968 ext(2097152->3145727) 00002000:00010000:0.0:1787857720.293657:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f03c0 00000100:00100000:0.0:1787857720.293688:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:0.0:1787857720.293699:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171603968:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787857720.327454:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.327558:0:6718:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787857720.327570:0:6718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1787857720.329948:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171604096 00000100:00100000:1.0:1787857720.329964:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171604096 00002000:00100000:1.0:1787857720.330027:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff99990153e940 x1874704171604096/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857720.330040:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990153e940 with x1874704171604096 ext(3145728->4194303) 00002000:00010000:1.0:1787857720.330046:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99990153e940 00000100:00100000:3.0:1787857720.331583:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:3.0:1787857720.331602:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2348:x1874704171604096:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787857720.351390:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171603840:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 92942us (95237us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787857720.351407:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 76 00002000:00100000:1.0:1787857720.351423:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff9998efa6cf00 x1874704171603840/t4294967336(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/448 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857720.351434:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6cf00 with x1874704171603840 ext(1048576->2097151) 00002000:00010000:1.0:1787857720.351442:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6cf00 00000100:00100000:0.0:1787857720.355201:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2350:x1874704171603968:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 61480us (62139us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787857720.355223:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 77 00002000:00100000:0.0:1787857720.355245:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff9997c34f03c0 x1874704171603968/t4294967335(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/448 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.355256:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f03c0 with x1874704171603968 ext(2097152->3145727) 00002000:00010000:0.0:1787857720.355265:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f03c0 00000100:00100000:0.0:1787857720.373257:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2348:x1874704171604096:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 41648us (45801us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787857720.373273:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 78 00002000:00100000:0.0:1787857720.373288:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff99990153e940 x1874704171604096/t4294967337(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/448 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.373325:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990153e940 with x1874704171604096 ext(3145728->4194303) 00002000:00010000:0.0:1787857720.373332:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99990153e940 00000100:00100000:3.0:1787857720.375021:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.375308:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171604224 00000100:00100000:0.0:1787857720.375318:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171604224 00002000:00100000:0.0:1787857720.375367:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff9997c34f1a40 x1874704171604224/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.375379:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f1a40 with x1874704171604224 ext(4194304->5242879) 00002000:00010000:0.0:1787857720.375385:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f1a40 00000100:00100000:0.0:1787857720.375420:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:0.0:1787857720.375430:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2348:x1874704171604224:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787857720.396978:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2348:x1874704171604224:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 21535us (21952us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787857720.396993:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 79 00002000:00100000:0.0:1787857720.397007:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff9997c34f1a40 x1874704171604224/t4294967338(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:366/0 lens 488/448 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.397017:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f1a40 with x1874704171604224 ext(4194304->5242879) 00002000:00010000:0.0:1787857720.397024:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f1a40 00000100:00100000:1.0:1787857720.406209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.406256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.406296:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.406388:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171604480 00000100:00100000:3.0:1787857720.406405:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171604480 00000100:00100000:3.0:1787857720.406501:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171604736 00000100:00100000:3.0:1787857720.406507:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171604736 00000100:00100000:2.0:1787857720.406519:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171604864 00000100:00100000:2.0:1787857720.406533:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171604864 00000100:00100000:3.0:1787857720.406570:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 330 00000100:00100000:2.0:1787857720.406608:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 868 00000100:00100000:2.0:1787857720.406706:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:24661:x1874704171604864:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787857720.406955:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171604480:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857720.407070:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171604480:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 487us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.407080:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 330 00000100:00100000:3.0:1787857720.407107:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 331 00000100:00100000:3.0:1787857720.407116:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171604736:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857720.407146:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171604736:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.407153:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 331 00000100:00080000:3.0:1787857720.407178:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857720.422577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.422650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.422686:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171604608 00000100:00100000:1.0:1787857720.422695:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171604608 00000100:00100000:1.0:1787857720.422754:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 332 00000100:00100000:1.0:1787857720.422765:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171604608:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857720.422878:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171604608:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 114us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857720.422901:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 332 00000100:00100000:3.0:1787857720.423512:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171604352 00000100:00100000:3.0:1787857720.423519:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171604352 00000100:00100000:3.0:1787857720.423569:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 542 00000100:00100000:3.0:1787857720.423577:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171604352:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857720.423616:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171604352:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.423640:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 542 00000100:00100000:0.0:1787857720.495162:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:24661:x1874704171604864:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 88531us (88851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857720.495176:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 868 00000001:00080000:1.0:1787857720.495312:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967868 is committed 00000001:00080000:1.0:1787857720.495334:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967860 is committed 00000004:00080000:1.0:1787857720.495371:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000001:00080000:1.0:1787857720.495394:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967865 is committed 00000020:00080000:1.0:1787857720.495404:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c133a300 refcount 2 committed 0 result 0 batchid 13 00000020:00080000:1.0:1787857720.495409:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998e53fb600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998c133ad80 00000020:00080000:1.0:1787857720.495412:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998e53fba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998d0925400 00000001:00080000:1.0:1787857720.495425:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967872 is committed 00000001:00080000:1.0:1787857720.495443:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967866 is committed 00000020:00080000:1.0:1787857720.495457:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 13 committed batchid 12 00000020:00080000:1.0:1787857720.495685:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12 00000100:00100000:1.0:1787857720.502971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.503057:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171604992 00000100:00100000:3.0:1787857720.503068:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171604992 00000100:00100000:3.0:1787857720.503139:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 215 00000100:00100000:3.0:1787857720.503150:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2347:x1874704171604992:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787857720.574260:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00000001:00080000:1.0:1787857720.574350:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00000100:00100000:2.0:1787857720.578413:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171604992:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 75254us (75441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857720.578427:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 215 00000100:00100000:3.0:1787857720.580664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.580769:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171605248 00000100:00100000:0.0:1787857720.580779:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171605248 00000100:00100000:0.0:1787857720.580867:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 869 00000100:00100000:0.0:1787857720.580892:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:24661:x1874704171605248:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857720.580959:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857720.580988:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36db expref: 38 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.581008:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857720.581013:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857720.581043:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.581057:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.581068:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857720.581281:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000c8f310 reply state 00000000f2818ded transno 4294967873 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857720.581291:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857720.581410:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:24661:x1874704171605248:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 519us (757us total) trans 4294967873 rc 0/0 00000100:00100000:0.0:1787857720.581418:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 869 00000100:00100000:0.0:1787857720.585049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857720.585333:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.585347:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.585354:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.585360:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857720.585365:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.585372:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.585391:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857720.585394:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857720.585399:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.585405:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bad6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.585604:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171605376 00000100:00100000:1.0:1787857720.585615:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171605376 00000100:00100000:1.0:1787857720.585689:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 870 00000100:00100000:1.0:1787857720.585698:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:24661:x1874704171605376:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857720.585721:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857720.585738:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36f0 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.585793:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 39 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.585863:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 39 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.585884:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:1.0:1787857720.585887:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857720.585890:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052c00, rc 0) 00000100:00100000:1.0:1787857720.585958:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:24661:x1874704171605376:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 261us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857720.585966:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 870 00000100:00100000:2.0:1787857720.589778:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.589951:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171605504 00000100:00100000:1.0:1787857720.589962:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171605504 00000100:00100000:1.0:1787857720.590016:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 216 00000100:00100000:1.0:1787857720.590027:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171605504:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787857720.590390:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:1.0:1787857720.590394:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1787857717 00002000:00010000:1.0:1787857720.590397:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb atime from disk: 0 -> 1787857717 00002000:00010000:1.0:1787857720.590399:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1787857717 00002000:00010000:1.0:1787857720.590401:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 1 -> 10247 00000100:00100000:1.0:1787857720.590470:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171605504:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 443us (701us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1787857720.590480:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 216 00000100:00100000:3.0:1787857720.597395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.597662:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171605760 00000100:00100000:0.0:1787857720.597677:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171605760 00000100:00100000:0.0:1787857720.597768:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 871 00000100:00100000:0.0:1787857720.597782:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:24661:x1874704171605760:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787857720.597950:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.597990:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.598002:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.598045:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.598062:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 39 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857720.598079:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188221312:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857720.598197:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857720.607130:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188221312:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857720.607169:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857720.607399:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.607651:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171605888 00000100:00100000:0.0:1787857720.607661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171605888 00010000:00010000:0.0:1787857720.607721:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 40 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857720.607774:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:0.0:1787857720.607784:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2349:x1874704171605888:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857720.607808:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857720.607878:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 40 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.607892:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 40 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.607921:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7ba90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36c6 expref: 40 pid: 5857 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.607941:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857720.607947:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.607959:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.607969:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.607996:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857720.608097:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2349:x1874704171605888:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 314us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857720.608107:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 270 00010000:00010000:1.0:1787857720.609070:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.609088:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.609142:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.609150:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.609157:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.609163:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857720.609167:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.609176:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.609192:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:1.0:1787857720.609195:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787857720.609202:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.609208:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bae4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.609307:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:24661:x1874704171605760:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 11525us (11923us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787857720.609319:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 871 00000100:00100000:2.0:1787857720.614169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.614432:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171606016 00000100:00100000:1.0:1787857720.614449:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171606016 00000100:00100000:1.0:1787857720.614530:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 217 00000100:00100000:1.0:1787857720.614563:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171606016:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857720.614647:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.614674:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.614684:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857720.614689:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857720.614695:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.614743:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.614760:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 10 pid: 14028 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.614778:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188221440:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857720.615078:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857720.618642:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188221440:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857720.618679:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857720.635343:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.635451:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171606144 00000100:00100000:1.0:1787857720.635476:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171606144 00010000:00010000:1.0:1787857720.635531:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 11 pid: 14028 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.635630:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 271 00000100:00100000:1.0:1787857720.635643:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171606144:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857720.635659:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857720.635683:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 11 pid: 14028 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.635698:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 11 pid: 14028 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.635723:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7bacf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36e9 expref: 11 pid: 14028 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.635742:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857720.635747:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857720.635754:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.635765:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.635810:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857720.635875:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.635887:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.635927:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171606144:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 285us (596us total) trans 0 rc 0/0 00010000:00010000:3.0:1787857720.635939:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.635951:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 271 00010000:00010000:3.0:1787857720.635952:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.635963:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.635970:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857720.635974:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.635984:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.636159:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.636169:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7baeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857720.636226:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171606016:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 21666us (22075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.636244:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 217 00000100:00100000:2.0:1787857720.645519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.646374:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171606400 00000100:00100000:1.0:1787857720.646386:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171606400 00000100:00100000:1.0:1787857720.646456:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 872 00000100:00100000:1.0:1787857720.646467:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:24661:x1874704171606400:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787857720.646553:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.646578:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.646594:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.646899:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.646912:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 39 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.646922:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.646959:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 39 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.646975:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 39 pid: 7656 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.647016:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188221568:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857720.647692:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857720.653229:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188221568:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857720.653264:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857720.661084:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.661178:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171606528 00000100:00100000:3.0:1787857720.661188:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171606528 00010000:00010000:3.0:1787857720.661232:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 40 pid: 7656 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857720.661277:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 272 00000100:00100000:3.0:1787857720.661287:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2349:x1874704171606528:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857720.661302:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857720.661308:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 40 pid: 7656 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.661328:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 40 pid: 7656 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.661354:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7badd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f0 expref: 40 pid: 7656 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.661371:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857720.661376:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.661385:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.661408:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857720.661447:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857720.661511:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2349:x1874704171606528:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 225us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.661519:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 272 00010000:00010000:1.0:1787857720.661635:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.661645:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857720.661951:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967874 00000001:00080000:1.0:1787857720.662115:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967875 00000001:00080000:1.0:1787857720.662163:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967876 00000100:00100000:1.0:1787857720.662253:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188221696:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787857720.662308:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857720.662336:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c12edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857720.662488:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188221696 00000100:00100000:3.0:1787857720.662493:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188221696 00000100:00100000:3.0:1787857720.662530:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787857720.662537:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188221696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787857720.662603:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188221696:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857720.662609:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787857720.663114:0:7656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:1.0:1787857720.663121:0:7656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c507d680, transno 4294967333 00000100:00100000:1.0:1787857720.663142:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188221696:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787857720.663692:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967877 00000100:00100000:1.0:1787857720.663763:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188221824:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787857720.663804:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857720.664645:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857720.668248:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188221824 00000100:00100000:3.0:1787857720.668268:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188221824 00000100:00100000:3.0:1787857720.668537:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787857720.668549:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188221824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787857720.668923:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7656:x1874704188221824:12345-0@lo:1000:mdt00_003.0 Request processed in 376us (5117us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787857720.668932:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787857720.669151:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188221824:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787857720.669274:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967878 00010000:00010000:1.0:1787857720.669331:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669343:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669366:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669372:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857720.669377:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669384:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669400:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998d1291100) 00010000:00010000:1.0:1787857720.669403:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857720.669408:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669414:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7baf9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669443:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669449:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669456:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669460:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857720.669463:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669478:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669487:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857720.669489:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857720.669496:0:7656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36a3 expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669508:0:7656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36a3 expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669517:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36a3 expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.669552:0:7656:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36a3 expref: 81 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857720.669568:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188221952:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857720.669669:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857720.678086:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188221952:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857720.678125:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678137:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7ba04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678172:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678198:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678210:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678221:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678228:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678235:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678241:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857720.678245:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678252:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678263:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857720.678266:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857720.678270:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678276:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678284:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678296:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678301:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678306:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857720.678308:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678381:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678394:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857720.678396:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857720.678399:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.678405:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7baf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857720.679127:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857720.679133:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787857720.679487:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:24661:x1874704171606400:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 33017us (33975us total) trans 4294967879 rc 0/0 00000100:00100000:1.0:1787857720.679499:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 872 00000020:00080000:1.0:1787857720.679507:0:7656:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1787857720.680095:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787857720.680110:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857720.681114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.681181:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171606656 00000100:00100000:1.0:1787857720.681190:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171606656 00000100:00100000:1.0:1787857720.681242:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 178 00000100:00100000:1.0:1787857720.681251:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6122c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:24660:x1874704171606656:12345-192.168.204.36@tcp:49:md5sum.0 00000100:00100000:1.0:1787857720.681399:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6122c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:24660:x1874704171606656:12345-192.168.204.36@tcp:49:md5sum.0 Request processed in 147us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857720.681407:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 178 00000100:00100000:3.0:1787857720.685354:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857720.685401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.685549:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171607040 00000100:00100000:1.0:1787857720.685561:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171607040 00000100:00100000:1.0:1787857720.685634:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 179 00000100:00100000:1.0:1787857720.685645:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:24661:x1874704171607040:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787857720.687448:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x16:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787857720.687610:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967880 00010000:00010000:1.0:1787857720.687693:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.687713:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.687725:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.687735:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.687742:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.687750:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857720.687776:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857720.687963:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171606784 00000100:00100000:2.0:1787857720.687971:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171606784 00000100:00100000:2.0:1787857720.688023:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:2.0:1787857720.688032:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:24660:x1874704171606784:12345-192.168.204.36@tcp:101:md5sum.0 00010000:00010000:2.0:1787857720.688056:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857720.688083:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36f7 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857720.688109:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 5242880, mtime: 0x6a908b35, atime: 0x6a908b35, ctime: 0x6a908b35, blocks: 0x2807 00010000:00010000:2.0:1787857720.688127:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1787857720.688132:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857720.688141:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.688155:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857720.688166:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5082a00, rc 0) 00000100:00100000:2.0:1787857720.688234:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:24660:x1874704171606784:12345-192.168.204.36@tcp:101:md5sum.0 Request processed in 203us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857720.688242:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 218 00010000:00010000:0.0:1787857720.688663:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857720.688671:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.688678:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857720.688682:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.688703:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.688716:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9998c53ae500) 00010000:00010000:0.0:1787857720.688719:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857720.688724:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.688730:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bb07 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857720.688751:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857720.688753:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857720.688755:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857720.689904:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:24661:x1874704171607040:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 4251us (4492us total) trans 4294967881 rc 0/0 00000100:00100000:1.0:1787857720.689943:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 179 00000020:00080000:1.0:1787857720.690144:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787857720.694256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.694437:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171607168 00000100:00100000:1.0:1787857720.694448:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171607168 00002000:00100000:1.0:1787857720.694500:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (0->32767) req@ffff9997c34f2d00 x1874704171607168/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857720.694512:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f2d00 with x1874704171607168 ext(0->32767) 00002000:00010000:1.0:1787857720.694517:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f2d00 00000100:00100000:1.0:1787857720.694553:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:1.0:1787857720.694563:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171607168:12345-192.168.204.36@tcp:3:md5sum.0 00000100:00100000:1.0:1787857720.702718:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171607168:12345-192.168.204.36@tcp:3:md5sum.0 Request processed in 8144us (8460us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1787857720.702732:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 80 00002000:00100000:1.0:1787857720.702746:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (0->32767) req@ffff9997c34f2d00 x1874704171607168/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/440 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 32768/32768 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857720.702756:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f2d00 with x1874704171607168 ext(0->32767) 00002000:00010000:1.0:1787857720.702764:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f2d00 00000100:00100000:3.0:1787857720.712381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.712679:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171607296 00000100:00100000:0.0:1787857720.712690:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171607296 00002000:00100000:0.0:1787857720.712743:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (32768->1048575) req@ffff9997c34f0780 x1874704171607296/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.712755:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f0780 with x1874704171607296 ext(32768->1048575) 00002000:00010000:0.0:1787857720.712761:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f0780 00000100:00100000:0.0:1787857720.712801:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:0.0:1787857720.712811:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171607296:12345-192.168.204.36@tcp:3:md5sum.0 00000100:00100000:0.0:1787857720.737553:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171607296:12345-192.168.204.36@tcp:3:md5sum.0 Request processed in 24732us (25171us total) trans 0 rc 1015808/1015808 00000100:00100000:0.0:1787857720.737569:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 81 00002000:00100000:0.0:1787857720.737582:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (32768->1048575) req@ffff9997c34f0780 x1874704171607296/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/440 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 1015808/1015808 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.737613:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c34f0780 with x1874704171607296 ext(32768->1048575) 00002000:00010000:0.0:1787857720.737631:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c34f0780 00000100:00100000:3.0:1787857720.763163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857720.763635:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171607424 00000100:00100000:0.0:1787857720.763647:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171607424 00002000:00100000:0.0:1787857720.763711:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff9997c507d680 x1874704171607424/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.763724:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507d680 with x1874704171607424 ext(1048576->2097151) 00002000:00010000:0.0:1787857720.763731:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c507d680 00000100:00100000:0.0:1787857720.763770:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:0.0:1787857720.763781:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171607424:12345-192.168.204.36@tcp:3:md5sum.0 00000100:00100000:2.0:1787857720.768464:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.768678:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171607552 00000100:00100000:1.0:1787857720.768689:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171607552 00002000:00100000:1.0:1787857720.768742:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff9998efa6de00 x1874704171607552/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857720.768755:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6de00 with x1874704171607552 ext(2097152->3145727) 00002000:00010000:1.0:1787857720.768761:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6de00 00000100:00100000:1.0:1787857720.768807:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:2.0:1787857720.768844:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.768865:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171607552:12345-192.168.204.36@tcp:3:md5sum.0 00000100:00100000:2.0:1787857720.768876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857720.768898:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171607680 00000100:00100000:2.0:1787857720.768902:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171607680 00002000:00100000:2.0:1787857720.768940:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff9998efa6c780 x1874704171607680/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857720.768949:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6c780 with x1874704171607680 ext(3145728->4194303) 00002000:00010000:2.0:1787857720.768952:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6c780 00000100:00100000:2.0:1787857720.768972:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171607808 00000100:00100000:2.0:1787857720.768976:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171607808 00002000:00100000:2.0:1787857720.768993:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff9998efa6f480 x1874704171607808/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/0 e 0 to 0 dl 1787857731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857720.769000:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6f480 with x1874704171607808 ext(4194304->5242879) 00002000:00010000:2.0:1787857720.769003:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6f480 00000100:00100000:2.0:1787857720.769028:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:2.0:1787857720.769036:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171607680:12345-192.168.204.36@tcp:3:md5sum.0 00000100:00100000:0.0:1787857720.792282:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2348:x1874704171607424:12345-192.168.204.36@tcp:3:md5sum.0 Request processed in 28491us (29118us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1787857720.792297:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 82 00002000:00100000:0.0:1787857720.792311:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff9997c507d680 x1874704171607424/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/440 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857720.792321:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507d680 with x1874704171607424 ext(1048576->2097151) 00002000:00010000:0.0:1787857720.792327:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c507d680 00000100:00100000:0.0:1787857720.792364:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 85 00000100:00100000:0.0:1787857720.792378:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171607808:12345-192.168.204.36@tcp:3:md5sum.0 00000100:00100000:2.0:1787857720.810416:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171607680:12345-192.168.204.36@tcp:3:md5sum.0 Request processed in 41369us (41587us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787857720.810432:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 84 00002000:00100000:2.0:1787857720.810449:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff9998efa6c780 x1874704171607680/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/440 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857720.810460:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6c780 with x1874704171607680 ext(3145728->4194303) 00002000:00010000:2.0:1787857720.810467:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6c780 00000100:00100000:1.0:1787857720.824360:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171607552:12345-192.168.204.36@tcp:3:md5sum.0 Request processed in 55487us (55894us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1787857720.824374:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 83 00002000:00100000:1.0:1787857720.824400:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff9998efa6de00 x1874704171607552/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/440 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857720.824410:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6de00 with x1874704171607552 ext(2097152->3145727) 00002000:00010000:1.0:1787857720.824417:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6de00 00000100:00100000:1.0:1787857720.838340:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171607808:12345-192.168.204.36@tcp:3:md5sum.0 Request processed in 45955us (69452us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1787857720.838357:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 85 00002000:00100000:1.0:1787857720.838370:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff9998efa6f480 x1874704171607808/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:366/0 lens 488/440 e 0 to 0 dl 1787857731 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857720.838381:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6f480 with x1874704171607808 ext(4194304->5242879) 00002000:00010000:1.0:1787857720.838398:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6f480 00000100:00100000:3.0:1787857720.866101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857720.866958:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171608064 00000100:00100000:1.0:1787857720.867038:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171608064 00000100:00100000:1.0:1787857720.867173:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 180 00000100:00100000:1.0:1787857720.867185:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:24660:x1874704171608064:12345-192.168.204.36@tcp:35:md5sum.0 00000100:00100000:1.0:1787857720.867486:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+83:24660:x1874704171608064:12345-192.168.204.36@tcp:35:md5sum.0 Request processed in 302us (1394us total) trans 4294967882 rc 0/0 00000100:00100000:1.0:1787857720.867494:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 180 00010000:00010000:1.0:1787857721.071007:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857722.098938:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857722.223186:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188222080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857722.223308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857722.223646:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188222080 00000100:00100000:0.0:1787857722.223658:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188222080 00000100:00100000:0.0:1787857722.223751:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787857722.223764:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188222080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857722.223845:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000100:00100000:0.0:1787857722.223929:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188222080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857722.223938:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787857722.224003:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188222080:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787857722.224188:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787857723.120512:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857723.758028:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c27170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188222464:0@lo:400:kworker.0 00000100:00100000:0.0:1787857723.758105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857723.758127:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2716940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188222336:0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857723.758163:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857723.758168:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188222592:0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758176:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188222848:0@lo:400:kworker.0 00000100:00100000:0.0:1787857723.758192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857723.758235:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188222464 00000100:00100000:0.0:1787857723.758242:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188222464 00000100:00100000:1.0:1787857723.758250:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857723.758281:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787857723.758287:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188222208:0@lo:400:kworker.0 00000100:00100000:0.0:1787857723.758306:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188222336 00000100:00100000:0.0:1787857723.758310:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188222336 00000100:00100000:1.0:1787857723.758317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857723.758330:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787857723.758337:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2715e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188222720:0@lo:400:kworker.0 00000100:00100000:0.0:1787857723.758338:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188222464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758357:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857723.758389:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188222720 00000100:00100000:1.0:1787857723.758392:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188222720 00000100:00100000:1.0:1787857723.758420:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787857723.758425:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188222336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758461:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188222336:12345-0@lo:400:kworker.0 Request processed in 35us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857723.758468:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787857723.758471:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188222464:12345-0@lo:400:kworker.0 Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857723.758477:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787857723.758484:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787857723.758490:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188222720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857723.758500:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188222592 00000100:00100000:0.0:1787857723.758508:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188222592 00000100:00100000:1.0:1787857723.758517:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188222720:12345-0@lo:400:kworker.0 Request processed in 28us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857723.758522:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787857723.758533:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188222848 00000100:00100000:0.0:1787857723.758536:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188222848 00000100:00100000:0.0:1787857723.758568:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787857723.758574:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188222592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758578:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2715e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188222720:0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758589:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2716940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188222336:0@lo:400:kworker.0 00000100:00100000:0.0:1787857723.758604:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188222592:12345-0@lo:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857723.758627:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787857723.758635:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188222208 00000100:00100000:1.0:1787857723.758639:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188222208 00000100:00100000:0.0:1787857723.758639:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787857723.758645:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188222848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758671:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1787857723.758676:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188222848:12345-0@lo:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857723.758677:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188222208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857723.758682:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787857723.758704:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188222208:12345-0@lo:400:kworker.0 Request processed in 28us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857723.758709:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188222592:0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758711:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1787857723.758719:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c27170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188222464:0@lo:400:kworker.0 00000100:00080000:1.0:1787857723.758741:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857723.758746:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857723.758770:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188222208:0@lo:400:kworker.0 00000100:00100000:1.0:1787857723.758780:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188222848:0@lo:400:kworker.0 00000040:00080000:3.0:1787857723.759248:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857723.759312:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857723.759678:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 3 00000040:00080000:3.0:1787857723.759691:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857724.147930:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787857724.271241:0:7958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 548321419437ns, next at 549321416827ns, rc = 0 00000100:00100000:0.0:1787857724.271279:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188222976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857724.271352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857724.271427:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188222976 00000100:00100000:0.0:1787857724.271434:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188222976 00000100:00100000:0.0:1787857724.271500:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787857724.271510:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188222976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857724.271562:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 69664768 pending 0 free 3852468224 avail 3850371072 00000100:00100000:0.0:1787857724.271609:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188222976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857724.271616:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787857724.271663:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188222976:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787857724.397560:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00000001:00080000:3.0:1787857724.397585:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967348 is committed 00010000:00010000:1.0:1787857725.166409:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857725.520041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857725.520274:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171608320 00000100:00100000:0.0:1787857725.520284:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171608320 00000100:00080000:1.0:1787857725.520390:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857725.520405:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 354 00000100:00100000:0.0:1787857725.520435:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+83:2350:x1874704171608320:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857725.520547:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+83:2350:x1874704171608320:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 116us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857725.520556:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 354 00000100:00100000:0.0:1787857725.530445:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857725.530560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171608192 00000100:00100000:1.0:1787857725.530570:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171608192 00000100:00100000:1.0:1787857725.530666:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 544 00000100:00100000:1.0:1787857725.530676:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171608192:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857725.530760:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171608192:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 85us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857725.530767:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 544 00000100:00100000:3.0:1787857725.532199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857725.532249:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857725.532274:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857725.532299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857725.532324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857725.532351:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171608448 00000100:00100000:3.0:1787857725.532358:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171608448 00000100:00100000:3.0:1787857725.532409:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171608576 00000100:00100000:3.0:1787857725.532413:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171608576 00000100:00100000:3.0:1787857725.532429:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171608832 00000100:00100000:3.0:1787857725.532432:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171608832 00000100:00100000:3.0:1787857725.532446:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171608960 00000100:00100000:3.0:1787857725.532449:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171608960 00000100:00100000:3.0:1787857725.532464:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 335 00000100:00100000:3.0:1787857725.532474:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171608448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857725.532543:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171608448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 69us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857725.532551:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 335 00000100:00100000:3.0:1787857725.532591:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 336 00000100:00100000:3.0:1787857725.532599:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171608576:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857725.532627:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171608576:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857725.532634:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 336 00000100:00100000:3.0:1787857725.532646:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 337 00000100:00100000:3.0:1787857725.532652:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171608832:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857725.532675:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171608832:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857725.532681:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 337 00000100:00100000:3.0:1787857725.532692:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00100000:3.0:1787857725.532698:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171608960:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857725.532734:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171608960:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857725.532740:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00100000:3.0:1787857725.532761:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171608704 00000100:00100000:3.0:1787857725.532765:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171608704 00000100:00100000:3.0:1787857725.532796:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 355 00000100:00100000:3.0:1787857725.532802:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2349:x1874704171608704:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857725.532870:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2349:x1874704171608704:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 68us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857725.532877:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 355 00000100:00080000:3.0:1787857725.532903:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857725.532908:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857725.532917:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787857725.865598:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000001:00080000:2.0:1787857725.865620:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967873 is committed 00000001:00080000:2.0:1787857725.865629:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967882 is committed 00000001:00080000:2.0:1787857725.865634:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967881 is committed 00000020:00080000:2.0:1787857725.865660:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998d8753600 refcount 2 committed 0 result 0 batchid 14 00000020:00080000:2.0:1787857725.865665:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c18d0400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998d8753540 00000020:00080000:2.0:1787857725.865681:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c18d0600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998efb5bc00 00000020:00080000:2.0:1787857725.865701:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 13 batchid updated 00000020:00080000:2.0:1787857725.865775:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 14 committed batchid 13 00000020:00080000:2.0:1787857725.865994:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 13 00000100:00100000:2.0:1787857725.866014:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188223104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787857725.866087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857725.866162:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188223104 00000100:00100000:2.0:1787857725.866170:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188223104 00000100:00100000:2.0:1787857725.866241:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787857725.866251:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188223104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787857725.866277:0:14028:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:19 count 1 00002000:00010000:2.0:1787857725.866309:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 5242880, mtime: 0x6a908b35, atime: 0x0, ctime: 0x6a908b35, blocks: 0x2807 00010000:00010000:2.0:1787857725.866317:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.866333:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787857725.866338:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857725.866346:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.866361:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.866372:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.866395:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.866413:0:14028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857725.867001:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188223104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 750us (912us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787857725.867009:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:2.0:1787857725.867034:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857725.867046:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857725.867052:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.867062:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857725.867067:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.867076:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.867094:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.867101:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7bb15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857725.867128:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857725.867130:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857725.867132:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857725.867160:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967348 gen 2 00000004:00080000:2.0:1787857725.867166:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c507e940, transno 4294967347 00000004:00080000:2.0:1787857725.867174:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967348 committed transno 4294967348 00000100:00100000:2.0:1787857725.867195:0:3305:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9998efa6c3c0 x1874704188223104/t4294967349(4294967349) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787857741 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787857725.867205:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998efa6c3c0/2, rc 0, transno 4294967349 00000100:00100000:2.0:1787857725.867209:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188223104:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787857725.873058:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00000001:00080000:1.0:1787857725.873076:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00000100:00100000:2.0:1787857726.028286:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857726.028418:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171609088 00000100:00100000:1.0:1787857726.028429:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171609088 00000100:00100000:1.0:1787857726.028497:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 873 00000100:00100000:1.0:1787857726.028508:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+82:25076:x1874704171609088:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857726.028541:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857726.028565:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bb1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd36fe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.028667:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bb23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.028684:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.028698:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857726.028983:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00000004:00200000:1.0:1787857726.028987:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857726.029072:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.029103:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bb1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36fe expref: 84 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.029120:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bb23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36fe expref: 83 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.029128:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857726.029131:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857726.029134:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857726.029214:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+83:25076:x1874704171609088:12345-192.168.204.36@tcp:101:rm.0 Request processed in 708us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857726.029221:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 873 00000100:00100000:3.0:1787857726.035350:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857726.035458:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171609344 00000100:00100000:1.0:1787857726.035470:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171609344 00000100:00100000:1.0:1787857726.035556:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 874 00000100:00100000:1.0:1787857726.035568:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+83:25076:x1874704171609344:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857726.035591:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857726.035612:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bb2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3705 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857726.036284:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:1.0:1787857726.036522:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bb2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3705 expref: 85 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.036539:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:1.0:1787857726.036543:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857726.036548:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bb2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3705 expref: 85 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.036561:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:1.0:1787857726.036630:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+84:25076:x1874704171609344:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1065us (1290us total) trans 4294967883 rc 301/301 00000100:00100000:1.0:1787857726.036648:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 874 00000100:00100000:3.0:1787857726.047971:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857726.048145:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171609472 00000100:00100000:2.0:1787857726.048160:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171609472 00000100:00100000:2.0:1787857726.048899:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 181 00000100:00100000:2.0:1787857726.048912:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+84:25076:x1874704171609472:12345-192.168.204.36@tcp:37:rm.0 00000100:00100000:0.0:1787857726.066592:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+84:25076:x1874704171609472:12345-192.168.204.36@tcp:37:rm.0 Request processed in 17673us (18628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857726.066619:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 181 00000100:00100000:3.0:1787857726.079925:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857726.080627:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171609728 00000100:00100000:1.0:1787857726.080645:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171609728 00000100:00100000:1.0:1787857726.080731:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:1.0:1787857726.080742:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+84:25076:x1874704171609728:12345-192.168.204.36@tcp:35:rm.0 00000100:00100000:1.0:1787857726.081292:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+85:25076:x1874704171609728:12345-192.168.204.36@tcp:35:rm.0 Request processed in 542us (1379us total) trans 4294967884 rc 0/0 00000100:00100000:1.0:1787857726.081301:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:2.0:1787857726.101095:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857726.101435:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171609984 00000100:00100000:1.0:1787857726.101589:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171609984 00000100:00100000:1.0:1787857726.101696:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 875 00000100:00100000:1.0:1787857726.101708:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+85:25076:x1874704171609984:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857726.101739:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857726.101761:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bb38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd370c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.102093:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.102111:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.102124:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857726.102135:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:1.0:1787857726.102327:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bb38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd370c expref: 88 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.102346:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd370c expref: 87 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.102354:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857726.102357:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787857726.102360:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052000, rc 0) 00000100:00100000:1.0:1787857726.102451:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+87:25076:x1874704171609984:12345-192.168.204.36@tcp:101:rm.0 Request processed in 737us (1362us total) trans 4294967885 rc 0/0 00000100:00100000:1.0:1787857726.102460:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 875 00000100:00100000:2.0:1787857726.117411:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857726.120757:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171610112 00000100:00100000:3.0:1787857726.120773:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171610112 00000100:00100000:2.0:1787857726.124694:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 876 00000100:00100000:2.0:1787857726.124712:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+87:25076:x1874704171610112:12345-192.168.204.36@tcp:41:rm.0 00000004:00000024:2.0:1787857726.124780:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 7704936448 avail 7696547840 00000100:00100000:2.0:1787857726.124898:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+87:25076:x1874704171610112:12345-192.168.204.36@tcp:41:rm.0 Request processed in 190us (7498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857726.124907:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 876 00000100:00100000:2.0:1787857726.133498:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857726.133692:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171610240 00000100:00100000:0.0:1787857726.133702:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171610240 00000100:00100000:0.0:1787857726.133767:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 877 00000100:00100000:0.0:1787857726.133777:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+87:25076:x1874704171610240:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857726.133807:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857726.133847:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bb4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3713 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.133917:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.133933:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.133946:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.133961:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.133968:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.133982:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.134753:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bb62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.134765:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bb62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.134773:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bb62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857726.138141:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00000004:00200000:1.0:1787857726.138151:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857726.138188:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bb62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138220:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bb62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138404:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138412:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138418:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138424:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857726.138429:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138436:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138453:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857726.138456:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857726.138462:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138467:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bb54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138487:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138522:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138528:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138532:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857726.138535:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138541:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138549:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff9998d8aea200) 00010000:00010000:1.0:1787857726.138551:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857726.138554:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138559:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bb5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138601:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bb4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3713 expref: 89 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138615:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bb62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3713 expref: 88 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.138623:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857726.138626:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857726.138644:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4800, rc 0) 00000100:00100000:1.0:1787857726.138731:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+88:25076:x1874704171610240:12345-192.168.204.36@tcp:101:rm.0 Request processed in 4954us (5241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857726.138740:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 877 00000100:00100000:2.0:1787857726.150166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857726.150984:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171610496 00000100:00100000:3.0:1787857726.150994:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171610496 00000100:00100000:3.0:1787857726.151061:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 878 00000100:00100000:3.0:1787857726.151071:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+88:25076:x1874704171610496:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:3.0:1787857726.151127:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787857726.151164:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bb62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3713 expref: 88 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.151188:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7ba0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36a3 expref: 87 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.151202:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857726.151218:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bb23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36fe expref: 86 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.151227:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:3.0:1787857726.151231:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857726.151252:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.151265:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.151274:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.151462:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.151471:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.151479:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.154133:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.154156:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.154168:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857726.155249:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8728 00000004:00080000:2.0:1787857726.155261:0:7656:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 550205443174ns, next at 551205440704ns, rc = 0 00010000:00010000:2.0:1787857726.155326:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155338:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155348:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155357:0:7656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155363:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155370:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155391:0:7656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857726.155413:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155430:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155436:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155443:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857726.155447:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155454:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155466:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998e18d9300) 00010000:00010000:2.0:1787857726.155469:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787857726.155474:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155480:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7bb77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155503:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155508:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155526:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155530:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857726.155538:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155544:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155553:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:2.0:1787857726.155555:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857726.155558:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857726.155564:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bb69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857726.155575:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009adb229d reply state 000000008d2099f1 transno 4294967886 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857726.155584:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857726.155691:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+87:25076:x1874704171610496:12345-192.168.204.36@tcp:36:rm.0 Request processed in 4618us (5533us total) trans 4294967886 rc 0/0 00000100:00100000:2.0:1787857726.155701:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 878 00010000:00010000:3.0:1787857726.157053:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857726.157067:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.157077:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857726.157082:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.157090:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.157106:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9998e18d9300) 00010000:00010000:3.0:1787857726.157109:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857726.157114:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.157121:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7bb7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.157142:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857726.157144:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857726.157146:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857726.164475:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.164494:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.164502:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.164519:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857726.164524:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.164532:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.164548:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff9998d1291500) 00010000:00010000:3.0:1787857726.164551:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857726.164557:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.164563:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bb70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857726.187554:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857726.187663:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171610752 00000100:00100000:1.0:1787857726.187673:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171610752 00000100:00100000:1.0:1787857726.187736:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 183 00000100:00100000:1.0:1787857726.187747:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+86:25076:x1874704171610752:12345-192.168.204.36@tcp:35:rm.0 00000100:00100000:1.0:1787857726.188108:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+87:25076:x1874704171610752:12345-192.168.204.36@tcp:35:rm.0 Request processed in 362us (571us total) trans 4294967887 rc 0/0 00000100:00100000:1.0:1787857726.188117:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 183 00010000:00010000:0.0:1787857726.190043:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857726.190687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857726.191393:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171611008 00000100:00100000:1.0:1787857726.191404:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171611008 00000100:00100000:1.0:1787857726.191475:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 879 00000100:00100000:1.0:1787857726.191486:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+87:25076:x1874704171611008:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:1.0:1787857726.191557:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787857726.191586:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd370c expref: 87 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.191610:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7b883 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3625 expref: 86 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.191621:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857726.191631:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7b867 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd361e expref: 85 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.191641:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:1.0:1787857726.191659:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857726.191681:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.191695:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.191703:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.191736:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.191751:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 35 pid: 5857 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857726.191764:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188223232:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857726.192187:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857726.196287:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188223232:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857726.196325:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857726.197651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857726.198214:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171611136 00000100:00100000:0.0:1787857726.198224:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171611136 00010000:00010000:0.0:1787857726.199198:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 36 pid: 5857 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857726.199269:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 273 00000100:00100000:0.0:1787857726.199451:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171611136:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857726.199472:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857726.199480:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 36 pid: 5857 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.199494:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 36 pid: 5857 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.199527:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7ba43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b1 expref: 36 pid: 5857 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.199558:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:0.0:1787857726.199564:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.199573:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.199580:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857726.199910:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857726.199969:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2350:x1874704171611136:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 691us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857726.199978:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 273 00010000:00010000:1.0:1787857726.205442:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.205467:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.205517:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.205554:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.205568:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.206444:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.206461:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 34 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.206468:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.206525:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 34 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.206543:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 34 pid: 7656 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857726.206557:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188223360:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857726.206754:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857726.221663:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857726.223232:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171611264 00000100:00100000:3.0:1787857726.223248:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171611264 00010000:00010000:3.0:1787857726.223313:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 35 pid: 7656 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857726.223366:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 274 00000100:00100000:3.0:1787857726.223378:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2349:x1874704171611264:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857726.223417:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857726.223426:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 35 pid: 7656 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.223442:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 35 pid: 7656 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.223468:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:3.0:1787857726.223475:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.223485:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.223492:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.223526:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857726.223595:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2349:x1874704171611264:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 219us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857726.223604:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 274 00010000:00010000:1.0:1787857726.228642:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7ba5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36b8 expref: 34 pid: 7656 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857726.228670:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2714780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188223360:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857726.228701:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.228755:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.228762:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857726.229661:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:1.0:1787857726.229682:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229691:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229699:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229705:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857726.229710:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229719:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229741:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9998e18d9900) 00010000:00010000:1.0:1787857726.229744:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857726.229750:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229755:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052e00/0xd3f183cab4a7bb93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229792:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229798:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229805:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229809:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857726.229812:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229864:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229873:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291200) 00010000:00010000:1.0:1787857726.229875:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857726.229878:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857726.229885:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bb85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857726.229900:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0ce38da reply state 00000000b936beab transno 4294967888 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857726.229908:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857726.229991:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+86:25076:x1874704171611008:12345-192.168.204.36@tcp:36:rm.0 Request processed in 38504us (39306us total) trans 4294967888 rc 0/0 00000100:00100000:1.0:1787857726.230001:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 879 00010000:00010000:3.0:1787857726.234811:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.234869:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.234877:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.234915:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857726.234920:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.234928:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.234946:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff9998c53aea00) 00010000:00010000:3.0:1787857726.234949:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857726.234963:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857726.234970:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bb8c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857726.318789:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857726.318929:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171611392 00000100:00100000:2.0:1787857726.318946:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171611392 00000100:00100000:2.0:1787857726.319035:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 880 00000100:00100000:2.0:1787857726.319046:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24632:x1874704171611392:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787857726.319159:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:24632:x1874704171611392:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 115us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857726.319179:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 880 00010000:00010000:1.0:1787857727.217446:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787857727.344182:0:6899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 551394362419ns, next at 552394359949ns, rc = 0 00000100:00100000:1.0:1787857727.344269:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857727.344293:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188223488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857727.344362:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857727.344476:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188223488 00000100:00100000:0.0:1787857727.344484:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188223488 00000100:00100000:0.0:1787857727.344560:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787857727.344570:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188223488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857727.344603:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000100:00100000:0.0:1787857727.344648:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188223488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857727.344654:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1787857727.344776:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857727.344803:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967340 gen 2 00000004:00080000:1.0:1787857727.344809:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967340 committed transno 4294967340 00000100:00100000:1.0:1787857727.344876:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188223488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857728.238121:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857728.328262:0:18580:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 15:08:46 (1787857726) 00000100:00100000:2.0:1787857728.701954:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857728.702380:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171611520 00000100:00100000:1.0:1787857728.702391:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171611520 00000100:00100000:1.0:1787857728.702532:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 881 00000100:00100000:1.0:1787857728.702544:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:25263:x1874704171611520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857728.702565:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857728.702628:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd371a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.702703:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.702718:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.702730:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857728.703257:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857728.703262:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857728.703295:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.703348:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bb9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.703369:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.703378:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53ae800) 00010000:00010000:1.0:1787857728.703381:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857728.703384:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:1.0:1787857728.703456:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:25263:x1874704171611520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 915us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857728.703530:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 881 00000100:00100000:0.0:1787857728.719656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857728.719745:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171611648 00000100:00100000:1.0:1787857728.719756:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171611648 00000100:00080000:2.0:1787857728.719925:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857728.725202:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 882 00000100:00100000:1.0:1787857728.725219:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:25263:x1874704171611648:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857728.725247:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857728.725268:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7bba8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3721 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.725334:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7bbaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.725348:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7bbaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.725361:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7bbaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857728.725442:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857728.725446:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857728.726410:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7bbaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.726446:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7bba8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3721 expref: 87 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.726545:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7bbaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3721 expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.726555:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53ae800) 00010000:00010000:1.0:1787857728.726558:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857728.726561:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053400, rc 0) 00000100:00100000:1.0:1787857728.728033:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+86:25263:x1874704171611648:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2744us (8314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857728.728045:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 882 00000100:00100000:0.0:1787857728.743708:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857728.745341:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171611776 00000100:00100000:1.0:1787857728.745357:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171611776 00000100:00100000:0.0:1787857728.746987:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 883 00000100:00100000:0.0:1787857728.747016:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:25264:x1874704171611776:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857728.747419:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:25264:x1874704171611776:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 405us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857728.747428:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 883 00000100:00100000:1.0:1787857728.782204:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857728.782300:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171611904 00000100:00100000:0.0:1787857728.782310:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171611904 00000100:00100000:0.0:1787857728.782443:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 884 00000100:00100000:0.0:1787857728.782454:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+86:25265:x1874704171611904:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857728.782550:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857728.782572:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bbb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3728 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782649:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782665:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782677:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782707:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782716:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782722:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782957:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782966:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782972:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782978:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.782982:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.782989:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783000:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53ae800) 00010000:00010000:0.0:1787857728.783003:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.783008:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783014:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783026:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783032:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783038:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783049:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.783052:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783058:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783066:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857728.783068:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.783070:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783075:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783106:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bbb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3728 expref: 87 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783116:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53ae800) 00010000:00010000:0.0:1787857728.783118:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.783122:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bbb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3728 expref: 87 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.783129:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857728.788160:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+86:25265:x1874704171611904:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5694us (6005us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857728.788174:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 884 00000100:00100000:2.0:1787857728.798330:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857728.798447:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171612160 00000100:00100000:3.0:1787857728.798471:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171612160 00000100:00100000:3.0:1787857728.798541:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 885 00000100:00100000:3.0:1787857728.798551:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+86:25265:x1874704171612160:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:3.0:1787857728.798617:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857728.798647:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7bbaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3721 expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.798668:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53ae800) 00010000:00010000:3.0:1787857728.798674:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857728.798777:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.798792:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.798811:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.800132:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.800153:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 34 pid: 5857 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857728.800180:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188223616:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857728.800290:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857728.807548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857728.808049:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188223616:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857728.808077:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857728.808364:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171612288 00000100:00100000:0.0:1787857728.808385:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171612288 00010000:00010000:0.0:1787857728.808422:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 35 pid: 5857 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857728.808514:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 275 00000100:00100000:0.0:1787857728.808523:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:2349:x1874704171612288:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857728.808539:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857728.808546:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 35 pid: 5857 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.808560:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 35 pid: 5857 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.808583:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bba1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd371a expref: 35 pid: 5857 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.808598:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53ae800) 00010000:00010000:0.0:1787857728.808603:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.808613:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.808621:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.808649:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857728.808709:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:2349:x1874704171612288:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 186us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857728.808725:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 275 00010000:00010000:3.0:1787857728.808785:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.808792:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.808849:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.808860:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.808870:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857728.811573:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00010000:00010000:3.0:1787857728.811593:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.811604:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.811612:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.811617:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857728.811621:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.811628:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.811645:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c53ae800) 00010000:00010000:3.0:1787857728.811649:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857728.811654:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.811659:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bbcb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857728.811680:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5e6d9ce reply state 0000000028bb406a transno 4294967889 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857728.811688:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857728.811783:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+87:25265:x1874704171612160:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 13230us (13464us total) trans 4294967889 rc 0/0 00000100:00100000:3.0:1787857728.811806:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 885 00010000:00010000:3.0:1787857728.819416:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.819436:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.819446:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.819453:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857728.819469:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.819477:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.819495:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff9998d1291500) 00010000:00010000:3.0:1787857728.819498:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857728.819504:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.819511:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bbd2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857728.825419:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857728.825546:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171612416 00000100:00100000:2.0:1787857728.825557:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171612416 00000100:00100000:2.0:1787857728.825629:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 886 00000100:00100000:2.0:1787857728.825639:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+86:25266:x1874704171612416:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857728.825669:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857728.825693:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bbd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd372f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.825771:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bbe0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.825785:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.825797:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857728.825904:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857728.825909:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857728.825933:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.825978:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bbd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd372f expref: 88 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.825998:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd372f expref: 87 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.826006:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:2.0:1787857728.826009:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857728.826013:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75e00, rc 0) 00000100:00100000:2.0:1787857728.826064:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+87:25266:x1874704171612416:12345-192.168.204.36@tcp:101:bash.0 Request processed in 427us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857728.826071:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 886 00000100:00100000:2.0:1787857728.838149:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857728.841610:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171612544 00000100:00100000:0.0:1787857728.841626:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171612544 00000100:00100000:0.0:1787857728.841708:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 887 00000100:00100000:0.0:1787857728.841718:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+87:25266:x1874704171612544:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857728.841738:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857728.841759:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bbe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3736 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.841891:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.841907:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.841919:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.841935:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.841943:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.841950:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842123:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bbfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842148:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bbfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842156:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bbfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857728.842192:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:0.0:1787857728.842196:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857728.842217:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bbfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842229:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842236:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842243:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842249:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.842253:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842261:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842272:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:0.0:1787857728.842275:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.842280:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842295:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bbee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842308:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842314:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842319:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842324:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.842327:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842334:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842340:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857728.842342:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.842345:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842350:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bbf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842379:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bbe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3736 expref: 89 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842390:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4800/0xd3f183cab4a7bbfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3736 expref: 88 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.842404:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857728.842406:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857728.842409:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4800, rc 0) 00000100:00100000:0.0:1787857728.842485:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+88:25266:x1874704171612544:12345-192.168.204.36@tcp:101:bash.0 Request processed in 768us (4352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857728.842492:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 887 00000100:00100000:1.0:1787857728.846299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857728.846556:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171612672 00000100:00100000:2.0:1787857728.846572:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171612672 00000100:00100000:2.0:1787857728.846662:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 888 00000100:00100000:2.0:1787857728.846674:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+88:25266:x1874704171612672:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857728.846701:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857728.846731:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bc03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd373d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.846867:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.846897:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.846937:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850276:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850301:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850315:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850415:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850422:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850429:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850435:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857728.850440:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850447:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850473:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:2.0:1787857728.850476:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857728.850481:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850503:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7bc0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850517:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850522:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850527:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850531:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857728.850533:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850539:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850546:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff9998e18d9500) 00010000:00010000:2.0:1787857728.850548:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857728.850551:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.850556:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.851106:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bc03 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd373d expref: 89 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.851132:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:2.0:1787857728.851135:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857728.851139:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bc03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd373d expref: 89 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.851149:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857728.851227:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+88:25266:x1874704171612672:12345-192.168.204.36@tcp:101:bash.0 Request processed in 4554us (4937us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857728.851237:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 888 00000100:00100000:1.0:1787857728.875728:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857728.876337:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171612800 00000100:00100000:0.0:1787857728.876347:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171612800 00000100:00100000:2.0:1787857728.876562:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 889 00000100:00100000:2.0:1787857728.876573:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+34:25267:x1874704171612800:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857728.876594:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857728.876612:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bc18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3744 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.876671:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.876684:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.876696:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857728.876765:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857728.876769:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857728.876793:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.876855:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bc18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.876885:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 35 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.876895:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:2.0:1787857728.876897:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857728.876901:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74600, rc 0) 00000100:00100000:2.0:1787857728.876965:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:25267:x1874704171612800:12345-192.168.204.36@tcp:101:rm.0 Request processed in 394us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857728.876972:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 889 00000100:00100000:0.0:1787857728.878054:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188224000:0@lo:400:kworker.0 00000100:00100000:0.0:1787857728.878124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857728.878287:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188223744:0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.878323:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857728.878354:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188223744 00000100:00100000:1.0:1787857728.878360:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188223744 00000100:00100000:1.0:1787857728.878408:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1787857728.878423:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188223744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.878481:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188223744:12345-0@lo:400:kworker.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857728.878489:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1787857728.878561:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188223872:0@lo:400:kworker.0 00000100:00100000:3.0:1787857728.878592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857728.878656:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188224000 00000100:00100000:1.0:1787857728.878660:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188224000 00000100:00100000:1.0:1787857728.878700:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188223872 00000100:00100000:1.0:1787857728.878703:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188223872 00000100:00100000:1.0:1787857728.878718:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787857728.878724:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188224000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.878753:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188224000:12345-0@lo:400:kworker.0 Request processed in 29us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857728.878759:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787857728.878771:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787857728.878776:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188223872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.878804:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188223872:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857728.878810:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:3.0:1787857728.878915:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787857728.879655:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857728.879661:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857728.880189:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787857728.880197:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857728.880513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857728.880541:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171612928 00000100:00100000:3.0:1787857728.880558:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171612928 00000100:00100000:3.0:1787857728.880603:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 890 00000100:00100000:3.0:1787857728.880612:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+35:25267:x1874704171612928:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857728.880628:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857728.880647:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd374b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880713:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880729:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880743:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880759:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880767:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880773:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880906:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7bc3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880915:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7bc3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.880922:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7bc3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857728.880963:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:3.0:1787857728.880967:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857728.880992:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7bc3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881004:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881010:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881017:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881023:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857728.881027:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881035:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881047:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:3.0:1787857728.881050:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857728.881056:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881062:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bc2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881074:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881090:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881096:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881101:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857728.881105:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881111:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881120:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff9998d1291500) 00010000:00010000:3.0:1787857728.881123:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857728.881126:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881131:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881161:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd374b expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881173:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53800/0xd3f183cab4a7bc3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd374b expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.881181:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:3.0:1787857728.881184:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787857728.881192:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53800, rc 0) 00000100:00100000:3.0:1787857728.881247:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25267:x1874704171612928:12345-192.168.204.36@tcp:101:rm.0 Request processed in 636us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857728.881254:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 890 00000100:00100000:0.0:1787857728.881537:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188224000:0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.882359:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188223744:0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.882371:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188224256:0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.882425:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857728.882521:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857728.882529:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188224128:0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.882570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857728.882660:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188224256 00000100:00100000:2.0:1787857728.882665:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188224256 00000100:00100000:2.0:1787857728.882714:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787857728.882722:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188224256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857728.882766:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188224256:12345-0@lo:400:kworker.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857728.882772:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787857728.882798:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188224256:0@lo:400:kworker.0 00000100:00080000:1.0:1787857728.882919:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857728.882974:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188224128 00000100:00100000:3.0:1787857728.882979:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188224128 00000100:00100000:3.0:1787857728.883018:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787857728.883025:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188224128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857728.883070:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188224128:12345-0@lo:400:kworker.0 Request processed in 45us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857728.883076:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787857728.883107:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188223872:0@lo:400:kworker.0 00000100:00100000:3.0:1787857728.883115:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188224384:0@lo:400:kworker.0 00000100:00100000:3.0:1787857728.883140:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857728.883208:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188224384 00000100:00100000:1.0:1787857728.883212:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188224384 00000100:00100000:1.0:1787857728.883247:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787857728.883254:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188224384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857728.883291:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188224384:12345-0@lo:400:kworker.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857728.883297:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787857728.883324:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188224384:0@lo:400:kworker.0 00000100:00100000:2.0:1787857728.883390:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188224128:0@lo:400:kworker.0 00000100:00080000:3.0:1787857728.883433:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857728.895891:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857728.897616:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171613056 00000100:00100000:0.0:1787857728.897633:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171613056 00000100:00100000:0.0:1787857728.897721:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 891 00000100:00100000:0.0:1787857728.897732:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25267:x1874704171613056:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857728.897754:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857728.897775:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3752 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.897911:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.897927:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.897939:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.897973:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.897981:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.897988:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898064:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898072:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898079:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898086:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.898091:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898099:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898111:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857728.898114:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.898120:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898127:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898150:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898155:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898160:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898165:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.898168:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898174:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898181:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857728.898183:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.898187:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898192:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898225:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc42 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3752 expref: 37 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898234:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857728.898237:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.898247:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3752 expref: 37 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.898256:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857728.898329:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25267:x1874704171613056:12345-192.168.204.36@tcp:101:rm.0 Request processed in 599us (2451us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857728.898337:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 891 00000100:00100000:3.0:1787857728.906255:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857728.906577:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171613184 00000100:00100000:0.0:1787857728.906587:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171613184 00000100:00100000:0.0:1787857728.906647:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 892 00000100:00100000:0.0:1787857728.906656:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25267:x1874704171613184:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857728.906677:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857728.906697:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3759 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.906764:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.906779:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.906790:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.906805:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.906813:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908075:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908181:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908188:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908195:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908200:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.908204:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908211:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908224:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857728.908226:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.908230:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908237:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908250:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908254:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908260:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908270:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.908273:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908278:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908284:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857728.908285:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.908288:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908292:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908331:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc57 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3759 expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908340:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857728.908342:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.908346:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3759 expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.908354:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857728.908425:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25267:x1874704171613184:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1770us (2180us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857728.908434:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 892 00000100:00100000:1.0:1787857728.948804:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857728.948953:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171613312 00000100:00100000:0.0:1787857728.948987:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171613312 00000100:00100000:0.0:1787857728.949048:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 893 00000100:00100000:0.0:1787857728.949057:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25268:x1874704171613312:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857728.949078:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857728.949100:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3760 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949182:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949198:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949209:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949224:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949231:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949236:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949314:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949321:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949328:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949340:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.949344:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949353:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949366:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857728.949369:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.949373:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949379:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bc73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949393:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949398:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949404:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949410:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.949412:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949418:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949437:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857728.949440:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.949443:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949448:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949493:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc6c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3760 expref: 37 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949504:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857728.949506:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.949510:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3760 expref: 37 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.949519:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857728.949589:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25268:x1874704171613312:12345-192.168.204.36@tcp:101:cp.0 Request processed in 533us (795us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857728.949598:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 893 00000100:00100000:1.0:1787857728.954643:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857728.954730:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171613440 00000100:00100000:3.0:1787857728.954739:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171613440 00000100:00100000:3.0:1787857728.955322:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 894 00000100:00100000:3.0:1787857728.955335:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25268:x1874704171613440:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857728.955359:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857728.955381:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bc81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3767 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955477:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955491:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955520:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955537:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955543:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955549:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955622:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955629:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955635:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955641:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857728.955645:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955651:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955662:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:3.0:1787857728.955664:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857728.955669:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955682:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bc88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955694:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955699:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955704:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955709:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857728.955712:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955717:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955725:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff9998d1291500) 00010000:00010000:3.0:1787857728.955727:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857728.955729:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955734:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bc8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955787:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bc81 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3767 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955809:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:3.0:1787857728.955811:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857728.955853:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bc81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3767 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.955866:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:3.0:1787857728.955945:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25268:x1874704171613440:12345-192.168.204.36@tcp:101:cp.0 Request processed in 613us (1312us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857728.955954:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 894 00000100:00100000:1.0:1787857728.959171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857728.959373:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171613696 00000100:00100000:0.0:1787857728.959383:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171613696 00000100:00100000:0.0:1787857728.959550:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 895 00000100:00100000:0.0:1787857728.959561:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25268:x1874704171613696:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857728.959583:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857728.959603:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd376e expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.959758:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.959774:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.959785:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.959800:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.959807:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.959814:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857728.960583:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:0.0:1787857728.960761:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bcab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960773:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bcab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960781:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bcab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960851:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960871:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960878:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960884:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857728.960888:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960897:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960909:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857728.960913:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857728.960917:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960924:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bc9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857728.960939:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a4779ae reply state 00000000fedf52f3 transno 4294967890 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857728.960949:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857728.960981:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bc96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd376e expref: 39 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.960996:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4000/0xd3f183cab4a7bcab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd376e expref: 38 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.961014:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:0.0:1787857728.961017:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857728.961019:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4000, rc 0) 00000100:00100000:0.0:1787857728.961086:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25268:x1874704171613696:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1527us (1923us total) trans 4294967890 rc 0/0 00000100:00100000:0.0:1787857728.961095:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 895 00010000:00010000:3.0:1787857728.967115:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.967135:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.967144:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.967150:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857728.967155:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.967164:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.967183:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff9998d8aeae00) 00010000:00010000:3.0:1787857728.967186:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857728.967191:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.967209:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bca4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857728.976743:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857728.977064:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171613824 00000100:00100000:2.0:1787857728.977075:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171613824 00000100:00100000:2.0:1787857728.977159:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00100000:2.0:1787857728.977170:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171613824:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857728.977203:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857728.977225:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3775 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857728.977253:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857728.977276:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=553s v=(0 0) 00010000:00010000:2.0:1787857728.977281:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857728.977300:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.977323:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857728.977337:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74e00, rc 0) 00000100:00100000:2.0:1787857728.977408:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171613824:12345-192.168.204.36@tcp:101:cp.0 Request processed in 240us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857728.977415:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00080000:3.0:1787857728.977696:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857728.985812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857728.986050:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171613952 00000100:00100000:1.0:1787857728.986061:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171613952 00000100:00100000:1.0:1787857728.986225:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 221 00000100:00100000:1.0:1787857728.986237:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:25268:x1874704171613952:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857728.986256:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857728.986276:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd377c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.986310:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.986339:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857728.986343:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857728.986349:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.986590:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857728.986606:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 11 pid: 6713 timeout: 653 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857728.986620:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188224512:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857728.986777:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857728.991782:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188224512:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857728.991904:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857728.991926:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052e00, rc 0) 00000100:00100000:3.0:1787857728.992056:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:25268:x1874704171613952:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5821us (6255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857728.992065:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 221 00000100:00100000:3.0:1787857728.993672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857728.993772:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171614080 00000100:00100000:0.0:1787857728.993781:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171614080 00010000:00010000:0.0:1787857728.993887:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 11 pid: 6713 timeout: 653 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857728.993962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 276 00000100:00100000:0.0:1787857728.993973:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171614080:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857728.993992:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857728.994026:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 11 pid: 6713 timeout: 653 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.994039:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 11 pid: 6713 timeout: 653 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.994063:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7bcb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3775 expref: 11 pid: 6713 timeout: 653 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.994082:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857728.994110:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857728.994120:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.994131:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857728.994181:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857728.994196:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188224640:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857728.994278:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857729.002129:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857729.003316:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171614336 00000100:00100000:3.0:1787857729.003330:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171614336 00000100:00100000:3.0:1787857729.003405:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 184 00000100:00100000:3.0:1787857729.003415:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6120450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25268:x1874704171614336:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:3.0:1787857729.003809:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6120450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25268:x1874704171614336:12345-192.168.204.36@tcp:35:cp.0 Request processed in 395us (1691us total) trans 4294967891 rc 0/0 00000100:00100000:3.0:1787857729.003852:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 184 00000100:00100000:0.0:1787857729.004152:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188224640:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857729.004173:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857729.004196:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171614080:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 10225us (10531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857729.004205:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 276 00000100:00100000:1.0:1787857729.095199:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857729.095664:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171614464 00000100:00100000:0.0:1787857729.095675:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171614464 00000100:00100000:0.0:1787857729.095738:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 896 00000100:00100000:0.0:1787857729.095749:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+88:25271:x1874704171614464:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857729.095768:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857729.095789:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bcc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3783 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.095869:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.095897:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.095909:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.095926:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.095933:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.095939:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096047:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bcdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096055:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096062:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857729.096097:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00000004:00200000:0.0:1787857729.096102:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857729.096121:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096132:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bcdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096151:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096170:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096177:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096183:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857729.096187:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096195:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096208:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857729.096211:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857729.096216:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096221:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bcce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096235:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096241:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096247:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096258:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857729.096262:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096268:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096276:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff9998d8aeae00) 00010000:00010000:0.0:1787857729.096278:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857729.096281:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096286:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bcd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096318:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bcc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3783 expref: 90 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096332:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bcdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3783 expref: 89 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.096339:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:0.0:1787857729.096342:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857729.096344:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4200, rc 0) 00000100:00100000:0.0:1787857729.096413:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:25271:x1874704171614464:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 665us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857729.096421:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 896 00000100:00100000:2.0:1787857729.104586:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857729.104865:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171614592 00000100:00100000:0.0:1787857729.104896:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171614592 00000100:00100000:0.0:1787857729.104986:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 222 00000100:00100000:0.0:1787857729.104997:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171614592:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857729.105021:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857729.105043:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000289aeaef/0xd3f183cab4a7bce3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd378a expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857729.105116:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188224768:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857729.105292:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787857729.105875:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787857729.110345:0:14028:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787857729.110358:0:14028:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb mtime: 0 -> 1787857728 00002000:00010000:0.0:1787857729.110361:0:14028:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb atime: 0 -> 1787857728 00002000:00010000:0.0:1787857729.110364:0:14028:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb ctime: 0 -> 1787857728 00000100:00100000:0.0:1787857729.110406:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188224768:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857729.110798:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000289aeaef/0xd3f183cab4a7bce3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd378a expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.110873:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000289aeaef/0xd3f183cab4a7bce3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd378a expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.110890:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857729.111025:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171614592:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 6028us (6451us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857729.111035:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 222 00000100:00100000:1.0:1787857729.115275:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857729.115496:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171614720 00000100:00100000:3.0:1787857729.115510:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171614720 00000100:00100000:3.0:1787857729.115594:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 897 00000100:00100000:3.0:1787857729.115609:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:25271:x1874704171614720:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857729.115664:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857729.115693:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bcea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3791 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857729.115787:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bcf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857729.115805:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857729.115860:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857729.115938:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:3.0:1787857729.115943:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857729.115973:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857729.116005:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bcea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3791 expref: 91 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857729.116028:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53c00/0xd3f183cab4a7bcf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3791 expref: 90 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857729.116038:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:3.0:1787857729.116042:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857729.116046:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53c00, rc 0) 00000100:00100000:3.0:1787857729.116141:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+90:25271:x1874704171614720:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 536us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857729.116149:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 897 00000100:00100000:2.0:1787857729.123896:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857729.124017:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171614848 00000100:00100000:0.0:1787857729.124031:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171614848 00000100:00100000:0.0:1787857729.124142:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 223 00000100:00100000:0.0:1787857729.124155:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171614848:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857729.124184:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857729.124214:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000289aeaef/0xd3f183cab4a7bcf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3798 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857729.124310:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188224896:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857729.124441:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857729.126952:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188224896:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857729.127003:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000289aeaef/0xd3f183cab4a7bcf8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3798 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.127036:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000289aeaef/0xd3f183cab4a7bcf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3798 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857729.127051:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857729.127129:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171614848:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2977us (3252us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857729.127140:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 223 00000100:00100000:1.0:1787857729.134984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857729.135295:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171615104 00000100:00100000:2.0:1787857729.135310:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171615104 00000100:00100000:2.0:1787857729.135406:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:2.0:1787857729.135419:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+90:25271:x1874704171615104:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:2.0:1787857729.135445:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857729.135508:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bcdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3783 expref: 90 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857729.135534:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:2.0:1787857729.135541:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857729.135619:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+89:25271:x1874704171615104:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 204us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857729.135627:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:2.0:1787857729.139695:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857729.139976:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171615232 00000100:00100000:0.0:1787857729.139992:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171615232 00000100:00100000:0.0:1787857729.140065:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 898 00000100:00100000:0.0:1787857729.140075:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:25271:x1874704171615232:12345-192.168.204.36@tcp:58:lfs.0 00000100:00100000:0.0:1787857729.140514:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:25271:x1874704171615232:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 437us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857729.140543:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 898 00010000:00010000:2.0:1787857729.263977:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857729.390251:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188225024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857729.390343:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857729.390420:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188225024 00000100:00100000:0.0:1787857729.390428:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188225024 00000100:00100000:0.0:1787857729.390511:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787857729.390521:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188225024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857729.390559:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 69664768 pending 0 free 3852468224 avail 3850371072 00000100:00100000:0.0:1787857729.391891:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188225024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1365us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857729.391902:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787857729.391968:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188225024:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787857729.446780:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967349 is committed 00000040:00080000:1.0:1787857729.902051:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857729.902063:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857729.902731:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787857729.902743:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787857730.093774:0:18630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857730.093784:0:18630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857730.094396:0:18630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 3 00000040:00080000:2.0:1787857730.094403:0:18630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857730.168016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857730.168978:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171615360 00000100:00100000:0.0:1787857730.168988:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171615360 00000100:00100000:0.0:1787857730.169067:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 899 00000100:00100000:0.0:1787857730.169077:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:25282:x1874704171615360:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857730.169097:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857730.169119:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7bcff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd379f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169189:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169207:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169221:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169242:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169249:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169255:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169356:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bd14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169363:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169370:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857730.169402:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00000004:00200000:0.0:1787857730.169406:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857730.169426:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169448:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169456:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169462:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169480:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169485:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857730.169489:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169497:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169509:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9998d8aeaa00) 00010000:00010000:0.0:1787857730.169513:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857730.169517:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169523:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bd06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169535:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169541:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169546:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169551:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857730.169553:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169567:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169575:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff9998d8aea200) 00010000:00010000:0.0:1787857730.169577:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857730.169579:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169585:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bd0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169614:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5800/0xd3f183cab4a7bcff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd379f expref: 91 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169627:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bd14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd379f expref: 90 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.169633:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:0.0:1787857730.169635:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857730.169638:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857730.169697:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+90:25282:x1874704171615360:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 622us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857730.169705:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 899 00000100:00080000:2.0:1787857730.169769:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857730.182224:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857730.185158:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171615488 00000100:00100000:3.0:1787857730.185174:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171615488 00000100:00100000:3.0:1787857730.185243:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 224 00000100:00100000:3.0:1787857730.185255:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171615488:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857730.185275:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857730.185295:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7bd1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37a6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857730.185375:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188225152:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857730.185480:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857730.203281:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188225152:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857730.203337:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7bd1b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37a6 expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.203395:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7bd1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37a6 expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.203411:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:0.0:1787857730.203508:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171615488:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 18254us (21295us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857730.203518:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 224 00000100:00100000:2.0:1787857730.221108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857730.221393:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171615616 00000100:00100000:0.0:1787857730.221403:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171615616 00000100:00100000:0.0:1787857730.221596:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 225 00000100:00100000:0.0:1787857730.221608:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171615616:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857730.221627:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857730.221647:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37ad expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857730.221709:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa03c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188225280:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857730.221967:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857730.233389:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa03c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188225280:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857730.233440:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd22 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ad expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857730.233487:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ad expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857730.233499:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5800, rc 0) 00000100:00100000:1.0:1787857730.235175:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+11:2349:x1874704171615616:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 13558us (14067us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857730.235188:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 225 00000100:00100000:2.0:1787857730.256146:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857730.256180:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171615872 00000100:00100000:2.0:1787857730.256189:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171615872 00000100:00100000:2.0:1787857730.256245:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 900 00000100:00100000:2.0:1787857730.256253:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+90:25282:x1874704171615872:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:2.0:1787857730.256565:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 136 off11184 00000100:00100000:2.0:1787857730.256657:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+90:25282:x1874704171615872:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 403us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857730.256664:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 900 00010000:00010000:1.0:1787857730.287609:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857730.641768:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857730.641982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857730.642116:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171616000 00000100:00100000:1.0:1787857730.642125:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171616000 00000100:00100000:1.0:1787857730.642175:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 546 00000100:00100000:1.0:1787857730.642185:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171616000:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857730.642257:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171616000:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 74us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857730.642265:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 546 00000100:00100000:3.0:1787857730.646793:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857730.646856:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857730.646884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857730.646919:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171616256 00000100:00100000:3.0:1787857730.646930:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171616256 00000100:00100000:3.0:1787857730.646996:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 359 00000100:00100000:3.0:1787857730.647006:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2347:x1874704171616256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857730.647084:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2347:x1874704171616256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857730.647092:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 359 00000100:00080000:3.0:1787857730.647203:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857730.647441:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171616128 00000100:00100000:1.0:1787857730.647446:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171616128 00000100:00100000:1.0:1787857730.647481:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171616384 00000100:00100000:1.0:1787857730.647484:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171616384 00000100:00100000:1.0:1787857730.647503:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171616512 00000100:00100000:1.0:1787857730.647506:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171616512 00000100:00100000:1.0:1787857730.647527:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 341 00000100:00100000:1.0:1787857730.647534:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171616128:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857730.647573:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171616128:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (5591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857730.647597:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 341 00000100:00100000:1.0:1787857730.647612:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:1.0:1787857730.647618:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171616384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857730.647645:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171616384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857730.647651:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:1.0:1787857730.647662:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00100000:1.0:1787857730.647669:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171616512:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857730.647694:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171616512:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857730.647699:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00080000:3.0:1787857730.655211:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857730.655223:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787857730.926990:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857730.926999:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857730.927036:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 4 00000040:00080000:1.0:1787857730.927043:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857730.927486:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188225408:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857730.927585:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b84840 going to sleep for 11 seconds 00000100:00100000:1.0:1787857730.934445:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188225408:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857730.961554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857730.961607:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171616640 00000100:00100000:0.0:1787857730.961618:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171616640 00000100:00100000:0.0:1787857730.961682:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 901 00000100:00100000:0.0:1787857730.961693:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171616640:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857730.961728:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857730.962078:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171616640:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 386us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857730.962099:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 901 00000100:00100000:3.0:1787857730.973206:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857730.973261:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171616896 00000100:00100000:3.0:1787857730.973270:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171616896 00000100:00100000:3.0:1787857730.973322:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 902 00000100:00100000:3.0:1787857730.973331:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171616896:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857730.973351:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857730.973371:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37b4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857730.973486:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857730.973502:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857730.973516:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857730.973527:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00010000:00010000:3.0:1787857730.973695:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37b4 expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857730.973714:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37b4 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857730.973721:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:3.0:1787857730.973725:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857730.973729:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:3.0:1787857730.973791:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:25292:x1874704171616896:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 461us (598us total) trans 4294967892 rc 0/0 00000100:00100000:3.0:1787857730.973808:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 902 00000100:00100000:0.0:1787857730.993911:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857730.993954:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171617024 00000100:00100000:0.0:1787857730.993963:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171617024 00000100:00100000:0.0:1787857730.994026:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:0.0:1787857730.994036:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:2350:x1874704171617024:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857730.994052:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857730.994077:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37b4 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857730.994114:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:0.0:1787857730.994127:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857730.994187:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2350:x1874704171617024:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 142us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857730.994195:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:3.0:1787857730.997221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857731.001192:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171617152 00000100:00100000:1.0:1787857731.001205:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171617152 00000100:00100000:1.0:1787857731.001260:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 226 00000100:00100000:1.0:1787857731.001272:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171617152:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857731.001316:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.001344:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.001358:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x14:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787857731.001363:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857731.001368:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.001405:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.001437:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 10 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857731.001453:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188225536:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857731.001543:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3ccc0 going to sleep for 11 seconds 00000001:00080000:0.0:1787857731.007943:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967890 is committed 00000004:00080000:0.0:1787857731.007965:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:0.0:1787857731.007990:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967888 is committed 00000004:00080000:0.0:1787857731.008035:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1787857731.008043:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 14 batchid updated 00000001:00080000:0.0:1787857731.008055:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967891 is committed 00000001:00080000:0.0:1787857731.008060:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967889 is committed 00000020:00080000:0.0:1787857731.008069:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000020:00080000:0.0:1787857731.008081:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000100:00100000:2.0:1787857731.008241:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188225664:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787857731.008332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857731.008365:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188225664 00000100:00100000:1.0:1787857731.008372:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188225664 00000100:00100000:1.0:1787857731.010974:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787857731.010997:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188225664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787857731.011032:0:14028:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:17 count 1 00010000:00010000:1.0:1787857731.011102:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.011136:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.011159:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=11s v=(0 0) 00010000:00010000:1.0:1787857731.011164:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857731.011170:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.011228:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.011242:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 11 pid: 6711 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857731.011258:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188225792:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857731.011356:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3cf00 going to sleep for 11 seconds 00000100:00080000:1.0:1787857731.011375:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857731.019200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857731.027682:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188225536:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857731.027716:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857731.031184:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857731.031275:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188225792:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857731.031305:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857731.031661:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171617408 00000100:00100000:2.0:1787857731.031669:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171617408 00010000:00010000:2.0:1787857731.031711:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 12 pid: 6711 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857731.031755:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 277 00000100:00100000:2.0:1787857731.031766:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171617408:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857731.031783:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857731.031789:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 12 pid: 6711 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.031804:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 12 pid: 6711 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.031849:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d124feae/0xd3f183cab4a7bb0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd36f7 expref: 12 pid: 6711 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.031866:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857731.031871:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857731.031877:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.031888:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.031940:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857731.032004:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171617408:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 238us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857731.032012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 277 00010000:00010000:2.0:1787857731.032073:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.032083:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.032093:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.032101:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.032119:0:14028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857731.032615:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171617280 00000100:00100000:1.0:1787857731.032628:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171617280 00002000:00100000:1.0:1787857731.032664:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x14:0x0] (0->157) req@ffff9998f9d1d680 x1874704171617280/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:377/0 lens 648/0 e 0 to 0 dl 1787857742 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857731.032675:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d1d680 with x1874704171617280 ext(0->157) 00010000:00010000:1.0:1787857731.032683:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 11 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.032697:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 11 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857731.032704:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998f9d1d680 00000100:00100000:1.0:1787857731.032730:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:1.0:1787857731.032738:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171617280:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857731.033856:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171617280:12345-192.168.204.36@tcp:4:cp.0 Request processed in 1113us (14660us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787857731.033867:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00002000:00100000:1.0:1787857731.033877:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x14:0x0] (0->157) req@ffff9998f9d1d680 x1874704171617280/t4294967350(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:377/0 lens 648/448 e 0 to 0 dl 1787857742 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857731.033887:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d1d680 with x1874704171617280 ext(0->157) 00010000:00010000:1.0:1787857731.033896:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 13 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.033910:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 13 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857731.033929:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998f9d1d680 00000100:00100000:2.0:1787857731.036174:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188225664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25180us (27835us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787857731.036188:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00010000:2.0:1787857731.036227:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857731.036236:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.036249:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857731.036262:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.036274:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.036294:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.036303:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bd45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.036325:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857731.036327:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857731.036329:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857731.036383:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999900d4f480/2, rc 0, transno 4294967341 00000100:00100000:2.0:1787857731.036392:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188225664:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787857731.047255:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857731.047322:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171617536 00000100:00100000:1.0:1787857731.047332:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171617536 00010000:00010000:1.0:1787857731.047373:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 13 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857731.047413:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 278 00000100:00100000:1.0:1787857731.047434:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171617536:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857731.047450:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857731.047472:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 13 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.047489:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 13 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.047531:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bcc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd377c expref: 13 pid: 6714 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.047547:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857731.047552:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857731.047558:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.047569:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.047633:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857731.047677:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.047689:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857731.047699:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171617536:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 264us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857731.047708:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 278 00010000:00010000:3.0:1787857731.047728:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.047739:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.047747:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.047754:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857731.047758:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.047767:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.047779:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.047794:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8f2009e/0xd3f183cab4a7bd3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857731.047867:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171617152:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 46596us (50656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857731.047875:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 226 00000100:00100000:3.0:1787857731.051255:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857731.051391:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171617792 00000100:00100000:0.0:1787857731.051402:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171617792 00000100:00100000:0.0:1787857731.051471:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 903 00000100:00100000:0.0:1787857731.051489:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25292:x1874704171617792:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857731.051609:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25292:x1874704171617792:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 122us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857731.051617:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 903 00000100:00100000:0.0:1787857731.057306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857731.057380:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171617920 00000100:00100000:1.0:1787857731.057389:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171617920 00000100:00100000:1.0:1787857731.057455:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 228 00000100:00100000:1.0:1787857731.057465:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171617920:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857731.057485:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857731.057505:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bd4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37bb expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857731.057616:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 158, mtime: 0x6a908b40, atime: 0x0, ctime: 0x6a908b40, blocks: 0x1 00010000:00010000:1.0:1787857731.057637:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1787857731.057642:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857731.057652:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bd4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37bb expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.057670:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007253014c/0xd3f183cab4a7bd4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37bb expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857731.057684:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052e00, rc 0) 00000100:00100000:1.0:1787857731.057752:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171617920:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 284us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857731.057772:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 228 00000100:00100000:3.0:1787857731.068391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857731.068626:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171618176 00000100:00100000:2.0:1787857731.068638:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171618176 00000100:00100000:2.0:1787857731.068704:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 904 00000100:00100000:2.0:1787857731.068715:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25292:x1874704171618176:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857731.068845:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25292:x1874704171618176:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 131us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857731.068852:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 904 00000100:00100000:0.0:1787857731.079268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857731.079693:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171618304 00000100:00100000:1.0:1787857731.079704:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171618304 00002000:00100000:1.0:1787857731.079760:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x14:0x0] (0->4095) req@ffff9998ffaa3c00 x1874704171618304/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:377/0 lens 488/0 e 0 to 0 dl 1787857742 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857731.079772:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffaa3c00 with x1874704171618304 ext(0->4095) 00002000:00010000:1.0:1787857731.079779:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffaa3c00 00000100:00100000:1.0:1787857731.079836:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:1.0:1787857731.079847:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171618304:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857731.080080:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171618304:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 235us (822us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857731.080089:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 86 00002000:00100000:1.0:1787857731.080097:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x14:0x0] (0->4095) req@ffff9998ffaa3c00 x1874704171618304/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:377/0 lens 488/4536 e 0 to 0 dl 1787857742 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857731.080105:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffaa3c00 with x1874704171618304 ext(0->4095) 00002000:00010000:1.0:1787857731.080109:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffaa3c00 00000100:00100000:1.0:1787857731.089954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857731.090118:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171618432 00000100:00100000:3.0:1787857731.090128:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171618432 00000100:00100000:3.0:1787857731.090196:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 905 00000100:00100000:3.0:1787857731.090207:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25292:x1874704171618432:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857731.090228:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857731.090250:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37c2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.090285:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.090299:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.090310:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.090408:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 40 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.090450:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.090458:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:3.0:1787857731.090461:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857731.090464:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52a00, rc 0) 00000100:00100000:3.0:1787857731.090524:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171618432:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 319us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857731.090531:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 905 00000100:00100000:0.0:1787857731.103979:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857731.104090:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171618560 00000100:00100000:2.0:1787857731.104100:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171618560 00000100:00100000:2.0:1787857731.104178:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 906 00000100:00100000:2.0:1787857731.104198:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171618560:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857731.104232:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857731.104342:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171618560:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 147us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857731.104350:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 906 00000100:00100000:1.0:1787857731.109985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857731.110357:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171618688 00000100:00100000:0.0:1787857731.110367:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171618688 00000100:00100000:0.0:1787857731.110441:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 229 00000100:00100000:0.0:1787857731.110453:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171618688:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857731.110497:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110515:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857731.110520:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857731.110526:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110540:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110574:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110583:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110608:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110615:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857731.110619:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110628:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110644:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.110653:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857731.110730:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171618688:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 279us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857731.110738:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 229 00000100:00100000:2.0:1787857731.114408:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857731.114773:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171618944 00000100:00100000:3.0:1787857731.114784:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171618944 00000100:00100000:3.0:1787857731.114977:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 907 00000100:00100000:3.0:1787857731.114988:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171618944:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857731.115068:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.115086:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.115095:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.117671:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.117697:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 39 pid: 5858 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857731.117732:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188225920:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857731.117851:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295600 going to sleep for 11 seconds 00000100:00100000:0.0:1787857731.130719:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188225920:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857731.130751:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857731.137865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857731.138089:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171619072 00000100:00100000:0.0:1787857731.138099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171619072 00010000:00010000:0.0:1787857731.138153:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 40 pid: 5858 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857731.138195:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00100000:0.0:1787857731.138206:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2350:x1874704171619072:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857731.138221:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857731.138229:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 40 pid: 5858 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.138242:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 40 pid: 5858 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.138265:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7bd5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c2 expref: 40 pid: 5858 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.138280:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:0.0:1787857731.138287:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.138311:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.138320:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.138356:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857731.138427:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2350:x1874704171619072:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 223us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857731.138435:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 279 00010000:00010000:2.0:1787857731.138482:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.138492:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.138722:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.138741:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.138749:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.138756:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857731.138761:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.138769:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.138778:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:2.0:1787857731.138788:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857731.138793:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857731.138800:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7bd68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857731.138977:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171618944:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 23990us (24579us total) trans 4294967893 rc 0/0 00000100:00100000:2.0:1787857731.138986:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 907 00000040:00080000:1.0:1787857731.139520:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857731.139526:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857731.140331:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787857731.140340:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857731.141377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857731.141565:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171619328 00000100:00100000:3.0:1787857731.141574:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171619328 00000100:00100000:3.0:1787857731.141622:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 185 00000100:00100000:3.0:1787857731.141631:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25292:x1874704171619328:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857731.141896:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:25292:x1874704171619328:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 264us (523us total) trans 4294967894 rc 0/0 00000100:00100000:3.0:1787857731.141904:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 185 00010000:00010000:3.0:1787857731.318390:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857731.339782:0:18682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857731.339795:0:18682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857731.340037:0:18682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 4 00000040:00080000:0.0:1787857731.340044:0:18682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857731.458999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857731.459078:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171619456 00000100:00100000:0.0:1787857731.459088:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171619456 00000100:00100000:0.0:1787857731.459168:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 230 00000100:00100000:0.0:1787857731.459192:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171619456:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857731.459211:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857731.459231:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37c9 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.459260:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857731.459265:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857731.459274:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c9 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.459312:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000faa6db85/0xd3f183cab4a7bd6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37c9 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857731.459327:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5800, rc 0) 00000100:00100000:0.0:1787857731.459384:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171619456:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 208us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857731.459392:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 230 00000100:00080000:3.0:1787857731.460161:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857731.469183:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857731.472158:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171619712 00000100:00100000:3.0:1787857731.472171:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171619712 00000100:00100000:3.0:1787857731.472254:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:3.0:1787857731.472265:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+83:25293:x1874704171619712:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:3.0:1787857731.472282:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857731.472308:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bd14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd379f expref: 83 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857731.472325:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9998d8aead00) 00010000:00010000:3.0:1787857731.472330:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857731.472393:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+82:25293:x1874704171619712:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 130us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857731.472400:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:0.0:1787857731.476489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857731.476655:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171619840 00000100:00100000:2.0:1787857731.476666:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171619840 00000100:00100000:2.0:1787857731.476733:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 908 00000100:00100000:2.0:1787857731.476744:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:25293:x1874704171619840:12345-192.168.204.36@tcp:58:lfs.0 00000100:00100000:2.0:1787857731.476905:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:25293:x1874704171619840:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 162us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857731.476913:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 908 00000040:00080000:1.0:1787857732.142075:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857732.142113:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857732.142595:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787857732.142605:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857732.337112:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857732.466899:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857732.466927:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188226048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857732.467002:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857732.467034:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188226048 00000100:00100000:0.0:1787857732.467053:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188226048 00000100:00100000:0.0:1787857732.467118:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787857732.467128:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188226048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857732.467166:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000100:00100000:0.0:1787857732.467223:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188226048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857732.467230:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787857732.467280:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188226048:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787857732.592208:0:18733:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857732.592219:0:18733:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857732.592279:0:18733:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 4 00000040:00080000:3.0:1787857732.592286:0:18733:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787857733.166137:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857733.166156:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857733.167013:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 2 00000040:00080000:1.0:1787857733.167025:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787857733.358022:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857733.654888:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857733.654920:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857733.654941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857733.654967:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857733.654987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857733.655002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857733.655027:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857733.655802:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171620352 00000100:00100000:0.0:1787857733.655812:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171620352 00000100:00100000:0.0:1787857733.655882:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171620608 00000100:00100000:0.0:1787857733.655885:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171620608 00000100:00100000:0.0:1787857733.655897:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171620224 00000100:00100000:0.0:1787857733.655899:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171620224 00000100:00100000:0.0:1787857733.655909:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171620736 00000100:00100000:0.0:1787857733.655911:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171620736 00000100:00100000:0.0:1787857733.655926:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 344 00000100:00100000:0.0:1787857733.655934:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171620352:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857733.656005:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171620352:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 72us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857733.656013:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 344 00000100:00100000:0.0:1787857733.656029:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 345 00000100:00100000:0.0:1787857733.656034:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171620608:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857733.656054:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171620608:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 19us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857733.656059:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 345 00000100:00100000:3.0:1787857733.656169:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171620096 00000100:00100000:3.0:1787857733.656173:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171620096 00000100:00100000:3.0:1787857733.656204:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171620480 00000100:00100000:3.0:1787857733.656206:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171620480 00000100:00100000:3.0:1787857733.656225:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 360 00000100:00100000:3.0:1787857733.656231:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:2348:x1874704171620096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857733.656260:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:2348:x1874704171620096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857733.656267:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 360 00000100:00100000:3.0:1787857733.656279:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 361 00000100:00100000:3.0:1787857733.656285:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2348:x1874704171620480:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857733.656310:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2348:x1874704171620480:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857733.656316:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 361 00000100:00100000:1.0:1787857733.657301:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 346 00000100:00100000:1.0:1787857733.657314:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171620224:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857733.657356:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171620224:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 48us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857733.657375:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 346 00000100:00100000:1.0:1787857733.657454:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00100000:1.0:1787857733.657462:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171620736:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:0.0:1787857733.657771:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857733.657778:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857733.657781:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857733.657878:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171619968 00000100:00100000:2.0:1787857733.657885:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171619968 00000100:00100000:2.0:1787857733.657928:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 547 00000100:00100000:2.0:1787857733.657935:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171619968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857733.657971:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171619968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (3003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857733.657977:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 547 00000100:00100000:0.0:1787857733.658620:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171620736:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1154us (3587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857733.658629:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00100000:3.0:1787857733.998198:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188226432:0@lo:400:kworker.0 00000100:00100000:3.0:1787857733.998270:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857733.998325:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857733.998332:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188226560:0@lo:400:kworker.0 00000100:00100000:3.0:1787857733.998369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857733.998400:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188226432 00000100:00100000:3.0:1787857733.998408:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188226432 00000100:00100000:3.0:1787857733.998472:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787857733.998482:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188226432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857733.998534:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188226432:12345-0@lo:400:kworker.0 Request processed in 54us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857733.998550:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1787857733.998600:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188226432:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.998662:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188226304:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.998691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857733.998715:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188226816:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.998736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857733.998757:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787857733.998762:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188226176:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.998789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857733.998812:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188226688:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.998884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857733.998911:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188226560 00000100:00100000:0.0:1787857733.998915:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188226560 00000100:00100000:0.0:1787857733.998951:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188226816 00000100:00100000:0.0:1787857733.998954:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188226816 00000100:00100000:0.0:1787857733.998973:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787857733.998979:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188226560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999021:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188226560:12345-0@lo:400:kworker.0 Request processed in 43us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857733.999028:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787857733.999041:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787857733.999048:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188226816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999080:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188226816:12345-0@lo:400:kworker.0 Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857733.999085:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:0.0:1787857733.999102:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857733.999105:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857733.999108:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857733.999121:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188226176 00000100:00100000:0.0:1787857733.999124:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188226176 00000100:00100000:0.0:1787857733.999149:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1787857733.999155:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188226176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999184:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188226176:12345-0@lo:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857733.999190:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1787857733.999228:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188226304 00000100:00100000:0.0:1787857733.999231:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188226304 00000100:00100000:0.0:1787857733.999253:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188226688 00000100:00100000:0.0:1787857733.999255:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188226688 00000100:00100000:0.0:1787857733.999275:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787857733.999280:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188226304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999333:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188226304:12345-0@lo:400:kworker.0 Request processed in 52us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857733.999339:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787857733.999350:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787857733.999355:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188226688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999394:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188226688:12345-0@lo:400:kworker.0 Request processed in 39us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857733.999400:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:0.0:1787857733.999426:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857733.999446:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188226176:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999456:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188226688:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999464:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188226304:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999473:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:0.0:1787857733.999478:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9998efa6c3c0, transno 4294967349 00000100:00100000:0.0:1787857733.999491:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188226816:0@lo:400:kworker.0 00000100:00100000:0.0:1787857733.999901:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188226560:0@lo:400:kworker.0 00010000:00010000:3.0:1787857734.397232:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857734.510204:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188226944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857734.510289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857734.510420:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188226944 00000100:00100000:2.0:1787857734.510430:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188226944 00000100:00100000:2.0:1787857734.510490:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787857734.510516:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188226944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857734.510556:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73072640 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857734.510610:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188226944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857734.510619:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787857734.510668:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188226944:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787857734.588533:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00010000:00010000:3.0:1787857735.406448:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857736.198978:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967893 is committed 00000001:00080000:1.0:1787857736.198996:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967894 is committed 00000001:00080000:0.0:1787857736.249247:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00010000:00010000:3.0:1787857736.431170:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857737.453970:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857737.582810:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188227072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857737.583121:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857737.583373:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188227072 00000100:00100000:1.0:1787857737.583383:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188227072 00000100:00100000:1.0:1787857737.583469:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787857737.583478:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188227072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857737.583517:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73203712 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857737.583572:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188227072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857737.583580:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1787857737.583639:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857737.585181:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:2.0:1787857737.585193:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999900d4f480, transno 4294967341 00000100:00100000:2.0:1787857737.585233:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188227072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857738.479099:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857738.651985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857738.652101:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171620864 00000100:00100000:0.0:1787857738.652114:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171620864 00000100:00100000:0.0:1787857738.652197:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 909 00000100:00100000:0.0:1787857738.652227:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:25264:x1874704171620864:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787857738.652419:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857738.652760:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:25264:x1874704171620864:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 533us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857738.652779:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 909 00000100:00100000:2.0:1787857738.842797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857738.842876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857738.842908:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857738.842947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857738.842966:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171621248 00000100:00100000:0.0:1787857738.842977:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171621248 00000100:00100000:2.0:1787857738.842983:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857738.843010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857738.843033:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171621120 00000100:00100000:2.0:1787857738.843036:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171621120 00000100:00100000:0.0:1787857738.843049:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171621504 00000100:00100000:0.0:1787857738.843052:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171621504 00000100:00100000:0.0:1787857738.843066:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171621376 00000100:00100000:0.0:1787857738.843068:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171621376 00000100:00100000:2.0:1787857738.843069:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 365 00000100:00100000:2.0:1787857738.843078:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:2348:x1874704171621120:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857738.843079:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171621632 00000100:00100000:0.0:1787857738.843080:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171621632 00000100:00100000:0.0:1787857738.843091:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 350 00000100:00100000:0.0:1787857738.843097:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171621248:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857738.843187:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171620992 00000100:00100000:1.0:1787857738.843192:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171620992 00000100:00100000:1.0:1787857738.843227:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 549 00000100:00100000:1.0:1787857738.843233:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171620992:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857738.843304:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+82:2348:x1874704171621120:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 226us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857738.843330:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 365 00000100:00100000:2.0:1787857738.843361:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 351 00000100:00100000:2.0:1787857738.843368:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171621504:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857738.843440:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 352 00000100:00100000:3.0:1787857738.843450:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171621376:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857738.858382:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2348:x1874704171621248:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 15270us (15490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857738.858411:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 350 00000100:00100000:0.0:1787857738.858454:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 353 00000100:00100000:0.0:1787857738.858472:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171621632:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857738.858530:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171621632:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 67us (15518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857738.858536:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 353 00000100:00080000:0.0:1787857738.858567:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857738.858573:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857738.858576:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857738.861041:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171620992:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 17793us (18241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857738.861056:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 549 00000100:00100000:2.0:1787857738.871123:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171621504:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27735us (28194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857738.871388:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 351 00000100:00100000:3.0:1787857738.873417:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171621376:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29957us (30419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857738.873433:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 352 00000100:00100000:3.0:1787857739.118167:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188227584:0@lo:400:kworker.0 00000100:00100000:3.0:1787857739.118243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857739.118324:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857739.118332:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188227456:0@lo:400:kworker.0 00000100:00100000:3.0:1787857739.118382:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857739.118429:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188227456 00000100:00100000:3.0:1787857739.118437:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188227456 00000100:00100000:3.0:1787857739.118496:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1787857739.118507:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188227456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857739.118561:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188227456:12345-0@lo:400:kworker.0 Request processed in 57us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857739.118584:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00080000:3.0:1787857739.118605:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857739.118633:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188227456:0@lo:400:kworker.0 00000100:00100000:3.0:1787857739.118676:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188227584 00000100:00100000:3.0:1787857739.118680:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188227584 00000100:00100000:3.0:1787857739.118714:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787857739.118720:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188227584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857739.118759:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188227584:12345-0@lo:400:kworker.0 Request processed in 38us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857739.118766:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:3.0:1787857739.118784:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857739.118800:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188227584:0@lo:400:kworker.0 00000100:00100000:1.0:1787857739.118985:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188227200:0@lo:400:kworker.0 00000100:00100000:1.0:1787857739.119022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857739.119061:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188227712:0@lo:400:kworker.0 00000100:00100000:1.0:1787857739.119085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857739.119107:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787857739.119113:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188227328:0@lo:400:kworker.0 00000100:00100000:1.0:1787857739.119134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857739.119147:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188227840:0@lo:400:kworker.0 00000100:00100000:1.0:1787857739.119167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857739.119194:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188227840 00000100:00100000:1.0:1787857739.119198:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188227840 00000100:00100000:0.0:1787857739.119217:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188227712 00000100:00100000:0.0:1787857739.119221:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188227712 00000100:00100000:1.0:1787857739.119231:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787857739.119237:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188227840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857739.119252:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188227328 00000100:00100000:0.0:1787857739.119255:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188227328 00000100:00100000:0.0:1787857739.119294:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787857739.119301:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188227712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857739.119341:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188227712:12345-0@lo:400:kworker.0 Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857739.119348:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787857739.119361:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787857739.119367:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188227328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857739.119397:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188227328:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857739.119398:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188227840:12345-0@lo:400:kworker.0 Request processed in 161us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857739.119404:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787857739.119404:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:1.0:1787857739.119419:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857739.119422:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857739.119483:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188227200 00000100:00100000:3.0:1787857739.119488:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188227200 00000100:00100000:3.0:1787857739.119516:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1787857739.119522:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188227200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857739.119557:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188227200:12345-0@lo:400:kworker.0 Request processed in 35us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857739.119562:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1787857739.126065:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188227328:0@lo:400:kworker.0 00000100:00100000:1.0:1787857739.126088:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188227840:0@lo:400:kworker.0 00000100:00100000:1.0:1787857739.126100:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188227200:0@lo:400:kworker.0 00000100:00100000:1.0:1787857739.126112:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188227712:0@lo:400:kworker.0 00010000:00010000:3.0:1787857739.511543:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857739.630550:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188227968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857739.630640:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857739.630841:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188227968 00000100:00100000:2.0:1787857739.630850:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188227968 00000100:00100000:2.0:1787857739.630911:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787857739.630921:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188227968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857739.630967:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857739.631024:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188227968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857739.631031:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787857739.631172:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188227968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787857740.528986:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857740.952997:0:18934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12e: Check forbidden restore ========== 15:08:58 (1787857738) 00000100:00100000:0.0:1787857741.378373:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857741.378483:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171621760 00000100:00100000:2.0:1787857741.378493:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171621760 00000100:00100000:2.0:1787857741.378574:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 910 00000100:00100000:2.0:1787857741.378585:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:25904:x1874704171621760:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787857741.378701:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:25904:x1874704171621760:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 118us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857741.378708:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 910 00000100:00080000:1.0:1787857741.378893:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857741.406677:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857741.406773:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171621888 00000100:00100000:3.0:1787857741.406784:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171621888 00000100:00100000:3.0:1787857741.406892:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 911 00000100:00100000:3.0:1787857741.406902:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:25905:x1874704171621888:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857741.406933:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857741.406955:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37d0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407057:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787857741.407244:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857741.407344:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407358:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407421:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407429:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407437:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407715:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407723:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407729:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407736:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.407740:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407759:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407772:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:3.0:1787857741.407775:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.407779:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407786:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bd7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407799:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407805:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407811:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407953:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.407956:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407962:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407969:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff9998d1291500) 00010000:00010000:3.0:1787857741.407971:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.407974:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.407988:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bd84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.408036:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37d0 expref: 83 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.408046:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:3.0:1787857741.408048:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.408052:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37d0 expref: 83 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.408061:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53400, rc 0) 00000100:00100000:3.0:1787857741.408182:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+82:25905:x1874704171621888:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1280us (1515us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857741.408190:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 911 00000100:00100000:3.0:1787857741.413473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857741.413649:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171622144 00000100:00100000:2.0:1787857741.413660:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171622144 00000100:00100000:2.0:1787857741.413728:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 912 00000100:00100000:2.0:1787857741.413738:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+82:25905:x1874704171622144:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:2.0:1787857741.413858:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857741.413894:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bbe0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd372f expref: 82 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.413935:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:2.0:1787857741.413942:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857741.414631:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.414651:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.414660:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.414696:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.414713:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 36 pid: 5857 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857741.414730:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa803c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188228096:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857741.414872:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857741.423799:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa803c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188228096:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857741.423866:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857741.425230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857741.426412:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171622272 00000100:00100000:2.0:1787857741.426447:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171622272 00010000:00010000:2.0:1787857741.426504:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 37 pid: 5857 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857741.426597:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 280 00000100:00100000:2.0:1787857741.426608:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:2350:x1874704171622272:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857741.426623:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857741.426631:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 37 pid: 5857 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.426645:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 37 pid: 5857 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.426669:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bc1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3744 expref: 37 pid: 5857 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.426688:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:2.0:1787857741.426693:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.426702:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.426710:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.426756:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857741.426844:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.426855:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.426881:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.426891:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.426901:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857741.426918:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171622272:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 310us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857741.426939:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 280 00000004:00200000:2.0:1787857741.428538:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00010000:00010000:2.0:1787857741.428556:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.428566:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.428574:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.428580:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857741.428586:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.428593:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.428609:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e18d9c00) 00010000:00010000:2.0:1787857741.428612:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857741.428617:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.428623:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7bd8b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857741.428643:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007558064c reply state 00000000444b944d transno 4294967895 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857741.428652:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857741.428757:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+83:25905:x1874704171622144:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 15017us (15292us total) trans 4294967895 rc 0/0 00000100:00100000:2.0:1787857741.428774:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 912 00000100:00100000:1.0:1787857741.443590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857741.444246:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171622400 00000100:00100000:0.0:1787857741.444256:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171622400 00000100:00100000:0.0:1787857741.444332:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 913 00000100:00100000:0.0:1787857741.444344:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+83:25906:x1874704171622400:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857741.444371:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857741.444393:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bd99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37d7 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.444469:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bda0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.444484:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bda0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.444497:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bda0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857741.444585:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857741.444590:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857741.444615:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bda0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.444646:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bd99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37d7 expref: 85 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.444666:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bda0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37d7 expref: 84 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.444675:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:0.0:1787857741.444678:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857741.444682:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4e00, rc 0) 00000100:00100000:0.0:1787857741.444760:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+84:25906:x1874704171622400:12345-192.168.204.36@tcp:101:bash.0 Request processed in 418us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857741.444768:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 913 00010000:00010000:3.0:1787857741.451232:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.451251:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.451259:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.451265:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.451270:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.451276:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.451294:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff9998d1291500) 00010000:00010000:3.0:1787857741.451297:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.451302:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.451308:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7bd92 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857741.453721:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857741.454194:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171622528 00000100:00100000:3.0:1787857741.454204:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171622528 00000100:00100000:3.0:1787857741.454282:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 914 00000100:00100000:3.0:1787857741.454294:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+83:25906:x1874704171622528:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857741.454314:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857741.454349:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bda7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37de expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454418:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454432:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454442:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454455:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454462:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454468:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454585:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7bdbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454594:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7bdbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454601:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7bdbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857741.454636:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:3.0:1787857741.454639:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857741.454660:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7bdbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454680:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454686:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454692:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454698:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.454702:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454708:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454720:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:3.0:1787857741.454723:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.454728:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454734:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7bdae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454747:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454752:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454757:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454769:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.454772:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454777:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454785:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff9998d1291c00) 00010000:00010000:3.0:1787857741.454787:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.454789:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454794:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bdb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454846:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7bda7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37de expref: 85 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454862:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53000/0xd3f183cab4a7bdbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37de expref: 84 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.454870:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:3.0:1787857741.454873:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787857741.454875:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53000, rc 0) 00000100:00100000:3.0:1787857741.455208:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+84:25906:x1874704171622528:12345-192.168.204.36@tcp:101:bash.0 Request processed in 915us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857741.455226:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 914 00000100:00100000:1.0:1787857741.460300:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857741.460381:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171622656 00000100:00100000:0.0:1787857741.460391:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171622656 00000100:00100000:0.0:1787857741.460455:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 915 00000100:00100000:0.0:1787857741.460464:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+84:25906:x1874704171622656:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857741.460488:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857741.460510:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bdc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37e5 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460575:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460608:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460619:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460635:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460642:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460663:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460737:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460744:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460749:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460755:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857741.460759:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460767:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460778:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:0.0:1787857741.460787:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857741.460794:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460800:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460837:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460844:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460850:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460855:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857741.460858:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460864:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460872:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff9998d34a6a00) 00010000:00010000:0.0:1787857741.460874:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857741.460877:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460881:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bdd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460917:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bdc3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37e5 expref: 85 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460935:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:0.0:1787857741.460938:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857741.460942:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bdc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37e5 expref: 85 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.460952:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857741.461023:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+84:25906:x1874704171622656:12345-192.168.204.36@tcp:101:bash.0 Request processed in 560us (732us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857741.461031:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 915 00000100:00100000:1.0:1787857741.485339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857741.485499:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171622784 00000100:00100000:2.0:1787857741.485510:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171622784 00000100:00100000:2.0:1787857741.485624:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 916 00000100:00100000:2.0:1787857741.485637:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:25907:x1874704171622784:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857741.485661:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857741.485684:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bdd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.485754:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.485769:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.485781:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857741.485897:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857741.485901:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857741.485925:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.485948:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7bdd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.485966:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.485994:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:2.0:1787857741.485996:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857741.486000:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75e00, rc 0) 00000100:00100000:2.0:1787857741.486225:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:25907:x1874704171622784:12345-192.168.204.36@tcp:101:rm.0 Request processed in 426us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857741.486235:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 916 00000100:00100000:1.0:1787857741.490506:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857741.490603:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171622912 00000100:00100000:0.0:1787857741.490615:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171622912 00000100:00100000:0.0:1787857741.490715:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 917 00000100:00100000:0.0:1787857741.490726:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+37:25907:x1874704171622912:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857741.492199:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857741.492248:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bde6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37f3 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492341:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492361:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492376:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492393:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492416:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492423:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492550:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bdfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492559:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492566:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857741.492598:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:0.0:1787857741.492603:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857741.492630:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492643:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492650:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492657:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492664:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857741.492669:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492684:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492698:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:0.0:1787857741.492701:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857741.492707:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492713:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492729:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492735:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492741:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492903:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857741.492907:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492914:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492923:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff9998d34a6a00) 00010000:00010000:0.0:1787857741.492926:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857741.492929:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492946:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bdf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492984:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bde6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37f3 expref: 39 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.492998:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5600/0xd3f183cab4a7bdfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37f3 expref: 38 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.493006:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:0.0:1787857741.493008:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857741.493011:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5600, rc 0) 00000100:00100000:0.0:1787857741.493128:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25907:x1874704171622912:12345-192.168.204.36@tcp:101:rm.0 Request processed in 2402us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857741.493137:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 917 00000100:00100000:1.0:1787857741.502487:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857741.502635:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171623040 00000100:00100000:3.0:1787857741.502659:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171623040 00000100:00100000:3.0:1787857741.502720:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 918 00000100:00100000:3.0:1787857741.502731:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25907:x1874704171623040:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857741.502755:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857741.502777:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7be02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd37fa expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.502896:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.502922:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.502934:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.502951:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.502958:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.502964:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503032:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503039:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503045:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503058:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.503062:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503070:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503082:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:3.0:1787857741.503085:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.503089:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503095:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503109:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503115:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503121:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503126:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.503129:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503135:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503153:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff9998d1291c00) 00010000:00010000:3.0:1787857741.503155:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.503158:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503165:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503200:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7be02 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37fa expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503210:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:3.0:1787857741.503225:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.503229:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7be02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37fa expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.503238:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52400, rc 0) 00000100:00100000:3.0:1787857741.503297:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25907:x1874704171623040:12345-192.168.204.36@tcp:101:rm.0 Request processed in 568us (823us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857741.503305:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 918 00000100:00100000:2.0:1787857741.509337:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857741.509428:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171623168 00000100:00100000:1.0:1787857741.509438:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171623168 00000100:00100000:1.0:1787857741.509495:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 919 00000100:00100000:1.0:1787857741.509521:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25907:x1874704171623168:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857741.509542:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857741.509564:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7be17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3801 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509633:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509648:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509659:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509675:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509682:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509688:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509756:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509763:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509771:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509787:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857741.509792:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509800:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509812:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:1.0:1787857741.509853:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857741.509859:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509866:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509880:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509886:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509892:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509897:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857741.509900:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509906:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509937:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff9998c3984500) 00010000:00010000:1.0:1787857741.509940:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857741.509943:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509948:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509979:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7be17 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3801 expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.509989:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:1.0:1787857741.509992:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857741.509995:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7be17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3801 expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.510005:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053200, rc 0) 00000100:00100000:1.0:1787857741.510060:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25907:x1874704171623168:12345-192.168.204.36@tcp:101:rm.0 Request processed in 541us (732us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857741.510067:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 919 00010000:00010000:1.0:1787857741.551158:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857741.554640:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857741.554853:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171623296 00000100:00100000:3.0:1787857741.554865:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171623296 00000100:00100000:3.0:1787857741.554944:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 920 00000100:00100000:3.0:1787857741.554954:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25908:x1874704171623296:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857741.554976:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857741.554997:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7be2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3808 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555082:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555097:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555109:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555125:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555132:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555138:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555205:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555222:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555229:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555235:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.555239:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555257:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555270:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:3.0:1787857741.555273:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.555278:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555284:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555297:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555302:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555308:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555313:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.555315:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555321:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555326:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff9998d1291c00) 00010000:00010000:3.0:1787857741.555329:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.555332:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555346:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555378:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7be2c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3808 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555388:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:3.0:1787857741.555390:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.555394:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7be2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3808 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.555404:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52400, rc 0) 00000100:00100000:3.0:1787857741.555473:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25908:x1874704171623296:12345-192.168.204.36@tcp:101:cp.0 Request processed in 520us (843us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857741.555481:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 920 00000100:00100000:2.0:1787857741.560293:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857741.560491:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171623424 00000100:00100000:1.0:1787857741.560502:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171623424 00000100:00100000:1.0:1787857741.560575:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 921 00000100:00100000:1.0:1787857741.560586:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25908:x1874704171623424:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857741.560607:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857741.560663:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd380f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560736:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560752:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560765:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560783:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560790:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560796:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560922:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560931:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560938:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560945:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857741.560949:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560969:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560983:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:1.0:1787857741.560986:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857741.560992:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.560999:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7be48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561014:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561020:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561027:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561032:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857741.561035:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561041:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561049:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff9998c3984500) 00010000:00010000:1.0:1787857741.561051:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857741.561054:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561071:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7be4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561108:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be41 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd380f expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561119:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:1.0:1787857741.561121:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857741.561125:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7be41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd380f expref: 39 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.561134:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052a00, rc 0) 00000100:00100000:1.0:1787857741.561201:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25908:x1874704171623424:12345-192.168.204.36@tcp:101:cp.0 Request processed in 617us (918us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857741.561210:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 921 00000100:00100000:1.0:1787857741.580127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857741.599318:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171623680 00000100:00100000:3.0:1787857741.599334:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171623680 00000100:00100000:3.0:1787857741.599416:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 922 00000100:00100000:3.0:1787857741.599428:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:25908:x1874704171623680:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857741.599450:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857741.599485:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7be56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3816 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.599640:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.599663:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.599688:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.599704:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.599712:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.599719:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857741.600467:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00010000:00010000:3.0:1787857741.600649:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7be6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600661:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7be6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600671:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7be6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600709:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600717:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600724:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600732:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857741.600743:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600751:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600765:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:3.0:1787857741.600769:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857741.600773:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600780:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7be5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857741.600791:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cbf889a reply state 000000001847328f transno 4294967896 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857741.600801:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857741.600891:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7be56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3816 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600907:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53400/0xd3f183cab4a7be6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3816 expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.600915:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:3.0:1787857741.600917:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857741.600920:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53400, rc 0) 00000100:00100000:3.0:1787857741.600991:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:25908:x1874704171623680:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1565us (20876us total) trans 4294967896 rc 0/0 00000100:00100000:3.0:1787857741.600999:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 922 00000100:00100000:0.0:1787857741.602640:0:6899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6899:1874704188228224:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787857741.602709:0:6899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857741.602770:0:6899:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857741.603089:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188228224 00000100:00100000:3.0:1787857741.603098:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188228224 00000100:00100000:3.0:1787857741.603309:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787857741.603322:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:6899:x1874704188228224:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787857741.603370:0:14028:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1787857741.610572:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.610593:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.610601:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.610607:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857741.610612:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.610620:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.610638:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff9998d1291c00) 00010000:00010000:2.0:1787857741.610641:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857741.610647:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857741.610673:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7be64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787857741.615496:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857741.617454:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857741.620132:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171623808 00000100:00100000:1.0:1787857741.620146:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171623808 00000100:00100000:1.0:1787857741.620253:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00100000:1.0:1787857741.620265:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171623808:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857741.620286:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857741.620320:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd381d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857741.620347:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857741.620369:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1787857741.620388:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857741.620399:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.620419:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.620434:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052a00, rc 0) 00000100:00100000:1.0:1787857741.620503:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171623808:12345-192.168.204.36@tcp:101:cp.0 Request processed in 241us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857741.620513:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00080000:2.0:1787857741.620903:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857741.650901:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857741.658621:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171623936 00000100:00100000:1.0:1787857741.658637:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171623936 00000100:00100000:0.0:1787857741.658764:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:6899:x1874704188228224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 55444us (56052us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1787857741.658765:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:0.0:1787857741.658775:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787857741.658776:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:25908:x1874704171623936:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857741.658793:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857741.658812:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3824 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.658857:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.658867:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857741.658872:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857741.658877:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.658922:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.658936:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 10 pid: 6714 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857741.658949:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188228352:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857741.660703:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857741.661641:0:6899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6899:1874704188228224:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787857741.661786:0:6899:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:1.0:1787857741.673347:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857741.673517:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171624064 00000100:00100000:3.0:1787857741.673534:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171624064 00010000:00010000:3.0:1787857741.673580:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 11 pid: 6714 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857741.673625:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 281 00000100:00100000:3.0:1787857741.673636:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171624064:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857741.673652:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857741.673675:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 11 pid: 6714 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.673690:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 11 pid: 6714 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.673718:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857741.673723:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857741.673732:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.673744:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857741.673863:0:17347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857741.673879:0:17347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17347:1874704188228480:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857741.673952:0:17347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f72953c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787857741.674808:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7be79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd381d expref: 11 pid: 6714 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857741.674869:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188228352:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857741.674905:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.674933:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:0.0:1787857741.674976:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:25908:x1874704171623936:12345-192.168.204.36@tcp:101:cp.0 Request processed in 16202us (24083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857741.674985:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:3.0:1787857741.685296:0:17347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17347:1874704188228480:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857741.685325:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857741.685404:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171624064:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 11770us (12067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857741.685418:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 281 00000100:00100000:2.0:1787857741.695830:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857741.696001:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171624320 00000100:00100000:1.0:1787857741.696012:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171624320 00000100:00100000:1.0:1787857741.696092:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 186 00000100:00100000:1.0:1787857741.696104:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:25908:x1874704171624320:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:1.0:1787857741.697025:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:25908:x1874704171624320:12345-192.168.204.36@tcp:35:cp.0 Request processed in 917us (1214us total) trans 4294967897 rc 0/0 00000100:00100000:1.0:1787857741.697035:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 186 00000100:00100000:0.0:1787857741.767805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857741.767997:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171624448 00000100:00100000:1.0:1787857741.768008:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171624448 00000100:00100000:1.0:1787857741.768094:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 923 00000100:00100000:1.0:1787857741.768105:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+84:25911:x1874704171624448:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857741.768127:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857741.768151:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7be87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd382b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768263:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768278:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768290:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768307:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768315:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768322:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768436:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7be9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768445:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7be9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768452:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7be9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857741.768490:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00000004:00200000:1.0:1787857741.768496:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857741.768517:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7be9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768555:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7be9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768563:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768570:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768577:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768583:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857741.768587:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768594:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768605:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:1.0:1787857741.768608:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857741.768612:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768618:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7be8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768632:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768638:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768650:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768655:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857741.768658:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768665:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768673:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff9998c3984a00) 00010000:00010000:1.0:1787857741.768675:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857741.768678:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768684:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7be95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768716:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7be87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd382b expref: 86 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768729:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7be9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd382b expref: 85 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.768737:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857741.768739:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857741.768741:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052800, rc 0) 00000100:00100000:1.0:1787857741.769262:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+85:25911:x1874704171624448:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1156us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857741.769280:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 923 00000100:00100000:2.0:1787857741.777523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857741.778046:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171624576 00000100:00100000:1.0:1787857741.778196:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171624576 00000100:00100000:1.0:1787857741.778331:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 234 00000100:00100000:1.0:1787857741.778341:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171624576:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857741.778362:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857741.778380:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bea3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3832 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857741.778441:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188228608:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857741.778549:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b840 going to sleep for 11 seconds 00000100:00080000:2.0:1787857741.779741:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787857741.786888:0:6714:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787857741.786899:0:6714:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb mtime: 0 -> 1787857741 00002000:00010000:1.0:1787857741.786902:0:6714:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb atime: 0 -> 1787857741 00002000:00010000:1.0:1787857741.786904:0:6714:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb ctime: 0 -> 1787857741 00000100:00100000:1.0:1787857741.787232:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188228608:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857741.787274:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bea3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3832 expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.787300:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7bea3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3832 expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857741.787314:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857741.787399:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171624576:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 9058us (9888us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857741.787427:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 234 00000100:00100000:3.0:1787857741.798661:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857741.799205:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171624704 00000100:00100000:0.0:1787857741.799226:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171624704 00000100:00100000:0.0:1787857741.799297:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 924 00000100:00100000:0.0:1787857741.799308:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:25911:x1874704171624704:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857741.799328:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857741.799349:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7beaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3839 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.799419:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7beb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.799434:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7beb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.799447:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7beb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857741.799513:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:0.0:1787857741.799517:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857741.799553:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7beb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.799581:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7beaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3839 expref: 87 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.799620:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7beb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3839 expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.799630:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:0.0:1787857741.799633:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857741.799636:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5a00, rc 0) 00000100:00100000:0.0:1787857741.799706:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+86:25911:x1874704171624704:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 399us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857741.799713:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 924 00000100:00100000:2.0:1787857741.811457:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857741.813243:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171624832 00000100:00100000:3.0:1787857741.813264:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171624832 00000100:00100000:3.0:1787857741.813608:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 235 00000100:00100000:3.0:1787857741.813623:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171624832:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857741.813651:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857741.813676:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008982e9ee/0xd3f183cab4a7beb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3840 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857741.813759:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188228736:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857741.814053:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f72953c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857741.822259:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188228736:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857741.822310:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008982e9ee/0xd3f183cab4a7beb8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3840 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.822338:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008982e9ee/0xd3f183cab4a7beb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3840 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857741.822353:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52400, rc 0) 00000100:00100000:0.0:1787857741.822506:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171624832:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 8886us (11207us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857741.822517:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 235 00000100:00100000:1.0:1787857741.846504:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857741.846931:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171625088 00000100:00100000:0.0:1787857741.846944:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171625088 00000100:00100000:0.0:1787857741.847019:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 925 00000100:00100000:0.0:1787857741.847031:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+86:25911:x1874704171625088:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857741.847467:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 136 off11320 00000100:00100000:0.0:1787857741.847555:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+86:25911:x1874704171625088:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 527us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857741.847563:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 925 00000040:00080000:2.0:1787857742.387730:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857742.387751:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857742.388145:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 3 00000040:00080000:3.0:1787857742.388155:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857742.388634:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188228864:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857742.388802:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857742.397256:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188228864:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857742.410923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857742.411273:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171625216 00000100:00100000:0.0:1787857742.411283:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171625216 00000100:00100000:0.0:1787857742.411349:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 926 00000100:00100000:0.0:1787857742.411361:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:25921:x1874704171625216:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857742.411398:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x18:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857742.411525:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:25921:x1874704171625216:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 166us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857742.411533:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 926 00000100:00100000:3.0:1787857742.415767:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857742.416453:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171625472 00000100:00100000:1.0:1787857742.416482:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171625472 00000100:00100000:1.0:1787857742.416589:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 927 00000100:00100000:1.0:1787857742.416604:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:25921:x1874704171625472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857742.416637:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857742.416666:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bebf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3847 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.416852:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bec6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.416873:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.416890:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857742.416906:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00010000:00010000:1.0:1787857742.417089:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7bebf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3847 expref: 44 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.417115:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bec6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3847 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.417125:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857742.417128:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857742.417153:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053a00, rc 0) 00000100:00100000:1.0:1787857742.417255:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:25921:x1874704171625472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 653us (1495us total) trans 4294967898 rc 0/0 00000100:00100000:1.0:1787857742.417266:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 927 00000100:00100000:3.0:1787857742.429335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857742.432313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857742.434598:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171625728 00000100:00100000:2.0:1787857742.434634:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171625728 00000100:00100000:2.0:1787857742.434755:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:2.0:1787857742.434770:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171625728:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857742.434879:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.434909:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.434920:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x12:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787857742.434925:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857742.434948:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857742.437234:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171625600 00000100:00100000:1.0:1787857742.437257:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171625600 00000100:00100000:1.0:1787857742.437345:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:1.0:1787857742.437358:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2350:x1874704171625600:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857742.437379:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857742.437415:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bec6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3847 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.437436:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857742.437443:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857742.437545:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:2350:x1874704171625600:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 189us (5240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857742.437554:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 38 00010000:00010000:2.0:1787857742.439084:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.439105:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 9 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857742.439124:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa82940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188228992:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857742.439241:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857742.451251:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857742.451321:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa82940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188228992:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857742.451349:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171625856 00000100:00100000:3.0:1787857742.451360:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171625856 00010000:00010000:2.0:1787857742.451369:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1787857742.451430:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (0->157) req@ffff9997c26e52c0 x1874704171625856/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:388/0 lens 648/0 e 0 to 0 dl 1787857753 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857742.451442:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c26e52c0 with x1874704171625856 ext(0->157) 00010000:00010000:3.0:1787857742.451453:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 10 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.451471:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 10 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857742.451479:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9997c26e52c0 00000100:00100000:3.0:1787857742.451513:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:3.0:1787857742.451523:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171625856:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:3.0:1787857742.454437:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171625856:12345-192.168.204.36@tcp:4:cp.0 Request processed in 2902us (3188us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787857742.454453:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00002000:00100000:3.0:1787857742.454468:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (0->157) req@ffff9997c26e52c0 x1874704171625856/t4294967343(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:388/0 lens 648/448 e 0 to 0 dl 1787857753 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857742.454478:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c26e52c0 with x1874704171625856 ext(0->157) 00010000:00010000:3.0:1787857742.454499:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 12 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.454520:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 12 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857742.454528:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9997c26e52c0 00000100:00100000:3.0:1787857742.458793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857742.458904:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171625984 00000100:00100000:2.0:1787857742.458922:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171625984 00010000:00010000:2.0:1787857742.458992:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 12 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857742.459056:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 282 00000100:00100000:2.0:1787857742.459070:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2347:x1874704171625984:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857742.459089:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857742.459122:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 12 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.459161:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 12 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.459210:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7be80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3824 expref: 12 pid: 6713 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.459234:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857742.459239:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857742.459246:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.459258:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.459296:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857742.459378:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171625984:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 311us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857742.459387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 282 00010000:00010000:3.0:1787857742.460761:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.460781:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.460842:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.460851:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.460860:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.460867:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857742.460872:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.460897:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.460919:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.460927:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7bed4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857742.461030:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171625728:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 26260us (31704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857742.461041:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:3.0:1787857742.465620:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857742.465709:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171626240 00000100:00100000:2.0:1787857742.465723:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171626240 00000100:00100000:2.0:1787857742.465802:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 928 00000100:00100000:2.0:1787857742.465812:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:25921:x1874704171626240:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857742.465956:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:25921:x1874704171626240:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 145us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857742.465963:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 928 00000100:00100000:2.0:1787857742.469706:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857742.471136:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171626368 00000100:00100000:3.0:1787857742.471149:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171626368 00000100:00100000:3.0:1787857742.471226:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:3.0:1787857742.471236:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171626368:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857742.471253:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857742.471272:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd384e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857742.471297:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 158, mtime: 0x6a908b4d, atime: 0x0, ctime: 0x6a908b4d, blocks: 0x1 00010000:00010000:3.0:1787857742.471317:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787857742.471323:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857742.471347:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.471368:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857742.471381:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52200, rc 0) 00000100:00100000:3.0:1787857742.471451:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171626368:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 217us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857742.471459:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:3.0:1787857742.477254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857742.477364:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171626624 00000100:00100000:0.0:1787857742.477380:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171626624 00000100:00100000:0.0:1787857742.477462:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 929 00000100:00100000:0.0:1787857742.477472:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:25921:x1874704171626624:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857742.477596:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:25921:x1874704171626624:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 125us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857742.477604:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 929 00000100:00100000:3.0:1787857742.482150:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857742.482419:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171626752 00000100:00100000:1.0:1787857742.482437:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171626752 00002000:00100000:1.0:1787857742.482503:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff9998f7018f00 x1874704171626752/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:388/0 lens 488/0 e 0 to 0 dl 1787857753 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857742.482517:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7018f00 with x1874704171626752 ext(0->4095) 00002000:00010000:1.0:1787857742.482524:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7018f00 00000100:00100000:1.0:1787857742.482568:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 87 00000100:00100000:1.0:1787857742.482580:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171626752:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857742.482899:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171626752:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 319us (766us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857742.482908:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 87 00002000:00100000:1.0:1787857742.482916:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff9998f7018f00 x1874704171626752/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:388/0 lens 488/4536 e 0 to 0 dl 1787857753 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857742.482924:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7018f00 with x1874704171626752 ext(0->4095) 00002000:00010000:1.0:1787857742.482928:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7018f00 00000100:00100000:2.0:1787857742.495095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857742.495144:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171626880 00000100:00100000:2.0:1787857742.495153:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171626880 00000100:00100000:2.0:1787857742.495235:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 930 00000100:00100000:2.0:1787857742.495246:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:25921:x1874704171626880:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857742.495270:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857742.495295:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7bee2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3855 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.495342:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.495359:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.495375:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.495512:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7bee2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.495532:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.495541:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:2.0:1787857742.495544:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857742.495546:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857742.495607:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:25921:x1874704171626880:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 364us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857742.495621:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 930 00000100:00100000:2.0:1787857742.515709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857742.518096:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171627008 00000100:00100000:3.0:1787857742.518120:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171627008 00000100:00100000:3.0:1787857742.518242:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 931 00000100:00100000:3.0:1787857742.518255:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:25921:x1874704171627008:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857742.518300:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x18:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857742.518459:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:25921:x1874704171627008:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 206us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857742.518467:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 931 00000100:00100000:3.0:1787857742.522580:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857742.524557:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171627136 00000100:00100000:0.0:1787857742.524575:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171627136 00000100:00100000:0.0:1787857742.524780:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00100000:0.0:1787857742.524791:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171627136:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857742.524861:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.524895:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857742.524899:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857742.524906:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.524923:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.524965:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.524974:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.524982:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.524989:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857742.524994:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.525003:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.525941:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.525968:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e3b1c2a/0xd3f183cab4a7bef0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857742.527409:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171627136:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 2608us (4833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857742.527422:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00100000:3.0:1787857742.530982:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857742.531369:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171627392 00000100:00100000:0.0:1787857742.531387:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171627392 00000100:00100000:0.0:1787857742.531459:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 932 00000100:00100000:0.0:1787857742.531470:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:25921:x1874704171627392:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857742.531559:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.531579:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.531588:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.531630:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857742.531646:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 43 pid: 5856 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857742.531662:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188229120:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857742.533938:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857742.538925:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188229120:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857742.538961:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857742.543144:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857742.546026:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171627520 00000100:00100000:1.0:1787857742.546040:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171627520 00010000:00010000:1.0:1787857742.546090:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 44 pid: 5856 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857742.546137:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 283 00000100:00100000:1.0:1787857742.546149:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171627520:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857742.546180:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857742.546187:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 44 pid: 5856 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.546467:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 44 pid: 5856 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.546499:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7bee9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3855 expref: 44 pid: 5856 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.547067:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857742.547083:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.547094:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.547103:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857742.547140:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857742.547181:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.547203:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.547554:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.547564:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.547571:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.547578:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857742.547583:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.547591:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.547602:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:2.0:1787857742.547611:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857742.547616:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857742.547622:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bef7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857742.547690:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171627520:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1080us (4096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857742.547701:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 283 00000100:00100000:2.0:1787857742.547763:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:25921:x1874704171627392:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 16294us (16795us total) trans 4294967899 rc 0/0 00000100:00100000:2.0:1787857742.547772:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 932 00000040:00080000:0.0:1787857742.548116:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857742.548121:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857742.549607:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787857742.549625:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857742.553441:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857742.553545:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171627776 00000100:00100000:0.0:1787857742.553559:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171627776 00000100:00100000:0.0:1787857742.553637:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 187 00000100:00100000:0.0:1787857742.553650:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:25921:x1874704171627776:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857742.554415:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:25921:x1874704171627776:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 767us (984us total) trans 4294967900 rc 0/0 00000100:00100000:0.0:1787857742.554424:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 187 00010000:00010000:0.0:1787857742.574323:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857742.704256:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857742.704289:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188229248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857742.704398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857742.704586:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188229248 00000100:00100000:3.0:1787857742.704596:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188229248 00000100:00100000:3.0:1787857742.704669:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787857742.704679:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188229248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857742.704718:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 76480512 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857742.704773:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188229248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857742.704781:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787857742.704864:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188229248:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787857742.984879:0:18984:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857742.984897:0:18984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857742.984950:0:18984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 3 00000040:00080000:0.0:1787857742.984957:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857743.058080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857743.058203:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171628032 00000100:00100000:1.0:1787857743.058218:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171628032 00000100:00080000:2.0:1787857743.058428:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857743.058576:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 933 00000100:00100000:1.0:1787857743.058590:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+86:25923:x1874704171628032:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857743.058621:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857743.058626:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787857743.059011:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7beb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3839 expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857743.059032:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:1.0:1787857743.059039:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857743.059058:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7befe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd385c expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857743.059233:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7bf05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857743.059249:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7bf05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857743.059262:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7bf05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857743.059275:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00010000:00010000:0.0:1787857743.060613:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7befe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd385c expref: 88 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857743.060707:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7bf05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd385c expref: 87 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857743.060721:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:0.0:1787857743.060724:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857743.060727:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052400, rc 0) 00000100:00100000:0.0:1787857743.060855:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+87:25923:x1874704171628032:12345-192.168.204.36@tcp:101:bash.0 Request processed in 2268us (2789us total) trans 4294967901 rc 0/0 00000100:00100000:0.0:1787857743.060880:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 933 00000100:00100000:3.0:1787857743.068302:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857743.069043:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171628160 00000100:00100000:1.0:1787857743.069059:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171628160 00000100:00100000:1.0:1787857743.069148:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:1.0:1787857743.069159:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+87:2348:x1874704171628160:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857743.069196:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857743.069232:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7bf05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd385c expref: 87 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857743.069258:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857743.069263:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857743.069349:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+86:2348:x1874704171628160:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 189us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857743.069357:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:2.0:1787857743.076100:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.076739:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171628288 00000100:00100000:3.0:1787857743.076755:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171628288 00000100:00080000:2.0:1787857743.076836:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857743.076889:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:3.0:1787857743.076977:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+11:2350:x1874704171628288:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857743.077005:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857743.077028:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3863 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.077064:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857743.077070:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857743.077080:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.077105:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.077122:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:3.0:1787857743.077214:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171628288:12345-192.168.204.36@tcp:101:cat.0 Request processed in 315us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.077237:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:3.0:1787857743.083604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857743.083722:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171628416 00000100:00100000:2.0:1787857743.083737:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171628416 00000100:00100000:2.0:1787857743.083850:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 240 00000100:00100000:2.0:1787857743.083864:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:25923:x1874704171628416:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857743.083899:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857743.083923:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e7a2b40/0xd3f183cab4a7bf1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd386a expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.083978:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.083990:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.084024:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857743.084029:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857743.084036:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e7a2b40/0xd3f183cab4a7bf1a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd386a expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.084085:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.084102:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 13 pid: 6713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857743.084121:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188229376:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857743.084277:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.084287:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 10 pid: 6714 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857743.084536:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b42940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188229504:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857743.084570:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857743.091488:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188229376:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857743.091508:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b42940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188229504:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857743.091557:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e7a2b40/0xd3f183cab4a7bf1a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd386a expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857743.091585:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74200, rc 0) 00000100:00100000:0.0:1787857743.091677:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+13:25923:x1874704171628416:12345-192.168.204.36@tcp:101:cat.0 Request processed in 7815us (8087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857743.091689:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 240 00000100:00100000:3.0:1787857743.096174:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.096237:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857743.096430:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171628544 00000100:00100000:2.0:1787857743.096446:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171628544 00010000:00010000:2.0:1787857743.096505:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 13 pid: 6713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857743.096576:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171628672 00000100:00100000:2.0:1787857743.096579:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171628672 00010000:00010000:2.0:1787857743.096613:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 11 pid: 6714 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857743.096639:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 284 00000100:00100000:2.0:1787857743.096651:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171628544:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857743.096672:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857743.096703:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 13 pid: 6713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.096720:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 13 pid: 6713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.096748:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7bf13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3863 expref: 13 pid: 6713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.096772:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857743.096870:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171628544:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 221us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857743.096879:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 284 00000100:00100000:2.0:1787857743.096904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 285 00000100:00100000:2.0:1787857743.096912:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171628672:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857743.096930:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857743.096940:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 11 pid: 6714 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.096951:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 11 pid: 6714 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.096978:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab028321/0xd3f183cab4a7bedb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd384e expref: 11 pid: 6714 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.096991:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857743.096996:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857743.097003:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e7a2b40/0xd3f183cab4a7bf1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd386a expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.097015:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e7a2b40/0xd3f183cab4a7bf1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd386a expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857743.097064:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003e7a2b40/0xd3f183cab4a7bf1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd386a expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857743.097081:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b43840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188229632:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857743.097154:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeee40 going to sleep for 11 seconds 00000100:00080000:2.0:1787857743.097351:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857743.101721:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857743.102064:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b43840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188229632:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857743.102090:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171628800 00000100:00100000:0.0:1787857743.102099:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171628800 00010000:00010000:2.0:1787857743.102114:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1787857743.102165:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff9997c2ca30c0 x1874704171628800/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:389/0 lens 488/0 e 0 to 0 dl 1787857754 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857743.102192:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2ca30c0 with x1874704171628800 ext(0->4095) 00000100:00100000:2.0:1787857743.102197:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171628672:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5285us (5960us total) trans 0 rc 0/0 00002000:00010000:0.0:1787857743.102198:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c2ca30c0 00000100:00100000:2.0:1787857743.102210:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 285 00000100:00100000:0.0:1787857743.102237:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 88 00000100:00100000:0.0:1787857743.102247:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171628800:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:0.0:1787857743.102736:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171628800:12345-192.168.204.36@tcp:3:cat.0 Request processed in 481us (1023us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857743.102751:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 88 00002000:00100000:0.0:1787857743.102761:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff9997c2ca30c0 x1874704171628800/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:389/0 lens 488/4536 e 0 to 0 dl 1787857754 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857743.102793:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2ca30c0 with x1874704171628800 ext(0->4095) 00002000:00010000:0.0:1787857743.102801:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c2ca30c0 00000100:00100000:3.0:1787857743.114395:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857743.114491:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171629056 00000100:00100000:2.0:1787857743.114503:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171629056 00000100:00100000:2.0:1787857743.114582:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 188 00000100:00100000:2.0:1787857743.114594:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+86:25923:x1874704171629056:12345-192.168.204.36@tcp:35:cat.0 00000001:00080000:2.0:1787857743.115210:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967902 00000001:00080000:2.0:1787857743.115274:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967903 00000100:00100000:2.0:1787857743.115419:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:25923:x1874704171629056:12345-192.168.204.36@tcp:35:cat.0 Request processed in 824us (1040us total) trans 4294967904 rc 0/0 00000100:00100000:2.0:1787857743.115429:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 188 00000020:00080000:2.0:1787857743.115435:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787857743.140940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857743.141063:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171629184 00000100:00100000:1.0:1787857743.141078:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171629184 00002000:00100000:1.0:1787857743.141150:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (0->315) req@ffff9997c1b43840 x1874704171629184/t0(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:389/0 lens 808/0 e 0 to 0 dl 1787857754 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857743.141197:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c1b43840 with x1874704171629184 ext(0->315) 00002000:00010000:1.0:1787857743.141204:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c1b43840 00000100:00100000:1.0:1787857743.141249:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 89 00000100:00100000:1.0:1787857743.141261:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171629184:12345-192.168.204.36@tcp:4:cat.0 00000100:00100000:1.0:1787857743.141781:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:365dae28-8203-4526-83a5-01baf5c55d8b+14:2347:x1874704171629184:12345-192.168.204.36@tcp:4:cat.0 Request processed in 520us (859us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787857743.141791:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 89 00002000:00100000:1.0:1787857743.141798:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (0->315) req@ffff9997c1b43840 x1874704171629184/t4294967344(0) o4->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:389/0 lens 808/448 e 0 to 0 dl 1787857754 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857743.141806:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c1b43840 with x1874704171629184 ext(0->315) 00002000:00010000:1.0:1787857743.141809:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c1b43840 00000100:00100000:3.0:1787857743.165975:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857743.166076:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171629440 00000100:00100000:0.0:1787857743.166094:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171629440 00000100:00100000:0.0:1787857743.166217:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 934 00000100:00100000:0.0:1787857743.166230:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+89:25925:x1874704171629440:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857743.166267:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857743.166297:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3871 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857743.166446:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857743.166466:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857743.166480:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857743.166495:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 316 00010000:00010000:0.0:1787857743.166666:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3871 expref: 92 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857743.166692:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3871 expref: 91 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857743.166703:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:0.0:1787857743.166716:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787857743.166721:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857743.166857:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+91:25925:x1874704171629440:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 629us (891us total) trans 4294967905 rc 0/0 00000100:00100000:0.0:1787857743.166866:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 934 00000100:00100000:0.0:1787857743.172154:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.172271:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171629568 00000100:00100000:3.0:1787857743.172283:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171629568 00000100:00100000:3.0:1787857743.172362:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 935 00000100:00100000:3.0:1787857743.172374:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+91:25925:x1874704171629568:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:3.0:1787857743.172479:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172502:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172518:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172553:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172561:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172569:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172576:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857743.172597:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172606:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172621:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:3.0:1787857743.172626:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857743.172631:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.172651:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857743.172744:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+91:25925:x1874704171629568:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 373us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.172754:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 935 00000100:00100000:0.0:1787857743.206562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.209948:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171629696 00000100:00100000:3.0:1787857743.209967:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171629696 00000100:00100000:3.0:1787857743.210054:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 936 00000100:00100000:3.0:1787857743.210068:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+91:25926:x1874704171629696:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857743.210102:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857743.210131:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bf3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3878 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.210248:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.210267:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.210299:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857743.210377:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:3.0:1787857743.210382:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857743.210407:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.210439:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7bf3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3878 expref: 93 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.210458:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52400/0xd3f183cab4a7bf44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3878 expref: 92 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857743.210468:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9998d1291600) 00010000:00010000:3.0:1787857743.210471:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857743.210476:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52400, rc 0) 00000100:00100000:3.0:1787857743.210577:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+92:25926:x1874704171629696:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 512us (4028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.210585:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 936 00000100:00100000:3.0:1787857743.230330:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857743.230377:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171630080 00000100:00100000:0.0:1787857743.230391:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171630080 00000100:00100000:0.0:1787857743.230470:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 189 00000100:00100000:0.0:1787857743.230481:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:25926:x1874704171630080:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1787857743.231254:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+93:25926:x1874704171630080:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 769us (937us total) trans 4294967906 rc 0/0 00000100:00100000:0.0:1787857743.231264:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 189 00000100:00100000:0.0:1787857743.243084:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857743.243226:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171630208 00000100:00100000:1.0:1787857743.243240:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171630208 00000100:00100000:1.0:1787857743.243327:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:1.0:1787857743.243340:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:25926:x1874704171630208:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:1.0:1787857743.243361:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787857743.243395:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3871 expref: 93 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857743.243421:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7be9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd382b expref: 92 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857743.243432:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9998d1291500) 00010000:00010000:1.0:1787857743.243438:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857743.243542:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+91:25926:x1874704171630208:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 205us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857743.243551:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:3.0:1787857743.249948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857743.250024:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171630336 00000100:00100000:0.0:1787857743.250039:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171630336 00000100:00100000:0.0:1787857743.250124:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 937 00000100:00100000:0.0:1787857743.250136:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+91:25926:x1874704171630336:12345-192.168.204.36@tcp:58:lfs.0 00000100:00100000:0.0:1787857743.250614:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+91:25926:x1874704171630336:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 478us (679us total) trans 0 rc -1/-1 00000100:00100000:0.0:1787857743.250624:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 937 00000040:00080000:0.0:1787857743.598354:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857743.598368:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857743.598567:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 2 00000040:00080000:0.0:1787857743.598575:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857743.599117:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857743.953905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.953961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.953995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.954019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.954042:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.954077:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.954102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857743.954136:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171630720 00000100:00100000:3.0:1787857743.954150:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171630720 00000100:00100000:3.0:1787857743.954229:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171631232 00000100:00100000:3.0:1787857743.954233:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171631232 00000100:00100000:3.0:1787857743.954257:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171630848 00000100:00100000:3.0:1787857743.954260:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171630848 00000100:00100000:3.0:1787857743.954274:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171631104 00000100:00100000:3.0:1787857743.954276:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171631104 00000100:00100000:3.0:1787857743.954294:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 356 00000100:00100000:3.0:1787857743.954305:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171630720:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857743.954401:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171630720:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 97us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.954411:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 356 00000100:00100000:3.0:1787857743.954431:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 357 00000100:00100000:3.0:1787857743.954438:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171631232:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857743.954468:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171631232:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.954475:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 357 00000100:00100000:3.0:1787857743.954491:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 358 00000100:00100000:3.0:1787857743.954497:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171630848:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857743.954520:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171630848:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.954526:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 358 00000100:00100000:3.0:1787857743.954539:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 359 00000100:00100000:3.0:1787857743.954552:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171631104:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857743.954584:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171631104:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.954591:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 359 00000100:00100000:3.0:1787857743.954617:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171630976 00000100:00100000:3.0:1787857743.954621:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171630976 00000100:00100000:3.0:1787857743.954658:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171630592 00000100:00100000:3.0:1787857743.954662:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171630592 00000100:00100000:3.0:1787857743.954684:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 369 00000100:00100000:3.0:1787857743.954690:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2348:x1874704171630976:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857743.954726:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2348:x1874704171630976:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.954733:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 369 00000100:00100000:3.0:1787857743.954744:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 370 00000100:00100000:3.0:1787857743.954750:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+91:2348:x1874704171630592:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857743.954773:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+91:2348:x1874704171630592:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857743.954779:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 370 00000100:00100000:2.0:1787857743.956771:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171630464 00000100:00100000:2.0:1787857743.956789:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171630464 00000100:00100000:2.0:1787857743.956885:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 551 00000100:00100000:2.0:1787857743.956896:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171630464:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857743.956982:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171630464:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 87us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857743.956990:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 551 00000100:00080000:2.0:1787857743.957037:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857743.957045:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857744.239202:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188230016:0@lo:400:kworker.0 00000100:00100000:1.0:1787857744.239304:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857744.239363:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188229760:0@lo:400:kworker.0 00000100:00100000:1.0:1787857744.239396:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857744.239408:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188230144:0@lo:400:kworker.0 00000100:00100000:0.0:1787857744.239515:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188229888:0@lo:400:kworker.0 00000100:00100000:0.0:1787857744.244109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857744.244208:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188230400:0@lo:400:kworker.0 00000100:00100000:0.0:1787857744.244256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857744.244333:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188230400 00000100:00100000:0.0:1787857744.244344:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188230400 00000100:00100000:3.0:1787857744.244634:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188230016 00000100:00100000:3.0:1787857744.244647:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188230016 00000100:00100000:3.0:1787857744.244709:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188229888 00000100:00100000:3.0:1787857744.244713:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188229888 00000100:00100000:3.0:1787857744.244739:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787857744.244750:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188230016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857744.244874:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188230016:12345-0@lo:400:kworker.0 Request processed in 126us (5569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857744.244917:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787857744.244936:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787857744.244942:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188229888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857744.246552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857744.246720:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188229888:12345-0@lo:400:kworker.0 Request processed in 1771us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857744.246734:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787857744.246781:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857744.247500:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188229760 00000100:00100000:3.0:1787857744.247511:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188229760 00000100:00100000:3.0:1787857744.247560:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1787857744.247568:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188229760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857744.247740:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188229760:12345-0@lo:400:kworker.0 Request processed in 173us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857744.247748:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1787857744.247810:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188229760:0@lo:400:kworker.0 00000100:00100000:3.0:1787857744.248516:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188230272:0@lo:400:kworker.0 00000100:00100000:3.0:1787857744.248567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857744.249196:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188230272 00000100:00100000:3.0:1787857744.249204:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188230272 00000100:00100000:3.0:1787857744.249248:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787857744.249257:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188230272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857744.249311:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188230272:12345-0@lo:400:kworker.0 Request processed in 56us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857744.249317:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787857744.249353:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188230272:0@lo:400:kworker.0 00000100:00100000:0.0:1787857744.253681:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188230144 00000100:00100000:0.0:1787857744.253706:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188230144 00000100:00100000:0.0:1787857744.253838:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787857744.253852:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188230400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857744.255508:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787857744.255533:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188230144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857744.255632:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188230144:12345-0@lo:400:kworker.0 Request processed in 112us (8858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857744.255640:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:2.0:1787857744.255729:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857744.255735:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857744.255738:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857744.255777:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188229888:0@lo:400:kworker.0 00000100:00100000:0.0:1787857744.256715:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188230400:12345-0@lo:400:kworker.0 Request processed in 2857us (12449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857744.256732:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787857744.257564:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188230400:0@lo:400:kworker.0 00000100:00100000:1.0:1787857744.260935:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188230144:0@lo:400:kworker.0 00000100:00100000:1.0:1787857744.260962:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188230016:0@lo:400:kworker.0 00010000:00010000:3.0:1787857744.625446:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857744.750203:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857744.750237:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188230528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857744.750336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857744.750427:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188230528 00000100:00100000:2.0:1787857744.750437:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188230528 00000100:00100000:2.0:1787857744.750508:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787857744.750519:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188230528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857744.750569:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857744.750624:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188230528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857744.750633:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787857744.750690:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188230528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787857745.645977:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787857746.377045:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967906 is committed 00000001:00080000:3.0:1787857746.377064:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967900 is committed 00000001:00080000:1.0:1787857746.386970:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00000001:00080000:1.0:1787857746.386996:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00000001:00080000:1.0:1787857746.387006:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00010000:00010000:0.0:1787857746.676175:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857747.695149:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857747.822338:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857747.822380:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188230656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857747.822493:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857747.822669:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188230656 00000100:00100000:3.0:1787857747.822680:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188230656 00000100:00080000:0.0:1787857747.822737:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857747.822771:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787857747.822783:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188230656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857747.823116:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857747.823265:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188230656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 483us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857747.823274:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787857747.823630:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967342 gen 2 00000100:00100000:1.0:1787857747.823676:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188230656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857748.635994:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857748.636260:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171631360 00000100:00100000:1.0:1787857748.636274:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171631360 00000100:00080000:0.0:1787857748.636354:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857748.636374:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 938 00000100:00100000:1.0:1787857748.636388:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25904:x1874704171631360:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787857748.636542:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:25904:x1874704171631360:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 156us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857748.636574:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 938 00010000:00010000:3.0:1787857748.719982:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857749.072052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857749.072192:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857749.072238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857749.072375:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171631488 00000100:00100000:0.0:1787857749.072388:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171631488 00000100:00100000:0.0:1787857749.072454:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 553 00000100:00100000:0.0:1787857749.072466:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171631488:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857749.072565:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171631488:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 101us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857749.072573:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 553 00000100:00100000:3.0:1787857749.072962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857749.072994:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857749.077169:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171631744 00000100:00100000:1.0:1787857749.077254:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171632256 00000100:00100000:1.0:1787857749.077270:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171632256 00000100:00100000:1.0:1787857749.077375:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 362 00000100:00100000:1.0:1787857749.077391:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171632256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857749.077503:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171632256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 118us (4542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857749.077511:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 362 00000100:00080000:1.0:1787857749.077543:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857749.077777:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171631744 00000100:00100000:0.0:1787857749.077852:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 363 00000100:00100000:0.0:1787857749.077861:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171631744:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:1.0:1787857749.078083:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857749.078287:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171631744:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 180us (5847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857749.078298:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 363 00000100:00100000:2.0:1787857749.082294:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171632000 00000100:00100000:2.0:1787857749.082318:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171632000 00000100:00100000:3.0:1787857749.082393:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857749.082413:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171631616 00000100:00100000:3.0:1787857749.082430:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857749.082440:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171631616 00000100:00100000:2.0:1787857749.082497:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 374 00000100:00100000:2.0:1787857749.082511:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2347:x1874704171632000:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:3.0:1787857749.082514:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857749.082633:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2347:x1874704171632000:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 126us (10394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.082643:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 374 00000100:00100000:2.0:1787857749.082664:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 375 00000100:00100000:2.0:1787857749.082670:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+84:2347:x1874704171631616:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857749.082695:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+84:2347:x1874704171631616:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (9701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.082702:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 375 00000100:00100000:2.0:1787857749.082740:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171631872 00000100:00100000:2.0:1787857749.082744:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171631872 00000100:00100000:2.0:1787857749.082780:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171632128 00000100:00100000:2.0:1787857749.082783:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171632128 00000100:00100000:2.0:1787857749.082805:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 364 00000100:00100000:2.0:1787857749.082811:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171631872:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857749.082881:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171631872:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 70us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.082888:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 364 00000100:00100000:2.0:1787857749.082899:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 365 00000100:00100000:2.0:1787857749.082904:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171632128:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857749.082928:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171632128:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.082935:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 365 00000100:00080000:3.0:1787857749.084987:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857749.085000:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857749.362513:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188230912:0@lo:400:kworker.0 00000100:00100000:1.0:1787857749.362513:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188231168:0@lo:400:kworker.0 00000100:00100000:0.0:1787857749.362599:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188231040:0@lo:400:kworker.0 00000100:00100000:3.0:1787857749.362604:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188230784:0@lo:400:kworker.0 00000100:00100000:2.0:1787857749.364732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857749.364907:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188231424:0@lo:400:kworker.0 00000100:00100000:2.0:1787857749.365010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857749.365099:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188230912 00000100:00100000:2.0:1787857749.365174:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188230912 00000100:00100000:2.0:1787857749.365418:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787857749.365430:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188230912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857749.365502:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188230912:12345-0@lo:400:kworker.0 Request processed in 75us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.365510:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787857749.365562:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188230912:0@lo:400:kworker.0 00000100:00100000:2.0:1787857749.365720:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188231424 00000100:00100000:2.0:1787857749.365726:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188231424 00000100:00100000:2.0:1787857749.365792:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787857749.365799:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188231424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857749.365858:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188231424:12345-0@lo:400:kworker.0 Request processed in 60us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.365865:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787857749.365895:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188231424:0@lo:400:kworker.0 00000100:00080000:2.0:1787857749.365920:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857749.368522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857749.368702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857749.369948:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188231168 00000100:00100000:2.0:1787857749.369964:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188231168 00000100:00100000:2.0:1787857749.370203:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787857749.370215:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188231168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857749.370319:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188231168:12345-0@lo:400:kworker.0 Request processed in 107us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.370348:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:0.0:1787857749.370379:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857749.370807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857749.370882:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188231296:0@lo:400:kworker.0 00000100:00100000:3.0:1787857749.370920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857749.371161:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188231040 00000100:00100000:0.0:1787857749.371168:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188231040 00000100:00100000:0.0:1787857749.371241:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188231296 00000100:00100000:0.0:1787857749.371245:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188231296 00000100:00100000:0.0:1787857749.371429:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787857749.371440:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188231040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857749.371498:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188231040:12345-0@lo:400:kworker.0 Request processed in 60us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857749.371505:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787857749.371521:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787857749.371529:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188231296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857749.371559:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188231296:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857749.371566:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:0.0:1787857749.371589:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857749.371632:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188231040:0@lo:400:kworker.0 00000100:00100000:3.0:1787857749.371884:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188231296:0@lo:400:kworker.0 00000100:00100000:1.0:1787857749.372613:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188231168:0@lo:400:kworker.0 00000100:00100000:2.0:1787857749.376304:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188230784 00000100:00100000:2.0:1787857749.376327:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188230784 00000100:00100000:2.0:1787857749.376435:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1787857749.376447:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188230784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857749.376578:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188230784:12345-0@lo:400:kworker.0 Request processed in 134us (5772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.376587:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1787857749.376873:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188230784:0@lo:400:kworker.0 00010000:00010000:1.0:1787857749.742515:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857749.871659:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857749.871684:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188231552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857749.871755:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857749.871855:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188231552 00000100:00100000:2.0:1787857749.871862:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188231552 00000100:00100000:2.0:1787857749.871908:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787857749.871916:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188231552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857749.871954:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857749.871999:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188231552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857749.872007:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787857749.872062:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188231552:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787857750.294512:0:19183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 15:09:08 (1787857748) 00010000:00010000:0.0:1787857750.767156:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857750.779302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.781975:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171632384 00000100:00100000:0.0:1787857750.781990:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171632384 00000100:00100000:0.0:1787857750.782172:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 939 00000100:00100000:0.0:1787857750.782198:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:26528:x1874704171632384:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857750.782320:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:26528:x1874704171632384:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 123us (3027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857750.782327:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 939 00000100:00080000:2.0:1787857750.783606:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857750.808432:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.808857:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171632512 00000100:00100000:0.0:1787857750.808868:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171632512 00000100:00100000:0.0:1787857750.808942:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 940 00000100:00100000:0.0:1787857750.808955:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+84:26529:x1874704171632512:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857750.808977:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857750.809001:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd387f expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809078:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809094:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809106:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809158:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809167:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809174:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809696:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809706:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809714:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809720:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.809723:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809731:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809758:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:0.0:1787857750.809761:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.809766:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809772:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809785:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809791:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809797:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809808:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.809811:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809871:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809880:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff9998d8797f00) 00010000:00010000:0.0:1787857750.809882:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.809885:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809891:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bf59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809926:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd387f expref: 85 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809937:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:0.0:1787857750.809939:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.809943:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd387f expref: 85 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.809952:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4200, rc 0) 00000100:00100000:0.0:1787857750.810029:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+84:26529:x1874704171632512:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1077us (1606us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857750.810048:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 940 00000100:00100000:3.0:1787857750.817561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.817650:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171632768 00000100:00100000:0.0:1787857750.817672:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171632768 00000100:00100000:0.0:1787857750.817745:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 941 00000100:00100000:0.0:1787857750.817756:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+84:26529:x1874704171632768:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1787857750.817812:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857750.817871:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bda0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37d7 expref: 84 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.817892:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:0.0:1787857750.817897:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857750.818197:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.818212:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.818220:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.818255:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.818269:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 38 pid: 5858 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857750.818283:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188231680:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857750.818384:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857750.823452:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188231680:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857750.823483:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857750.824631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857750.824722:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171632896 00000100:00100000:1.0:1787857750.824735:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171632896 00010000:00010000:1.0:1787857750.824779:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 39 pid: 5858 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857750.824858:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 286 00000100:00100000:1.0:1787857750.824868:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:2349:x1874704171632896:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857750.824884:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857750.824901:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 39 pid: 5858 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.824914:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 39 pid: 5858 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.824938:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7bddf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd37ec expref: 39 pid: 5858 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.824954:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:1.0:1787857750.824960:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.824970:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.824978:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.825005:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857750.825068:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:2349:x1874704171632896:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 201us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857750.825076:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 286 00010000:00010000:0.0:1787857750.825149:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.825158:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.825184:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.825194:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.825203:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857750.826448:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00010000:00010000:0.0:1787857750.826462:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.826471:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.826478:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.826484:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.826488:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.826495:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.826519:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:0.0:1787857750.826522:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.826527:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.826533:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bf60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857750.826551:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc4ebae7 reply state 000000000f299efa transno 4294967907 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857750.826560:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857750.826637:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+85:26529:x1874704171632768:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 8881us (9084us total) trans 4294967907 rc 0/0 00000100:00100000:0.0:1787857750.826645:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 941 00010000:00010000:3.0:1787857750.832319:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857750.832349:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857750.832357:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857750.832364:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857750.832368:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857750.832376:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857750.832395:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff9998d8797f00) 00010000:00010000:3.0:1787857750.832399:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857750.832404:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857750.832411:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bf67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857750.841327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857750.841694:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171633024 00000100:00100000:1.0:1787857750.841703:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171633024 00000100:00100000:1.0:1787857750.841767:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 942 00000100:00100000:1.0:1787857750.841776:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+84:26530:x1874704171633024:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857750.841800:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857750.841849:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bf6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.841927:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bf75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.841941:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.841954:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857750.842018:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857750.842022:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857750.842053:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.842077:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bf6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3886 expref: 86 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.842096:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bf75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3886 expref: 85 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.842105:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857750.842108:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857750.842112:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857750.842173:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+85:26530:x1874704171633024:12345-192.168.204.36@tcp:101:bash.0 Request processed in 397us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857750.842180:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 942 00000100:00100000:2.0:1787857750.848148:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857750.848322:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171633152 00000100:00100000:1.0:1787857750.848341:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171633152 00000100:00100000:1.0:1787857750.848406:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 943 00000100:00100000:1.0:1787857750.848416:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:26530:x1874704171633152:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857750.848435:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857750.848461:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bf7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd388d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848545:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848560:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848571:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848586:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848593:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848599:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848943:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7bf91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848953:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7bf91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.848963:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7bf91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857750.849012:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:1.0:1787857750.849016:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857750.849049:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7bf91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849062:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849069:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849076:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849081:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857750.849085:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849093:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849105:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857750.849108:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857750.849112:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849118:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7bf83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849131:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849156:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849162:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849167:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857750.849173:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849180:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849191:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff9998c3984300) 00010000:00010000:1.0:1787857750.849194:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857750.849197:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849203:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7bf8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849234:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7bf7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd388d expref: 87 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849248:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052800/0xd3f183cab4a7bf91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd388d expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.849255:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857750.849258:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857750.849266:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052800, rc 0) 00000100:00100000:1.0:1787857750.849616:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+86:26530:x1874704171633152:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1200us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857750.849624:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 943 00000100:00100000:3.0:1787857750.853019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857750.853993:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171633280 00000100:00100000:1.0:1787857750.854004:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171633280 00000100:00100000:1.0:1787857750.854083:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 944 00000100:00100000:1.0:1787857750.854093:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+86:26530:x1874704171633280:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857750.854115:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857750.854139:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bf98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3894 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854221:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854237:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854248:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854265:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854272:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854278:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854370:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854387:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854394:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854401:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857750.854406:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854413:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854426:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857750.854429:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857750.854434:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854441:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7bf9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854456:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854463:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854468:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854472:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857750.854482:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854488:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854495:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998c3984a00) 00010000:00010000:1.0:1787857750.854498:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857750.854501:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854507:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7bfa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854542:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bf98 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3894 expref: 87 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854552:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857750.854554:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857750.854558:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7bf98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3894 expref: 87 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.854567:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053e00, rc 0) 00000100:00100000:1.0:1787857750.858558:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+86:26530:x1874704171633280:12345-192.168.204.36@tcp:101:bash.0 Request processed in 4453us (5535us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857750.858572:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 944 00000100:00100000:1.0:1787857750.881889:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.882028:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171633408 00000100:00100000:0.0:1787857750.882049:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171633408 00000100:00100000:0.0:1787857750.882114:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 945 00000100:00100000:0.0:1787857750.882125:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+38:26531:x1874704171633408:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857750.882145:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857750.882167:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd389b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.882234:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.882249:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.882280:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857750.882360:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857750.882364:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857750.882389:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.882415:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.882433:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.882442:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:0.0:1787857750.882445:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857750.882449:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4e00, rc 0) 00000100:00100000:0.0:1787857750.882516:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:26531:x1874704171633408:12345-192.168.204.36@tcp:101:rm.0 Request processed in 392us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857750.882525:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 945 00000100:00100000:3.0:1787857750.886971:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.887098:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171633536 00000100:00100000:0.0:1787857750.887111:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171633536 00000100:00100000:0.0:1787857750.887165:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 946 00000100:00100000:0.0:1787857750.887176:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:26531:x1874704171633536:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857750.887206:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857750.887228:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bfbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38a2 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887323:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887346:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887358:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887375:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887382:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887389:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887510:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7bfd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887519:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7bfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887526:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7bfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857750.887557:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:0.0:1787857750.887561:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857750.887583:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7bfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887605:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887610:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887617:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887622:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.887627:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887633:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887644:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:0.0:1787857750.887647:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.887651:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887657:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7bfc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887669:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887674:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887680:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887689:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.887692:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887698:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887705:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff9998d8797f00) 00010000:00010000:0.0:1787857750.887707:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.887709:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887715:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7bfc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887742:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7bfbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38a2 expref: 41 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887756:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3a00/0xd3f183cab4a7bfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38a2 expref: 40 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.887763:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.887766:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857750.887769:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999014e3a00, rc 0) 00000100:00100000:0.0:1787857750.887864:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26531:x1874704171633536:12345-192.168.204.36@tcp:101:rm.0 Request processed in 687us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857750.887872:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 946 00000100:00100000:2.0:1787857750.897103:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.897178:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171633664 00000100:00100000:0.0:1787857750.897211:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171633664 00000100:00100000:0.0:1787857750.897271:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 947 00000100:00100000:0.0:1787857750.897281:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26531:x1874704171633664:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857750.897302:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857750.897323:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7bfd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38a9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897411:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897426:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897437:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897456:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897464:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897472:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897546:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897554:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897560:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897573:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.897577:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897584:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897595:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.897598:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.897603:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897610:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7bfde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897623:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897629:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897634:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897639:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.897642:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897648:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897665:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998d8797b00) 00010000:00010000:0.0:1787857750.897667:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.897670:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897676:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7bfe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897712:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7bfd7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38a9 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897722:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.897724:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.897727:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7bfd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38a9 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.897972:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999014e3e00, rc 0) 00000100:00100000:0.0:1787857750.898048:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26531:x1874704171633664:12345-192.168.204.36@tcp:101:rm.0 Request processed in 768us (955us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857750.898055:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 947 00000100:00100000:2.0:1787857750.903157:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.903738:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171633792 00000100:00100000:0.0:1787857750.903749:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171633792 00000100:00100000:0.0:1787857750.903802:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 948 00000100:00100000:0.0:1787857750.903811:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26531:x1874704171633792:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857750.903858:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857750.903880:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7bfec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38b0 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.903974:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.903990:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904002:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904016:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904024:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904030:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904107:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904115:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904120:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904126:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.904129:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904146:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904158:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.904161:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.904166:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904171:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7bff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904186:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904192:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904198:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904203:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.904206:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904212:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904219:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998d8797f00) 00010000:00010000:0.0:1787857750.904222:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.904225:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904241:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7bffa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904280:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7bfec lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38b0 expref: 41 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904290:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.904292:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.904296:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7bfec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38b0 expref: 41 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.904306:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857750.904361:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26531:x1874704171633792:12345-192.168.204.36@tcp:101:rm.0 Request processed in 551us (1227us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857750.904369:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 948 00000100:00100000:3.0:1787857750.930863:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.930968:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171633920 00000100:00100000:0.0:1787857750.930979:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171633920 00000100:00100000:0.0:1787857750.931058:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 949 00000100:00100000:0.0:1787857750.931069:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26532:x1874704171633920:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857750.931092:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857750.931115:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38b7 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931183:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931199:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931227:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931243:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931250:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931257:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931341:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931350:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931357:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931363:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.931367:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931375:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931387:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.931389:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.931394:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931406:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c008 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931421:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931428:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931434:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931440:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.931443:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931449:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931457:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998d8797f00) 00010000:00010000:0.0:1787857750.931459:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.931462:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931468:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c00f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931500:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c001 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38b7 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931524:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.931526:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.931530:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38b7 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.931541:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857750.931607:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26532:x1874704171633920:12345-192.168.204.36@tcp:101:cp.0 Request processed in 540us (801us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857750.931615:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 949 00000100:00100000:2.0:1787857750.934956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.935062:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171634048 00000100:00100000:0.0:1787857750.935073:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171634048 00000100:00100000:0.0:1787857750.935125:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 950 00000100:00100000:0.0:1787857750.935134:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26532:x1874704171634048:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857750.935158:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857750.935178:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c016 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38be expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935249:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935265:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935277:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935292:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935316:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935323:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935404:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935411:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935419:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935425:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.935430:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935438:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935449:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.935452:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.935456:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935463:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c01d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935477:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935489:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935495:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935500:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.935503:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935510:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935518:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998d8797b00) 00010000:00010000:0.0:1787857750.935520:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.935523:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935528:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c024 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935565:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c016 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38be expref: 41 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935575:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.935578:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.935581:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c016 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38be expref: 41 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.935603:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70a00, rc 0) 00000100:00100000:0.0:1787857750.935679:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26532:x1874704171634048:12345-192.168.204.36@tcp:101:cp.0 Request processed in 546us (732us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857750.935687:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 950 00000100:00100000:2.0:1787857750.944391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.944513:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171634304 00000100:00100000:0.0:1787857750.944524:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171634304 00000100:00100000:0.0:1787857750.944591:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 951 00000100:00100000:0.0:1787857750.944601:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26532:x1874704171634304:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857750.944623:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857750.944643:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c02b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38c5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.944793:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.944810:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.944859:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.944876:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.944883:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.944889:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857750.945614:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:0.0:1787857750.945810:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945856:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945865:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945902:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945909:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945916:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945922:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857750.945927:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945934:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945946:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857750.945949:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857750.945954:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.945971:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c032 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857750.945986:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037fb397a reply state 00000000ab70320b transno 4294967908 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857750.945996:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857750.946043:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c02b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.946059:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.946067:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:0.0:1787857750.946069:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857750.946072:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857750.946143:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26532:x1874704171634304:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1543us (1763us total) trans 4294967908 rc 0/0 00000100:00100000:0.0:1787857750.946153:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 951 00010000:00010000:2.0:1787857750.955261:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.955282:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.955290:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.955297:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857750.955302:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.955310:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.955340:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998d8797b00) 00010000:00010000:2.0:1787857750.955343:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857750.955348:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.955355:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c039 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857750.955679:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857750.955754:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171634432 00000100:00100000:1.0:1787857750.955763:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171634432 00000100:00100000:1.0:1787857750.955844:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 241 00000100:00100000:1.0:1787857750.955870:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171634432:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857750.955889:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857750.955908:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38cc expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857750.955933:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857750.955953:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1787857750.955958:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857750.955967:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 11 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.955986:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 11 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857750.955998:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053e00, rc 0) 00000100:00100000:1.0:1787857750.956055:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171634432:12345-192.168.204.36@tcp:101:cp.0 Request processed in 188us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857750.956062:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 241 00000100:00100000:3.0:1787857750.959761:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857750.959862:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171634560 00000100:00100000:2.0:1787857750.959871:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171634560 00000100:00100000:2.0:1787857750.959933:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 242 00000100:00100000:2.0:1787857750.959944:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:26532:x1874704171634560:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857750.959962:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857750.959980:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38d3 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.960027:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.960048:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857750.960053:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857750.960059:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.960093:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.960107:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 12 pid: 14028 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857750.960121:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188231808:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857750.960224:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998e1b7ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857750.964513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.964669:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171634688 00000100:00100000:0.0:1787857750.964679:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171634688 00010000:00010000:0.0:1787857750.964728:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 13 pid: 14028 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857750.964781:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 287 00000100:00100000:0.0:1787857750.964792:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171634688:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857750.964809:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857750.964879:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 13 pid: 14028 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.964894:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 13 pid: 14028 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.964924:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857750.964929:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857750.964938:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.964949:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857750.964988:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857750.965003:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188231936:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857750.965087:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8240 going to sleep for 11 seconds 00010000:00010000:2.0:1787857750.965747:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c04e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38cc expref: 13 pid: 14028 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857750.965766:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188231808:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857750.965791:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857750.965871:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74e00, rc 0) 00000100:00100000:2.0:1787857750.965918:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:26532:x1874704171634560:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5976us (6168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857750.965928:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 242 00000100:00100000:3.0:1787857750.971681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857750.971808:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188231936:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857750.971865:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857750.971929:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171634688:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 7138us (7429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857750.971941:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 287 00000100:00100000:1.0:1787857750.972383:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171634944 00000100:00100000:1.0:1787857750.972391:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171634944 00000100:00100000:1.0:1787857750.972436:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 190 00000100:00100000:1.0:1787857750.972446:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6123450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26532:x1874704171634944:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:1.0:1787857750.972843:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6123450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26532:x1874704171634944:12345-192.168.204.36@tcp:35:cp.0 Request processed in 373us (1151us total) trans 4294967909 rc 0/0 00000100:00100000:1.0:1787857750.972851:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 190 00000100:00100000:3.0:1787857751.023440:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857751.023605:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171635072 00000100:00100000:0.0:1787857751.023618:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171635072 00000100:00100000:0.0:1787857751.023728:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 952 00000100:00100000:0.0:1787857751.023749:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+86:26535:x1874704171635072:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857751.023771:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857751.023793:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c05c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38da expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.023895:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.023911:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.023922:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.023937:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.023945:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.023951:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024068:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024077:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024085:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857751.024131:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:0.0:1787857751.024135:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857751.024154:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024166:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024175:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024181:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024188:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024194:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857751.024199:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024206:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024217:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857751.024220:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857751.024226:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024232:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024261:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024268:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024274:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024279:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857751.024282:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024298:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024308:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998d8797b00) 00010000:00010000:0.0:1787857751.024310:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857751.024313:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024319:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c06a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024352:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c05c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 88 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024364:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 87 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.024383:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:0.0:1787857751.024385:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857751.024387:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70c00, rc 0) 00000100:00100000:0.0:1787857751.024445:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+87:26535:x1874704171635072:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 700us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857751.024453:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 952 00000100:00080000:2.0:1787857751.024707:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857751.031176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857751.031278:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171635200 00000100:00100000:1.0:1787857751.031303:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171635200 00000100:00100000:1.0:1787857751.031391:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 243 00000100:00100000:1.0:1787857751.031401:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171635200:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857751.031419:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857751.031437:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c078 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38e1 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857751.031492:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188232064:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857751.031578:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f540 going to sleep for 11 seconds 00000100:00080000:2.0:1787857751.031676:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1787857751.034985:0:8490:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787857751.034996:0:8490:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb mtime: 0 -> 1787857750 00002000:00010000:1.0:1787857751.034998:0:8490:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb atime: 0 -> 1787857750 00002000:00010000:1.0:1787857751.035000:0:8490:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb ctime: 0 -> 1787857750 00000100:00100000:1.0:1787857751.035027:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188232064:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857751.035078:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c078 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e1 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.035106:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c078 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e1 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.035122:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:1.0:1787857751.035195:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171635200:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3795us (4030us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857751.035205:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 243 00000100:00100000:3.0:1787857751.038281:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857751.038444:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171635328 00000100:00100000:1.0:1787857751.038469:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171635328 00000100:00100000:1.0:1787857751.038525:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 953 00000100:00100000:1.0:1787857751.038535:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+87:26535:x1874704171635328:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857751.038557:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857751.038580:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c07f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38e8 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.038656:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.038670:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.038682:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857751.038759:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:1.0:1787857751.038763:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857751.038784:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.038807:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c07f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 89 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.038852:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 88 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.038861:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857751.038864:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857751.038867:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052000, rc 0) 00000100:00100000:1.0:1787857751.038925:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+88:26535:x1874704171635328:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 391us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857751.038933:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 953 00000100:00100000:2.0:1787857751.042174:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857751.042270:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171635456 00000100:00100000:0.0:1787857751.042281:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171635456 00000100:00100000:0.0:1787857751.042357:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 244 00000100:00100000:0.0:1787857751.042367:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171635456:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857751.042384:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857751.042399:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087843ee3/0xd3f183cab4a7c08d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38ef expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857751.042453:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188232192:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857751.042527:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857751.044574:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188232192:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857751.044613:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087843ee3/0xd3f183cab4a7c08d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38ef expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.044639:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087843ee3/0xd3f183cab4a7c08d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38ef expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.044652:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:0.0:1787857751.044739:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171635456:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2373us (2574us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857751.044747:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 244 00000100:00100000:3.0:1787857751.050284:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857751.050450:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171635712 00000100:00100000:0.0:1787857751.050461:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171635712 00000100:00100000:0.0:1787857751.050528:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 954 00000100:00100000:0.0:1787857751.050539:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+88:26535:x1874704171635712:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857751.050902:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 136 off11456 00000100:00100000:0.0:1787857751.050994:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+88:26535:x1874704171635712:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 457us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857751.051001:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 954 00000001:00080000:2.0:1787857751.511356:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967908 is committed 00000001:00080000:2.0:1787857751.511376:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967907 is committed 00000001:00080000:2.0:1787857751.511399:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967909 is committed 00010000:00010000:2.0:1787857751.790127:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857751.798695:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857751.798703:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857751.799453:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 25 count 3 00000040:00080000:1.0:1787857751.799463:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857751.803551:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188232320:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857751.803660:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857751.809940:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188232320:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857751.810812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857751.811121:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171635840 00000100:00100000:0.0:1787857751.811130:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171635840 00000100:00100000:0.0:1787857751.811194:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 955 00000100:00100000:0.0:1787857751.811205:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:26545:x1874704171635840:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857751.811247:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857751.811367:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:26545:x1874704171635840:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 163us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857751.811375:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 955 00000100:00100000:2.0:1787857751.825524:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857751.835004:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171636096 00000100:00100000:1.0:1787857751.835156:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171636096 00000100:00100000:1.0:1787857751.835239:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 956 00000100:00100000:1.0:1787857751.835251:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:26545:x1874704171636096:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857751.835272:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857751.835297:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c094 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38f6 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.836360:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c09b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.836381:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c09b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.836468:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c09b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857751.836486:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:1.0:1787857751.836691:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c094 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38f6 expref: 44 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.837505:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c09b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38f6 expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.837523:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:1.0:1787857751.837526:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857751.837530:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:1.0:1787857751.838444:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26545:x1874704171636096:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3190us (12926us total) trans 4294967910 rc 0/0 00000100:00100000:1.0:1787857751.838454:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 956 00000100:00100000:0.0:1787857751.853309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857751.853396:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171636224 00000100:00100000:1.0:1787857751.853407:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171636224 00000100:00100000:1.0:1787857751.853488:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 245 00000100:00100000:1.0:1787857751.853499:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171636224:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857751.853548:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.853571:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.853580:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857751.853585:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857751.853590:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.853627:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857751.853641:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 11 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857751.853666:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188232448:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857751.854011:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5fc00 going to sleep for 11 seconds 00000100:00080000:0.0:1787857751.854390:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857751.869354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857751.869373:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188232448:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857751.869387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857751.869403:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857751.869430:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171636480 00000100:00100000:0.0:1787857751.869430:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171636352 00000100:00100000:2.0:1787857751.869437:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171636480 00000100:00100000:0.0:1787857751.869437:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171636352 00002000:00100000:0.0:1787857751.869486:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x15:0x0] (0->157) req@ffff99990153cf00 x1874704171636352/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:397/0 lens 648/0 e 0 to 0 dl 1787857762 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787857751.869494:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 41 00002000:00100000:0.0:1787857751.869497:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990153cf00 with x1874704171636352 ext(0->157) 00000100:00100000:2.0:1787857751.869503:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2350:x1874704171636480:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857751.869504:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 12 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.869517:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 12 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.869518:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787857751.869523:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99990153cf00 00000100:00100000:0.0:1787857751.869541:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00010000:00010000:2.0:1787857751.869543:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c09b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38f6 expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857751.869548:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171636352:12345-192.168.204.36@tcp:4:cp.0 00010000:00010000:2.0:1787857751.869570:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:2.0:1787857751.869576:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857751.869626:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:2350:x1874704171636480:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 124us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857751.869633:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:0.0:1787857751.871156:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2348:x1874704171636352:12345-192.168.204.36@tcp:4:cp.0 Request processed in 1598us (1802us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787857751.871180:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00002000:00100000:0.0:1787857751.871190:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x15:0x0] (0->157) req@ffff99990153cf00 x1874704171636352/t4294967351(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:397/0 lens 648/448 e 0 to 0 dl 1787857762 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857751.871200:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990153cf00 with x1874704171636352 ext(0->157) 00010000:00010000:0.0:1787857751.871209:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 14 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.871225:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 14 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857751.871243:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99990153cf00 00000100:00100000:2.0:1787857751.888690:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857751.888856:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171636608 00000100:00100000:3.0:1787857751.888865:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171636608 00010000:00010000:3.0:1787857751.888909:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 14 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857751.888947:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 288 00000100:00100000:3.0:1787857751.888956:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2348:x1874704171636608:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857751.888972:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857751.888995:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 14 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.889009:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 14 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.889046:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c055 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38d3 expref: 14 pid: 6711 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.889064:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857751.889077:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857751.889084:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.889094:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.889122:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857751.889171:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171636608:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 215us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857751.889179:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 288 00010000:00010000:0.0:1787857751.889598:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.889608:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.889633:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.889641:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.889648:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.889655:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857751.889659:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.889667:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.889679:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.889700:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098b7f6cc/0xd3f183cab4a7c0a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857751.889772:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2347:x1874704171636224:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 36274us (36472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857751.889780:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 245 00000100:00100000:3.0:1787857751.898561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857751.899998:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171636864 00000100:00100000:0.0:1787857751.900029:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171636864 00000100:00100000:0.0:1787857751.900184:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 957 00000100:00100000:0.0:1787857751.900197:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26545:x1874704171636864:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857751.900333:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26545:x1874704171636864:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 138us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857751.900342:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 957 00000100:00100000:2.0:1787857751.915800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857751.915857:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171636992 00000100:00100000:2.0:1787857751.915865:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171636992 00000100:00100000:2.0:1787857751.915920:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 246 00000100:00100000:2.0:1787857751.915930:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171636992:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857751.915949:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857751.915969:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd38fd expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857751.915996:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 158, mtime: 0x6a908b56, atime: 0x0, ctime: 0x6a908b56, blocks: 0x1 00010000:00010000:2.0:1787857751.916037:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=575s v=(0 0) 00010000:00010000:2.0:1787857751.916042:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857751.916051:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.916069:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.916083:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74800, rc 0) 00000100:00100000:2.0:1787857751.916152:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171636992:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 223us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857751.916159:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 246 00000100:00100000:3.0:1787857751.923324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857751.924185:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171637248 00000100:00100000:2.0:1787857751.924198:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171637248 00000100:00100000:2.0:1787857751.924265:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 958 00000100:00100000:2.0:1787857751.924275:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26545:x1874704171637248:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857751.924406:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26545:x1874704171637248:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 132us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857751.924415:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 958 00000100:00100000:3.0:1787857751.934911:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857751.934986:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171637376 00000100:00100000:1.0:1787857751.934996:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171637376 00002000:00100000:1.0:1787857751.935061:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x15:0x0] (0->4095) req@ffff9998efab4780 x1874704171637376/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:397/0 lens 488/0 e 0 to 0 dl 1787857762 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857751.935073:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab4780 with x1874704171637376 ext(0->4095) 00002000:00010000:1.0:1787857751.935079:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efab4780 00000100:00100000:1.0:1787857751.935112:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00100000:1.0:1787857751.935122:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171637376:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857751.935328:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171637376:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 207us (427us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857751.935337:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 90 00002000:00100000:1.0:1787857751.935344:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x15:0x0] (0->4095) req@ffff9998efab4780 x1874704171637376/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:397/0 lens 488/4536 e 0 to 0 dl 1787857762 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857751.935351:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab4780 with x1874704171637376 ext(0->4095) 00002000:00010000:1.0:1787857751.935354:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efab4780 00000100:00100000:2.0:1787857751.946617:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857751.947135:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171637504 00000100:00100000:3.0:1787857751.947147:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171637504 00000100:00100000:3.0:1787857751.949803:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 959 00000100:00100000:3.0:1787857751.949849:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26545:x1874704171637504:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857751.949871:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857751.949892:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c0b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3904 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.949927:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.949940:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.949953:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.950070:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c0b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.950089:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857751.950097:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:3.0:1787857751.950100:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857751.950104:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52e00, rc 0) 00000100:00100000:3.0:1787857751.950178:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26545:x1874704171637504:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 362us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857751.950185:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 959 00000100:00100000:1.0:1787857751.962722:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857751.962875:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171637632 00000100:00100000:3.0:1787857751.962887:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171637632 00000100:00100000:3.0:1787857751.962948:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 960 00000100:00100000:3.0:1787857751.962958:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26545:x1874704171637632:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857751.962990:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857751.963139:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26545:x1874704171637632:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 181us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857751.963146:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 960 00000100:00100000:1.0:1787857751.973574:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857751.974584:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171637760 00000100:00100000:0.0:1787857751.974596:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171637760 00000100:00100000:0.0:1787857751.974724:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 247 00000100:00100000:0.0:1787857751.974735:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171637760:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857751.974781:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974798:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787857751.974803:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857751.974808:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974871:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974905:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974913:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974922:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974930:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857751.974934:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974944:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974960:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.974968:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c0c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857751.975333:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171637760:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 599us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857751.975341:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 247 00000100:00100000:0.0:1787857751.994357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857751.994500:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171638016 00000100:00100000:2.0:1787857751.994511:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171638016 00000100:00100000:2.0:1787857751.994576:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 961 00000100:00100000:2.0:1787857751.994587:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26545:x1874704171638016:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857751.994673:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.994693:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.994703:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.994737:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.994752:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 43 pid: 5856 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857751.994782:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901220780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188232576:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857751.995089:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857751.997511:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901220780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188232576:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857751.997543:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857751.998394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857751.998517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171638144 00000100:00100000:2.0:1787857751.998525:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171638144 00010000:00010000:2.0:1787857751.998559:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 44 pid: 5856 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857751.998596:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 289 00000100:00100000:2.0:1787857751.998605:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171638144:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857751.998621:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857751.998628:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 44 pid: 5856 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.998639:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 44 pid: 5856 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.998663:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c0be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3904 expref: 44 pid: 5856 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.998677:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:2.0:1787857751.998683:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.998701:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.998708:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857751.998741:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857751.998790:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2349:x1874704171638144:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 184us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857751.998798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 289 00010000:00010000:0.0:1787857751.998936:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.998944:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.999165:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.999173:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.999179:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.999185:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857751.999190:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.999197:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.999207:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:0.0:1787857751.999209:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857751.999222:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857751.999228:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c0cc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857751.999362:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26545:x1874704171638016:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 4776us (5015us total) trans 4294967911 rc 0/0 00000100:00100000:0.0:1787857751.999371:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 961 00000040:00080000:2.0:1787857751.999622:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857751.999627:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857752.000175:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857752.000185:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857752.023511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857752.023555:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171638400 00000100:00100000:3.0:1787857752.023564:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171638400 00000100:00100000:3.0:1787857752.023627:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00100000:3.0:1787857752.023638:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26545:x1874704171638400:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857752.023922:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:26545:x1874704171638400:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 285us (422us total) trans 4294967912 rc 0/0 00000100:00100000:3.0:1787857752.023931:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00080000:0.0:1787857752.028269:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787857752.084411:0:19234:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857752.084421:0:19234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857752.084469:0:19234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 25 count 3 00000040:00080000:3.0:1787857752.084474:0:19234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857752.171565:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857752.171861:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171638528 00000100:00100000:0.0:1787857752.171872:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171638528 00000100:00100000:0.0:1787857752.171925:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 248 00000100:00100000:0.0:1787857752.171935:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171638528:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857752.171954:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857752.171971:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd390b expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.171996:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857752.172001:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857752.172020:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.172039:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.172052:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71e00, rc 0) 00000100:00100000:0.0:1787857752.172121:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+13:2347:x1874704171638528:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 187us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857752.172135:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 248 00000100:00100000:3.0:1787857752.180350:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857752.180862:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171638784 00000100:00100000:0.0:1787857752.180874:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171638784 00000100:00100000:0.0:1787857752.181302:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 962 00000100:00100000:0.0:1787857752.181318:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+87:26546:x1874704171638784:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857752.181342:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857752.181364:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c0da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3912 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.181479:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c0e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.181494:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.181506:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857752.181518:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:0.0:1787857752.181659:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c0da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3912 expref: 90 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.181680:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c0e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3912 expref: 89 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.181689:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:0.0:1787857752.181692:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787857752.181695:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70600, rc 0) 00000100:00100000:0.0:1787857752.181790:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+89:26546:x1874704171638784:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 477us (1451us total) trans 4294967913 rc 0/0 00000100:00100000:0.0:1787857752.185269:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 962 00000100:00100000:3.0:1787857752.197472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857752.199234:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171638912 00000100:00100000:1.0:1787857752.199249:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171638912 00000100:00100000:1.0:1787857752.199315:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 249 00000100:00100000:1.0:1787857752.199331:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2348:x1874704171638912:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:1.0:1787857752.199378:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.199399:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.199410:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.199418:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857752.199423:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857752.199428:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 5/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.199464:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.199480:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 13 pid: 6711 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857752.199495:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188232704:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857752.199597:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.199619:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 12 pid: 8490 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857752.199629:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188232832:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857752.199655:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857752.209117:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857752.209142:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188232704:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857752.209151:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171639040 00000100:00100000:3.0:1787857752.209159:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171639040 00000100:00100000:0.0:1787857752.209162:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188232832:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857752.209203:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 14 pid: 6711 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.209216:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857752.209243:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 290 00000100:00100000:3.0:1787857752.209253:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+14:2349:x1874704171639040:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857752.209268:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857752.209290:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 14 pid: 6711 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.209315:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 14 pid: 6711 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.209341:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c0d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd390b expref: 14 pid: 6711 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.209373:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857752.209436:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171639040:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 183us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857752.209445:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 290 00000100:00100000:3.0:1787857752.209494:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857752.209699:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171639168 00000100:00100000:2.0:1787857752.209705:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171639168 00010000:00010000:2.0:1787857752.209728:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 13 pid: 8490 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857752.209753:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 291 00000100:00100000:2.0:1787857752.209759:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171639168:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857752.209768:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857752.209778:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 13 pid: 8490 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857752.209790:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 13 pid: 8490 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857752.209843:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb681617/0xd3f183cab4a7c0b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38fd expref: 13 pid: 8490 timeout: 676 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857752.209856:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857752.209860:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857752.209866:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857752.209876:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857752.209896:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857752.209927:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171639168:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 167us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857752.209934:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 291 00010000:00010000:0.0:1787857752.210032:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.210042:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.210069:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.210078:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.210087:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.210153:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857752.210158:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.210175:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.210187:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.210194:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c0ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857752.210261:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171638912:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 10931us (12799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857752.210269:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 249 00000100:00100000:2.0:1787857752.229278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857752.229376:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171639424 00000100:00100000:3.0:1787857752.229386:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171639424 00000100:00100000:3.0:1787857752.229442:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 192 00000100:00100000:3.0:1787857752.229452:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:26546:x1874704171639424:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:3.0:1787857752.229520:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x19:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c0e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3912 expref: 89 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857752.229803:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967914 00000001:00080000:3.0:1787857752.232200:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967915 00010000:00010000:3.0:1787857752.232299:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.232323:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.232331:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 92 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.232338:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.232378:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 92 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.232403:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 92 pid: 7656 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857752.232419:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188232960:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857752.233276:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.233289:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 43 pid: 5857 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857752.233301:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188233088:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857752.233336:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857752.271953:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857752.272041:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171639552 00000100:00100000:1.0:1787857752.272058:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171639552 00010000:00010000:1.0:1787857752.272112:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 93 pid: 7656 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857752.272156:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 292 00000100:00100000:1.0:1787857752.272167:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+93:2349:x1874704171639552:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857752.272185:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857752.272193:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 93 pid: 7656 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.272207:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 93 pid: 7656 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.272232:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:1.0:1787857752.272238:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.272249:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.272268:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857752.272331:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+93:2349:x1874704171639552:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 165us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857752.272340:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 292 00010000:00010000:3.0:1787857752.272967:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c071 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38da expref: 92 pid: 7656 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857752.272988:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188232960:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857752.272999:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188233088:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857752.273038:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857752.280278:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857752.283356:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171639680 00000100:00100000:3.0:1787857752.283374:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171639680 00010000:00010000:3.0:1787857752.283427:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 44 pid: 5857 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857752.283492:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 293 00000100:00100000:3.0:1787857752.283504:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171639680:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857752.283522:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857752.283530:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 44 pid: 5857 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.283545:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 44 pid: 5857 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.283570:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c040 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38c5 expref: 44 pid: 5857 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.283585:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:3.0:1787857752.283591:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.283601:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.283609:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.283638:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857752.283778:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2349:x1874704171639680:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 202us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857752.283788:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 293 00010000:00010000:3.0:1787857752.283875:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.283890:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857752.284038:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967916 00000001:00080000:3.0:1787857752.285541:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967917 00000001:00080000:3.0:1787857752.285629:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967918 00000100:00100000:3.0:1787857752.286176:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188233216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787857752.286249:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857752.286284:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857752.286473:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188233216 00000100:00100000:0.0:1787857752.286481:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188233216 00000100:00100000:0.0:1787857752.286554:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787857752.286570:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188233216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787857752.286660:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188233216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857752.286668:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787857752.286758:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857752.286798:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188233216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787857752.287691:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967919 00000100:00100000:3.0:1787857752.287781:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188233344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787857752.288297:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857752.288337:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f73cf240 going to sleep for 11 seconds 00000100:00100000:1.0:1787857752.288465:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188233344 00000100:00100000:1.0:1787857752.288473:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188233344 00000100:00100000:1.0:1787857752.288524:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787857752.288534:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188233344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857752.288741:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188233344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 208us (445us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787857752.288749:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787857752.288959:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188233344:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1787857752.288988:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.288998:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.289017:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.289024:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857752.289028:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.289056:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.289074:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:3.0:1787857752.289078:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787857752.289084:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.289212:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857752.289431:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x3d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787857752.289587:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 64 off9032 00000004:00080000:3.0:1787857752.289598:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 576339780226ns, next at 577339778036ns, rc = 0 00000001:00080000:3.0:1787857752.289606:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967920 00010000:00010000:3.0:1787857752.289645:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d8797f00) 00010000:00010000:3.0:1787857752.289648:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857752.289655:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c0e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3912 expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857752.289949:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:26546:x1874704171639424:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 60497us (60682us total) trans 4294967921 rc 0/0 00000100:00100000:3.0:1787857752.289958:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 192 00000020:00080000:3.0:1787857752.289964:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787857752.336660:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857752.336698:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171639808 00000100:00100000:3.0:1787857752.336706:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171639808 00000100:00100000:3.0:1787857752.336764:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 963 00000100:00100000:3.0:1787857752.336775:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:26547:x1874704171639808:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857752.338947:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857752.338975:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3919 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339318:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339333:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339346:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339363:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339371:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339378:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339738:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c112 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339747:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339755:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857752.339790:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:3.0:1787857752.339843:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857752.339868:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339880:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339888:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339895:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339902:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339908:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857752.339912:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339920:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339933:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:3.0:1787857752.339936:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857752.339940:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339947:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339958:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339972:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339979:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339984:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857752.339987:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.339993:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.340000:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998d1291100) 00010000:00010000:3.0:1787857752.340013:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857752.340017:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.340023:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c10b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.340248:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c0fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3919 expref: 97 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.340264:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c112 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3919 expref: 96 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857752.340272:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d1291200) 00010000:00010000:3.0:1787857752.340274:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857752.340281:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52200, rc 0) 00000100:00100000:3.0:1787857752.340363:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+96:26547:x1874704171639808:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3589us (3711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857752.340372:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 963 00000100:00100000:2.0:1787857752.364097:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857752.364185:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171640064 00000100:00100000:0.0:1787857752.364198:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171640064 00000100:00100000:0.0:1787857752.364277:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:0.0:1787857752.364289:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+96:26547:x1874704171640064:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:0.0:1787857752.364308:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857752.364350:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c112 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3919 expref: 96 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857752.364367:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998d1291200) 00010000:00010000:0.0:1787857752.364378:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857752.364440:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:26547:x1874704171640064:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 153us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857752.364448:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:2.0:1787857752.367931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857752.368020:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171640192 00000100:00100000:1.0:1787857752.368029:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171640192 00000100:00100000:1.0:1787857752.368094:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 964 00000100:00100000:1.0:1787857752.368103:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+95:26547:x1874704171640192:12345-192.168.204.36@tcp:58:lfs.0 00010000:00010000:1.0:1787857752.368214:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.368232:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857752.368244:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857752.368468:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 136 off11592 00000100:00100000:1.0:1787857752.368564:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+95:26547:x1874704171640192:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 461us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857752.368591:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 964 00010000:00010000:3.0:1787857752.816584:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857752.942148:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857752.942173:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188233472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857752.942251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857752.943189:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188233472 00000100:00100000:2.0:1787857752.943199:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188233472 00000100:00080000:3.0:1787857752.943260:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857752.943270:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787857752.943281:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188233472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857752.944272:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857752.945001:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188233472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1710us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857752.945013:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787857752.945043:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188233472:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787857753.007064:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857753.007074:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857753.007214:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 3 00000040:00080000:2.0:1787857753.007221:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857753.007354:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901222580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188233600:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857753.007441:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857753.015583:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857753.015669:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171640320 00000100:00100000:0.0:1787857753.015680:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171640320 00000100:00100000:0.0:1787857753.015771:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 965 00000100:00100000:0.0:1787857753.015783:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:26557:x1874704171640320:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857753.015854:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857753.017061:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:26557:x1874704171640320:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 1273us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857753.017072:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 965 00000100:00100000:3.0:1787857753.029128:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901222580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188233600:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857753.034946:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.037884:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171640448 00000100:00100000:3.0:1787857753.037900:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171640448 00000100:00100000:2.0:1787857753.038649:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 966 00000100:00100000:2.0:1787857753.038661:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26557:x1874704171640448:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787857753.038891:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.038910:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.038925:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.038942:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.038949:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.038957:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039010:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039018:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039024:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857753.039059:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:2.0:1787857753.039063:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857753.039076:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039087:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039092:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039099:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039105:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857753.039109:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039116:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039126:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857753.039211:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857753.039217:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039224:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c120 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039236:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039242:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039247:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039252:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857753.039255:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039260:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039267:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8876c877 (ffff9998e18d9200) 00010000:00010000:2.0:1787857753.039269:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857753.039406:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039414:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c127 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039432:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039445:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039452:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039457:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857753.039460:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039467:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039475:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998c4eb6200) 00010000:00010000:2.0:1787857753.039477:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857753.039480:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.039486:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c12e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857753.039566:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26557:x1874704171640448:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 906us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857753.039575:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 966 00000100:00100000:2.0:1787857753.043402:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.043514:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171640704 00000100:00100000:3.0:1787857753.043523:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171640704 00000100:00100000:3.0:1787857753.043584:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 967 00000100:00100000:3.0:1787857753.043594:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26557:x1874704171640704:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857753.043614:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857753.043637:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c135 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3920 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.043738:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.043754:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.043776:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857753.043803:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:3.0:1787857753.043932:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.043940:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.043946:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.043952:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857753.043956:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.043964:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.043975:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998c4eb6200) 00010000:00010000:3.0:1787857753.043978:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857753.043983:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.044002:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c13c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.044042:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c135 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3920 expref: 45 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.044052:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857753.044054:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857753.044065:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c135 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3920 expref: 45 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.044076:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:3.0:1787857753.044133:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:26557:x1874704171640704:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 541us (741us total) trans 4294967922 rc 301/301 00000100:00100000:3.0:1787857753.044141:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 967 00000100:00100000:3.0:1787857753.054177:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.054222:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171640832 00000100:00100000:3.0:1787857753.054235:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171640832 00000100:00100000:3.0:1787857753.054299:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 968 00000100:00100000:3.0:1787857753.054310:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:26557:x1874704171640832:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857753.054362:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857753.054471:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:26557:x1874704171640832:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 162us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857753.054479:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 968 00000100:00100000:0.0:1787857753.065646:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.065749:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171641088 00000100:00100000:3.0:1787857753.065767:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171641088 00000100:00100000:3.0:1787857753.065852:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 969 00000100:00100000:3.0:1787857753.065864:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:26557:x1874704171641088:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857753.065890:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857753.065916:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c14a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3927 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.067965:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c151 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.067987:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.068020:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857753.068034:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00010000:00010000:3.0:1787857753.068097:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c14a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3927 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.068114:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c151 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3927 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.068124:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857753.068128:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857753.068132:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52e00, rc 0) 00000100:00100000:3.0:1787857753.068209:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:26557:x1874704171641088:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2347us (2576us total) trans 4294967923 rc 0/0 00000100:00100000:3.0:1787857753.068219:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 969 00000100:00100000:3.0:1787857753.076259:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857753.078003:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171641344 00000100:00100000:1.0:1787857753.078016:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171641344 00000100:00100000:1.0:1787857753.079032:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 970 00000100:00100000:1.0:1787857753.079047:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:26557:x1874704171641344:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857753.079104:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857753.079132:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c151 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3927 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.079148:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d1291100) 00010000:00010000:1.0:1787857753.079159:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857753.079183:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.079197:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.079206:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.079239:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.079254:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 94 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857753.079303:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188233728:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857753.079517:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857753.083596:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188233728:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857753.083629:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.083722:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857753.084946:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171641472 00000100:00100000:2.0:1787857753.084956:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171641472 00010000:00010000:2.0:1787857753.085070:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 95 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857753.085139:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 294 00000100:00100000:2.0:1787857753.085150:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+95:2349:x1874704171641472:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857753.085170:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857753.085177:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 95 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.085189:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 95 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.085214:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c086 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd38e8 expref: 95 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.085233:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:2.0:1787857753.085239:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.085249:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.085257:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.085300:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857753.085371:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+94:2349:x1874704171641472:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 222us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857753.085389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 294 00010000:00010000:1.0:1787857753.085710:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.085720:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.085745:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.085757:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.085766:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086119:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086128:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086135:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086150:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857753.086154:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086161:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086172:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857753.086175:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857753.086179:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086185:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c15f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086195:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086200:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086205:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086209:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857753.086212:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086217:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086233:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x19f1fc7a (ffff9998c4eb6c00) 00010000:00010000:1.0:1787857753.086235:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857753.086238:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.086244:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c166 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x19f1fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857753.086311:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:26557:x1874704171641344:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 7268us (10065us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857753.086319:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 970 00000100:00080000:3.0:1787857753.090047:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857753.090187:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857753.090362:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171641600 00000100:00100000:0.0:1787857753.090373:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171641600 00000100:00100000:0.0:1787857753.090433:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 971 00000100:00100000:0.0:1787857753.090444:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:26557:x1874704171641600:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857753.090463:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857753.090487:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c16d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd392e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.090522:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.090545:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.090556:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.091133:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c16d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.091157:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.091167:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:0.0:1787857753.091169:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857753.091172:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71e00, rc 0) 00000100:00100000:0.0:1787857753.091284:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:26557:x1874704171641600:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 831us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857753.091296:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 971 00000100:00100000:0.0:1787857753.095532:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.096033:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171641856 00000100:00100000:3.0:1787857753.096044:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171641856 00000100:00100000:3.0:1787857753.096110:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 972 00000100:00100000:3.0:1787857753.096120:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:26557:x1874704171641856:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857753.096208:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.096226:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.096255:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857753.096564:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d1425e7 reply state 00000000518df818 transno 4294967924 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.096573:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857753.096680:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:26557:x1874704171641856:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 561us (1158us total) trans 4294967924 rc 0/0 00000100:00100000:3.0:1787857753.097486:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 972 00010000:00010000:3.0:1787857753.101053:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.101072:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.101080:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.101087:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857753.101096:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.101106:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.101125:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:3.0:1787857753.101127:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857753.101132:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.101159:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c17b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857753.108381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.108524:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171641984 00000100:00100000:3.0:1787857753.108534:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171641984 00000100:00100000:3.0:1787857753.108598:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 973 00000100:00100000:3.0:1787857753.108609:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:26557:x1874704171641984:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857753.108636:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857753.108660:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3935 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.108901:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.108919:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.108929:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:1.0:1787857753.108932:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857753.108936:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52a00, rc 0) 00000100:00100000:1.0:1787857753.109011:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:26557:x1874704171641984:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 404us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857753.109018:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 973 00000100:00100000:2.0:1787857753.113553:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857753.113678:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171642112 00000100:00100000:1.0:1787857753.113690:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171642112 00000100:00100000:1.0:1787857753.113757:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00100000:1.0:1787857753.113775:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:26557:x1874704171642112:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787857753.113972:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:26557:x1874704171642112:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 198us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857753.113979:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00100000:3.0:1787857753.128579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857753.128737:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171642368 00000100:00100000:0.0:1787857753.128748:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171642368 00000100:00100000:0.0:1787857753.128843:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:0.0:1787857753.128856:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:26557:x1874704171642368:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857753.129121:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:26557:x1874704171642368:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 267us (553us total) trans 4294967925 rc 0/0 00000100:00100000:0.0:1787857753.129145:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:0.0:1787857753.134248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.137694:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171642624 00000100:00100000:3.0:1787857753.137708:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171642624 00000100:00100000:3.0:1787857753.137784:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 974 00000100:00100000:3.0:1787857753.137795:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:26557:x1874704171642624:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857753.137949:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:26557:x1874704171642624:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 155us (3711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857753.137956:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 974 00000100:00100000:3.0:1787857753.146267:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857753.146486:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171642880 00000100:00100000:0.0:1787857753.146498:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171642880 00000100:00100000:0.0:1787857753.146568:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 975 00000100:00100000:0.0:1787857753.146579:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:26557:x1874704171642880:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857753.146602:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857753.146627:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c189 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd393c expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.146741:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.146768:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.146778:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.146854:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.146870:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 50 pid: 5856 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857753.146884:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188233856:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857753.146969:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb7fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857753.159963:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857753.161016:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171643008 00000100:00100000:1.0:1787857753.161029:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171643008 00010000:00010000:1.0:1787857753.161078:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 51 pid: 5856 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857753.161126:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 295 00000100:00100000:1.0:1787857753.161136:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171643008:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857753.161151:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857753.161157:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 51 pid: 5856 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.161171:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 51 pid: 5856 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.161197:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:1.0:1787857753.161203:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.161214:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.161221:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.161255:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857753.162003:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171643008:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 854us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857753.162013:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 295 00010000:00010000:0.0:1787857753.165025:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c182 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3935 expref: 50 pid: 5856 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857753.165055:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188233856:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857753.165082:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.165095:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.165101:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857753.165121:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00000004:00080000:0.0:1787857753.166663:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:0.0:1787857753.168105:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.168121:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.168129:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.168136:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857753.168140:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.168147:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.168164:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:0.0:1787857753.168176:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857753.168181:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.168186:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c190 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.168252:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c189 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd393c expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.168262:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:0.0:1787857753.168264:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857753.170431:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c189 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd393c expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.170467:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70000, rc 0) 00000100:00100000:0.0:1787857753.170558:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:26557:x1874704171642880:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 23976us (24298us total) trans 4294967926 rc 301/301 00000100:00100000:0.0:1787857753.170568:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 975 00000100:00100000:0.0:1787857753.180720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.181055:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171643264 00000100:00100000:3.0:1787857753.181065:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171643264 00000100:00100000:3.0:1787857753.181141:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:3.0:1787857753.181151:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6123850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:26557:x1874704171643264:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857753.182040:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6123850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:26557:x1874704171643264:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 887us (1328us total) trans 4294967927 rc 0/0 00000100:00100000:3.0:1787857753.182061:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:3.0:1787857753.186566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857753.186838:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171643392 00000100:00100000:0.0:1787857753.186850:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171643392 00000100:00100000:0.0:1787857753.186918:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 976 00000100:00100000:0.0:1787857753.186927:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:26557:x1874704171643392:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857753.186952:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857753.186973:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c19e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3943 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.187059:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c1a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.187082:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.187094:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857753.187134:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00000004:00200000:0.0:1787857753.187138:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857753.187168:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.187198:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c19e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3943 expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.187217:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3943 expref: 51 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.187226:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:0.0:1787857753.187229:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787857753.187232:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71000, rc 0) 00000100:00100000:0.0:1787857753.187579:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:26557:x1874704171643392:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 651us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857753.187587:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 976 00000100:00100000:2.0:1787857753.200210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857753.209844:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171643520 00000100:00100000:0.0:1787857753.209862:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171643520 00000100:00080000:2.0:1787857753.210050:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857753.210631:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 250 00000100:00100000:0.0:1787857753.210646:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171643520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857753.210666:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857753.210711:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd394a expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857753.210739:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857753.210760:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=577s v=(0 0) 00010000:00010000:0.0:1787857753.210766:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857753.210776:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.210797:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.210811:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70000, rc 0) 00000100:00100000:0.0:1787857753.211551:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171643520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 906us (11347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857753.211562:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 250 00000100:00100000:2.0:1787857753.233210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.233258:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171643776 00000100:00100000:3.0:1787857753.233270:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171643776 00000100:00100000:3.0:1787857753.233425:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 977 00000100:00100000:3.0:1787857753.233435:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:26557:x1874704171643776:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857753.233564:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:26557:x1874704171643776:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 130us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857753.233573:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 977 00000100:00100000:2.0:1787857753.240036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857753.240134:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171643904 00000100:00100000:1.0:1787857753.240143:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171643904 00000100:00100000:1.0:1787857753.240199:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 251 00000100:00100000:1.0:1787857753.240208:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:26557:x1874704171643904:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857753.240227:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857753.240245:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3951 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.240274:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.240399:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857753.240405:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857753.240412:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.240446:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.240460:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 10 pid: 6714 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857753.240485:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188233984:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857753.240574:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857753.244459:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188233984:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857753.244495:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.244502:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:0.0:1787857753.244515:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052600, rc 0) 00000100:00100000:3.0:1787857753.244528:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171644032 00000100:00100000:3.0:1787857753.244534:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171644032 00010000:00010000:3.0:1787857753.244565:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 11 pid: 6714 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857753.244588:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:26557:x1874704171643904:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 4381us (4562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857753.244594:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 296 00000100:00100000:0.0:1787857753.244596:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 251 00000100:00100000:3.0:1787857753.244602:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171644032:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857753.244614:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857753.244948:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 10 pid: 6714 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.244961:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 10 pid: 6714 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.245000:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ca54ad/0xd3f183cab4a7c1ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd394a expref: 10 pid: 6714 timeout: 677 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.245022:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857753.245027:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857753.245035:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 9 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.245045:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 9 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.245125:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 9 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.245140:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188234112:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857753.245208:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f73cf240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857753.253975:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188234112:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857753.254018:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857753.254075:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171644032:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 9471us (9571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857753.254086:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 296 00000100:00100000:2.0:1787857753.256227:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.256309:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171644160 00000100:00100000:3.0:1787857753.256320:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171644160 00002000:00100000:3.0:1787857753.256449:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x13:0x0] (0->157) req@ffff999901222580 x1874704171644160/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:399/0 lens 648/0 e 0 to 0 dl 1787857764 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857753.256460:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901222580 with x1874704171644160 ext(0->157) 00002000:00010000:3.0:1787857753.256466:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff999901222580 00000100:00100000:3.0:1787857753.256508:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 91 00000100:00100000:3.0:1787857753.256517:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171644160:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787857753.258207:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171644160:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 1682us (1982us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787857753.258218:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 91 00002000:00100000:3.0:1787857753.258228:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x13:0x0] (0->157) req@ffff999901222580 x1874704171644160/t4294967345(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:399/0 lens 648/448 e 0 to 0 dl 1787857764 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857753.258238:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901222580 with x1874704171644160 ext(0->157) 00002000:00010000:3.0:1787857753.258244:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff999901222580 00000100:00100000:3.0:1787857753.265937:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857753.266086:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171644288 00000100:00100000:0.0:1787857753.266096:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171644288 00000100:00100000:0.0:1787857753.266175:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 978 00000100:00100000:0.0:1787857753.266187:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:26557:x1874704171644288:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787857753.394214:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:26557:x1874704171644288:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 128015us (128275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857753.394228:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 978 00000001:00080000:2.0:1787857753.394267:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967926 is committed 00000001:00080000:2.0:1787857753.394280:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967913 is committed 00000001:00080000:2.0:1787857753.394298:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967927 is committed 00000001:00080000:2.0:1787857753.394310:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967921 is committed 00000004:00080000:2.0:1787857753.394314:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000020:00080000:2.0:1787857753.394331:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c6ed43c0 refcount 2 committed 0 result 0 batchid 15 00000020:00080000:2.0:1787857753.394335:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998ffaec700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998c5bfd480 00000020:00080000:2.0:1787857753.394338:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998ffaec800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff999901417000 00000020:00080000:2.0:1787857753.394779:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 15 committed batchid 14 00000020:00080000:2.0:1787857753.395021:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000100:00100000:2.0:1787857753.395041:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188234240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787857753.395098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857753.395165:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188234240 00000100:00100000:2.0:1787857753.395173:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188234240 00000100:00100000:2.0:1787857753.395212:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787857753.395221:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188234240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787857753.395246:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:21 count 1 00002000:00010000:2.0:1787857753.395279:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 158, mtime: 0x6a908b56, atime: 0x0, ctime: 0x6a908b56, blocks: 0x1 00010000:00010000:2.0:1787857753.395296:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.395314:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=577s v=(0 0) 00010000:00010000:2.0:1787857753.395319:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857753.395327:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.395343:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.395355:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.395363:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.395388:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857753.396958:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857753.396972:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.396996:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857753.397001:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.397011:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.397032:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.397040:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7c1ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.397065:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857753.397068:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857753.397070:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857753.399382:0:19286:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857753.399393:0:19286:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857753.399448:0:19286:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 3 00000040:00080000:0.0:1787857753.399455:0:19286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857753.401689:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188234240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6459us (6581us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787857753.401704:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000004:00080000:2.0:1787857753.401774:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999901223480/2, rc 0, transno 4294967353 00000100:00100000:2.0:1787857753.401782:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188234240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787857753.417800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.419042:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171644416 00000100:00100000:3.0:1787857753.419065:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171644416 00000100:00100000:3.0:1787857753.419122:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 253 00000100:00100000:3.0:1787857753.419132:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171644416:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787857753.488946:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00000100:00100000:2.0:1787857753.491062:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171644416:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 71920us (73261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857753.491081:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 253 00000100:00100000:0.0:1787857753.506238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.506309:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171644672 00000100:00100000:3.0:1787857753.506320:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171644672 00000100:00100000:3.0:1787857753.506385:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 979 00000100:00100000:3.0:1787857753.506396:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26557:x1874704171644672:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857753.506501:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857753.506528:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c1a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3943 expref: 42 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.506549:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:3.0:1787857753.506554:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857753.506584:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.506620:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.506631:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857753.506884:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3e237fc reply state 000000005175be8a transno 4294967928 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.506894:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857753.507009:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26557:x1874704171644672:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 614us (781us total) trans 4294967928 rc 0/0 00000100:00100000:3.0:1787857753.507016:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 979 00000100:00100000:3.0:1787857753.511299:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857753.511380:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.511394:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.511403:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.511409:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857753.511415:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.511423:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.511443:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:2.0:1787857753.511446:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857753.511451:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.511458:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c1c1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857753.511892:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171644800 00000100:00100000:0.0:1787857753.511913:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171644800 00000100:00100000:0.0:1787857753.511972:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 980 00000100:00100000:0.0:1787857753.511991:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26557:x1874704171644800:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857753.512016:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857753.512036:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3958 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.512101:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.512117:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.512135:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:0.0:1787857753.512137:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857753.512141:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857753.512398:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26557:x1874704171644800:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 418us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857753.512416:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 980 00000100:00100000:0.0:1787857753.527076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857753.527164:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171644928 00000100:00100000:1.0:1787857753.527176:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171644928 00000100:00100000:1.0:1787857753.527235:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 254 00000100:00100000:1.0:1787857753.527254:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171644928:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787857753.527535:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787857753.527539:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1787857750 00002000:00010000:1.0:1787857753.527542:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb atime from disk: 0 -> 1787857750 00002000:00010000:1.0:1787857753.527543:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1787857750 00002000:00010000:1.0:1787857753.527545:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787857753.527615:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171644928:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 363us (548us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787857753.527623:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 254 00000100:00100000:2.0:1787857753.531873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857753.532337:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171645184 00000100:00100000:1.0:1787857753.532347:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171645184 00000100:00100000:1.0:1787857753.532411:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 981 00000100:00100000:1.0:1787857753.532420:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:26557:x1874704171645184:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787857753.532489:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.532506:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.532516:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.532555:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.532569:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 43 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857753.532598:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188234368:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857753.532705:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b84600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857753.535555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857753.535585:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188234368:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857753.535620:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.539945:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171645312 00000100:00100000:3.0:1787857753.539962:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171645312 00010000:00010000:2.0:1787857753.541004:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 44 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857753.541050:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00100000:2.0:1787857753.541063:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171645312:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857753.541088:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857753.541095:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 44 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.541109:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 44 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.541135:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c174 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd392e expref: 44 pid: 5857 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.541149:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:2.0:1787857753.541156:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.541166:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.541174:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.541208:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857753.541269:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2349:x1874704171645312:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 209us (5722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857753.541278:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 297 00010000:00010000:1.0:1787857753.541508:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.541519:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.541548:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.541556:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.541563:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.541570:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857753.541574:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.541582:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.541593:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:1.0:1787857753.541604:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787857753.541609:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.541615:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1cf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857753.546141:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26557:x1874704171645184:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 13706us (14263us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787857753.546158:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 981 00000100:00100000:3.0:1787857753.556846:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857753.556954:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171645440 00000100:00100000:0.0:1787857753.556966:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171645440 00000100:00100000:0.0:1787857753.557037:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 255 00000100:00100000:0.0:1787857753.557047:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171645440:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857753.557089:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.557110:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.557119:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857753.557123:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857753.557128:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.557162:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 10 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.557180:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 10 pid: 8490 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857753.557196:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188234496:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857753.557284:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857753.561265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.561308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171645568 00000100:00100000:3.0:1787857753.561319:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171645568 00010000:00010000:3.0:1787857753.561363:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 11 pid: 8490 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.561404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 298 00000100:00100000:3.0:1787857753.561415:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171645568:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857753.561431:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857753.561458:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 11 pid: 8490 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.561490:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 11 pid: 8490 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.561522:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857753.561528:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857753.561534:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.561544:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.561568:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857753.561625:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171645568:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 212us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857753.561633:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 298 00010000:00010000:3.0:1787857753.561766:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001270dfee/0xd3f183cab4a7c1b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3951 expref: 10 pid: 8490 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.561781:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188234496:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857753.561801:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.562968:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.563009:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.563040:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.563049:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.563057:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.563064:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857753.563069:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.563079:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.563096:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.563105:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7c1d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857753.563206:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171645440:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 6158us (6399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857753.563215:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 255 00000100:00100000:3.0:1787857753.566051:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857753.566235:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171645824 00000100:00100000:2.0:1787857753.566248:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171645824 00000100:00100000:2.0:1787857753.566316:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 982 00000100:00100000:2.0:1787857753.566327:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:26557:x1874704171645824:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857753.566425:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.566443:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.566457:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.566707:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.566719:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.566727:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.566762:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.566776:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 43 pid: 7656 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857753.566791:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188234624:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857753.566912:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857753.581158:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857753.581285:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188234624:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857753.581312:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857753.586156:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171645952 00000100:00100000:1.0:1787857753.586174:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171645952 00010000:00010000:1.0:1787857753.586226:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 44 pid: 7656 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857753.586269:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 299 00000100:00100000:1.0:1787857753.586280:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2350:x1874704171645952:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857753.586299:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857753.586307:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 44 pid: 7656 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.586321:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 44 pid: 7656 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.586345:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c1c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3958 expref: 44 pid: 7656 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.586360:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:1.0:1787857753.586379:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.586388:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.586396:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.586425:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857753.586487:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2350:x1874704171645952:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 208us (5341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857753.586495:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 299 00010000:00010000:3.0:1787857753.586888:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857753.586897:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857753.587121:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967929 00000001:00080000:3.0:1787857753.587345:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967930 00000001:00080000:3.0:1787857753.587393:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967931 00000100:00100000:3.0:1787857753.587474:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188234752:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787857753.587544:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857753.587579:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f73cf540 going to sleep for 11 seconds 00000100:00100000:1.0:1787857753.588201:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188234752 00000100:00100000:1.0:1787857753.588209:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188234752 00000100:00100000:1.0:1787857753.588266:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787857753.588275:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188234752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787857753.588381:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188234752:12345-0@lo:1000:mdt00_002.0 Request processed in 106us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857753.588388:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787857753.588598:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188234752:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787857753.590128:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967932 00000100:00100000:3.0:1787857753.590218:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188234880:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787857753.590281:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857753.590315:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f73cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857753.590481:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188234880 00000100:00100000:1.0:1787857753.590488:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188234880 00000100:00100000:1.0:1787857753.590538:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787857753.590547:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188234880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787857753.590764:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1874704188234880:12345-0@lo:1000:mdt00_002.0 Request processed in 217us (482us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787857753.590772:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787857753.590907:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188234880:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787857753.591004:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967933 00010000:00010000:0.0:1787857753.591035:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591045:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591053:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591060:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857753.591065:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591073:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591090:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:0.0:1787857753.591094:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857753.591099:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591106:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c1e4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591136:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591142:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591149:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591164:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857753.591167:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591174:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591183:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998c4eb6200) 00010000:00010000:0.0:1787857753.591185:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857753.591189:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591195:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c119 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591219:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591231:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591241:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591248:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591254:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591259:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591269:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857753.591272:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591278:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591286:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998c4eb6200) 00010000:00010000:0.0:1787857753.591288:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857753.591291:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591297:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c1eb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591308:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591314:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591320:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591325:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857753.591328:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591334:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591351:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998c4eb6200) 00010000:00010000:0.0:1787857753.591353:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857753.591356:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857753.591362:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c1dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857753.591520:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:26557:x1874704171645824:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 25192us (25477us total) trans 4294967934 rc 0/0 00000100:00100000:0.0:1787857753.591529:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 982 00000020:00080000:0.0:1787857753.591534:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1787857753.593882:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857753.593890:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857753.594391:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787857753.594400:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857753.596181:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857753.596310:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171646208 00000100:00100000:1.0:1787857753.596320:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171646208 00000100:00100000:1.0:1787857753.596378:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:1.0:1787857753.596388:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:26557:x1874704171646208:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787857753.597159:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x1a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787857753.597282:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967935 00010000:00010000:1.0:1787857753.597334:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.597352:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.597364:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.597372:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.597378:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.597385:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857753.597409:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857753.597495:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:26557:x1874704171646208:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1107us (1321us total) trans 4294967936 rc 0/0 00000100:00100000:1.0:1787857753.597505:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 196 00000020:00080000:1.0:1787857753.597510:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787857753.597673:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857753.597681:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.597695:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857753.597699:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.597706:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.597720:0:17404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff9998c4eb6c00) 00010000:00010000:2.0:1787857753.597723:0:17404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787857753.597728:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.597734:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c1f2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857753.597752:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857753.597754:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857753.597756:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857753.838114:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857754.192293:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857754.192346:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857754.192379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857754.192420:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857754.192437:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857754.192460:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857754.192486:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857754.192519:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171646720 00000100:00100000:0.0:1787857754.192530:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171646720 00000100:00100000:0.0:1787857754.192590:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171646592 00000100:00100000:0.0:1787857754.192593:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171646592 00000100:00100000:0.0:1787857754.192607:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171646976 00000100:00100000:0.0:1787857754.192609:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171646976 00000100:00100000:0.0:1787857754.192618:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171647104 00000100:00100000:0.0:1787857754.192620:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171647104 00000100:00100000:0.0:1787857754.192636:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 368 00000100:00100000:0.0:1787857754.192646:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171646720:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857754.192765:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171646720:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 119us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857754.192773:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 368 00000100:00100000:0.0:1787857754.192790:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 369 00000100:00100000:0.0:1787857754.192796:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171646592:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857754.192855:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171646592:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 59us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857754.192862:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 369 00000100:00100000:0.0:1787857754.192875:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 370 00000100:00100000:0.0:1787857754.192881:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171646976:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857754.192905:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171646976:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857754.192912:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 370 00000100:00100000:0.0:1787857754.192922:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 371 00000100:00100000:0.0:1787857754.192929:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171647104:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857754.192949:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171647104:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857754.192956:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 371 00000100:00080000:0.0:1787857754.192987:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857754.192992:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857754.193178:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171646464 00000100:00100000:1.0:1787857754.193183:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171646464 00000100:00100000:1.0:1787857754.193221:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171646848 00000100:00100000:1.0:1787857754.193224:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171646848 00000100:00100000:1.0:1787857754.193253:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 379 00000100:00100000:1.0:1787857754.193259:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:2347:x1874704171646464:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857754.193296:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+85:2347:x1874704171646464:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857754.193303:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 379 00000100:00100000:1.0:1787857754.193315:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 380 00000100:00100000:1.0:1787857754.193322:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2348:x1874704171646848:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857754.193345:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2348:x1874704171646848:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857754.193351:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 380 00000100:00080000:1.0:1787857754.193364:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857754.193856:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171646336 00000100:00100000:3.0:1787857754.193862:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171646336 00000100:00100000:3.0:1787857754.193895:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 555 00000100:00100000:3.0:1787857754.193901:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171646336:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857754.193930:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171646336:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857754.193937:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 555 00000100:00100000:1.0:1787857754.478111:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901221a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188235264:0@lo:400:kworker.0 00000100:00100000:3.0:1787857754.478245:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188235392:0@lo:400:kworker.0 00000100:00100000:0.0:1787857754.478329:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188235136:0@lo:400:kworker.0 00000100:00100000:2.0:1787857754.478488:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188235008:0@lo:400:kworker.0 00000100:00100000:3.0:1787857754.479795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857754.480205:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188235392 00000100:00100000:3.0:1787857754.480214:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188235392 00000100:00100000:3.0:1787857754.481024:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787857754.481046:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188235392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857754.481208:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188235392:12345-0@lo:400:kworker.0 Request processed in 169us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857754.481216:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787857754.481291:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188235392:0@lo:400:kworker.0 00000100:00100000:0.0:1787857754.483317:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857754.483522:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188235648:0@lo:400:kworker.0 00000100:00100000:0.0:1787857754.483595:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857754.483756:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188235648 00000100:00100000:0.0:1787857754.483765:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188235648 00000100:00100000:0.0:1787857754.484111:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787857754.484123:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1874704188235648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857754.484180:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1874704188235648:12345-0@lo:400:kworker.0 Request processed in 58us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857754.484187:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787857754.484235:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188235648:0@lo:400:kworker.0 00000100:00080000:0.0:1787857754.484284:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857754.484288:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857754.484517:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188235136 00000100:00100000:3.0:1787857754.484523:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188235136 00000100:00100000:3.0:1787857754.484569:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1787857754.484578:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188235136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857754.485973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857754.486138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857754.486185:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188235520:0@lo:400:kworker.0 00000100:00100000:2.0:1787857754.486222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857754.486261:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188235264 00000100:00100000:2.0:1787857754.486269:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188235264 00000100:00100000:2.0:1787857754.486308:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188235520 00000100:00100000:2.0:1787857754.486311:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188235520 00000100:00100000:2.0:1787857754.486326:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787857754.486333:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188235264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857754.486531:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188235008 00000100:00100000:1.0:1787857754.486536:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188235008 00000100:00100000:1.0:1787857754.486568:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1787857754.486575:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188235008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857754.486619:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188235008:12345-0@lo:400:kworker.0 Request processed in 45us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857754.486626:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1787857754.486672:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188235008:0@lo:400:kworker.0 00000100:00100000:1.0:1787857754.486713:0:7656:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787857754.486726:0:7656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:1.0:1787857754.486809:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857754.487057:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188235136:12345-0@lo:400:kworker.0 Request processed in 2478us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857754.487058:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188235264:12345-0@lo:400:kworker.0 Request processed in 722us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857754.487073:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1787857754.487445:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787857754.487462:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787857754.487470:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188235520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857754.487511:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188235520:12345-0@lo:400:kworker.0 Request processed in 43us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857754.487517:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787857754.487550:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188235520:0@lo:400:kworker.0 00000100:00100000:2.0:1787857754.487579:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901221a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188235264:0@lo:400:kworker.0 00000100:00100000:2.0:1787857754.487619:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188235136:0@lo:400:kworker.0 00010000:00010000:2.0:1787857754.862069:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857754.993141:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188235776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857754.993215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857754.993260:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188235776 00000100:00100000:0.0:1787857754.993267:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188235776 00000100:00100000:0.0:1787857754.993313:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787857754.993321:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188235776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857754.993351:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 74776576 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857754.993390:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188235776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857754.993397:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787857754.993466:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188235776:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787857755.044062:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967351 is committed 00000001:00080000:3.0:1787857755.044082:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967352 is committed 00000001:00080000:3.0:1787857755.044097:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00000040:00080000:2.0:1787857755.370038:0:19340:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857755.370049:0:19340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857755.370094:0:19340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 3 00000040:00080000:2.0:1787857755.370099:0:19340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857755.464938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857755.465052:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171647360 00000100:00100000:1.0:1787857755.465062:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171647360 00000100:00100000:1.0:1787857755.465170:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 983 00000100:00100000:1.0:1787857755.465182:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+85:26568:x1874704171647360:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857755.465202:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857755.465224:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c1f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd395f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.465298:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.465313:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.465326:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.465339:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.465347:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.465353:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466075:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c20e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466087:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466100:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857755.466111:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:1.0:1787857755.466213:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466220:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466227:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466234:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857755.466238:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466246:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466259:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9998c3984400) 00010000:00010000:1.0:1787857755.466262:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857755.466267:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466274:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466285:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466302:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466307:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466312:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857755.466316:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466322:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466328:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff9998c4eb6500) 00010000:00010000:1.0:1787857755.466331:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857755.466334:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466338:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466387:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c1f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd395f expref: 88 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466401:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052400/0xd3f183cab4a7c20e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd395f expref: 87 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.466408:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998c4eb6f00) 00010000:00010000:1.0:1787857755.466410:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857755.466420:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052400, rc 0) 00000100:00100000:1.0:1787857755.466837:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+87:26568:x1874704171647360:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1635us (1886us total) trans 4294967937 rc 0/0 00000100:00100000:1.0:1787857755.466847:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 983 00000100:00080000:0.0:1787857755.466937:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857755.470717:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857755.476690:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171647488 00000100:00100000:1.0:1787857755.476707:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171647488 00000100:00100000:1.0:1787857755.476775:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 984 00000100:00100000:1.0:1787857755.476785:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+87:26568:x1874704171647488:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1787857755.477146:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477165:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477177:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477205:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477212:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477219:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477225:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857755.477229:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477237:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477257:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998c4eb6f00) 00010000:00010000:1.0:1787857755.477260:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857755.477265:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857755.477272:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c21c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857755.477393:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+87:26568:x1874704171647488:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 606us (6683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857755.477401:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 984 00000100:00100000:1.0:1787857755.486345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857755.486462:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171647744 00000100:00100000:3.0:1787857755.486473:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171647744 00000100:00100000:3.0:1787857755.486533:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 197 00000100:00100000:3.0:1787857755.486544:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+87:26568:x1874704171647744:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1787857755.486852:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+88:26568:x1874704171647744:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 310us (516us total) trans 4294967938 rc 0/0 00000100:00100000:3.0:1787857755.486861:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 197 00000100:00100000:3.0:1787857755.562722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857755.563598:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171647872 00000100:00100000:2.0:1787857755.563610:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171647872 00000100:00100000:2.0:1787857755.563675:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 256 00000100:00100000:2.0:1787857755.563685:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171647872:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:2.0:1787857755.563706:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857755.563728:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000803eeec3/0xd3f183cab4a7c223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3966 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857755.563759:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 158, mtime: 0x6a908b56, atime: 0x6a908b56, ctime: 0x6a908b56, blocks: 0xb 00010000:00010000:2.0:1787857755.563790:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1787857755.563795:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857755.563806:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000803eeec3/0xd3f183cab4a7c223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3966 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857755.565333:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000803eeec3/0xd3f183cab4a7c223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3966 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857755.565353:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75800, rc 0) 00000100:00100000:2.0:1787857755.565649:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:2347:x1874704171647872:12345-192.168.204.36@tcp:101:diff.0 Request processed in 1962us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857755.565658:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 256 00000100:00100000:3.0:1787857755.569341:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857755.575712:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171648128 00000100:00100000:0.0:1787857755.575746:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171648128 00000100:00100000:0.0:1787857755.575887:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 985 00000100:00100000:0.0:1787857755.575900:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+88:26573:x1874704171648128:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:0.0:1787857755.575935:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857755.575974:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c22a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd396d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857755.576082:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71a00/0xd3f183cab4a7c231 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857755.576098:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71a00/0xd3f183cab4a7c231 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857755.576111:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71a00/0xd3f183cab4a7c231 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857755.576124:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:0.0:1787857755.576314:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c22a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd396d expref: 91 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857755.576335:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71a00/0xd3f183cab4a7c231 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd396d expref: 90 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857755.576345:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff9998c4eb6f00) 00010000:00010000:0.0:1787857755.576348:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787857755.576351:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71a00, rc 0) 00000100:00100000:0.0:1787857755.576434:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+90:26573:x1874704171648128:12345-192.168.204.36@tcp:101:diff.0 Request processed in 537us (7103us total) trans 4294967939 rc 0/0 00000100:00100000:0.0:1787857755.576442:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 985 00000100:00100000:0.0:1787857755.583370:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857755.583618:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171648256 00000100:00100000:3.0:1787857755.583629:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171648256 00002000:00100000:3.0:1787857755.583693:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (0->4095) req@ffff9998dabb2580 x1874704171648256/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:401/0 lens 488/0 e 0 to 0 dl 1787857766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857755.583705:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dabb2580 with x1874704171648256 ext(0->4095) 00002000:00010000:3.0:1787857755.583711:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998dabb2580 00000100:00100000:3.0:1787857755.583749:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 92 00000100:00100000:3.0:1787857755.583759:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171648256:12345-192.168.204.36@tcp:3:diff.0 00000100:00100000:3.0:1787857755.584127:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171648256:12345-192.168.204.36@tcp:3:diff.0 Request processed in 367us (769us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787857755.584134:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 92 00002000:00100000:3.0:1787857755.584141:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (0->4095) req@ffff9998dabb2580 x1874704171648256/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:401/0 lens 488/4536 e 0 to 0 dl 1787857766 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857755.584150:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dabb2580 with x1874704171648256 ext(0->4095) 00002000:00010000:3.0:1787857755.584153:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998dabb2580 00010000:00010000:1.0:1787857755.886019:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857756.919906:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857757.934495:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857758.066727:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188235904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857758.066852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857758.067020:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188235904 00000100:00100000:3.0:1787857758.067028:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188235904 00000100:00080000:0.0:1787857758.067068:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857758.067091:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787857758.067102:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188235904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857758.067150:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857758.067207:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188235904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857758.067214:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787857758.067312:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188235904:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787857758.637296:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00000001:00080000:0.0:1787857758.637314:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000001:00080000:2.0:1787857758.639508:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967939 is committed 00000001:00080000:2.0:1787857758.639526:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967934 is committed 00000001:00080000:2.0:1787857758.639534:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967936 is committed 00000020:00080000:2.0:1787857758.639547:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 15 batchid updated 00000020:00080000:2.0:1787857758.639562:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998f73cf540 refcount 2 committed 0 result 0 batchid 16 00000020:00080000:2.0:1787857758.639567:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f7140400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998f73cfe40 00000020:00080000:2.0:1787857758.639571:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f7140600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998f703a000 00000020:00080000:2.0:1787857758.639805:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16 committed batchid 15 00000020:00080000:2.0:1787857758.640048:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 15 00010000:00010000:2.0:1787857758.960163:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857759.317083:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857759.317134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857759.317171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857759.317200:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857759.317220:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857759.317238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857759.317274:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857759.317312:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171648640 00000100:00100000:3.0:1787857759.317324:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171648640 00000100:00100000:3.0:1787857759.317760:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171649152 00000100:00100000:3.0:1787857759.317765:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171649152 00000100:00100000:3.0:1787857759.317784:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171648768 00000100:00100000:3.0:1787857759.317786:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171648768 00000100:00100000:3.0:1787857759.317797:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171649024 00000100:00100000:3.0:1787857759.317799:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171649024 00000100:00100000:3.0:1787857759.317850:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 374 00000100:00100000:3.0:1787857759.317861:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2348:x1874704171648640:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857759.317949:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2348:x1874704171648640:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 90us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857759.317976:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 374 00000100:00100000:3.0:1787857759.317996:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 375 00000100:00100000:3.0:1787857759.318003:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171649152:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857759.318032:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171649152:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857759.318039:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 375 00000100:00100000:3.0:1787857759.318050:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 376 00000100:00100000:3.0:1787857759.318056:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171648768:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857759.318078:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171648768:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857759.318084:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 376 00000100:00100000:3.0:1787857759.318101:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 377 00000100:00100000:3.0:1787857759.318107:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171649024:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857759.318131:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171649024:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857759.318138:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 377 00000100:00100000:1.0:1787857759.318239:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171648896 00000100:00100000:1.0:1787857759.318244:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171648896 00000100:00100000:1.0:1787857759.318300:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171648512 00000100:00100000:1.0:1787857759.318303:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171648512 00000100:00100000:1.0:1787857759.318323:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 384 00000100:00100000:1.0:1787857759.318329:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2348:x1874704171648896:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857759.318358:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2348:x1874704171648896:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857759.318364:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 384 00000100:00100000:1.0:1787857759.318378:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 385 00000100:00100000:1.0:1787857759.318383:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+87:2348:x1874704171648512:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857759.318419:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+87:2348:x1874704171648512:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857759.318435:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 385 00000100:00100000:2.0:1787857759.318939:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171648384 00000100:00100000:2.0:1787857759.318946:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171648384 00000100:00100000:2.0:1787857759.318989:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 557 00000100:00100000:2.0:1787857759.318997:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171648384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857759.319040:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171648384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 45us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857759.319047:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 557 00000100:00080000:0.0:1787857759.325839:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857759.327271:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857759.327279:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857759.598509:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188236032:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.598591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857759.598647:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188236544:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.598677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857759.598704:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857759.598710:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188236416:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.598737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857759.598763:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188236160:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.598786:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857759.598804:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188236672:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.598860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857759.598890:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857759.598896:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188236288:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.598918:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857759.598951:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188236032 00000100:00100000:1.0:1787857759.598958:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188236032 00000100:00100000:1.0:1787857759.599014:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1787857759.599023:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188236032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599068:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188236032:12345-0@lo:400:kworker.0 Request processed in 46us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857759.599075:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1787857759.599102:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188236544 00000100:00100000:1.0:1787857759.599105:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188236544 00000100:00100000:1.0:1787857759.599132:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188236160 00000100:00100000:1.0:1787857759.599146:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188236160 00000100:00100000:1.0:1787857759.599162:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188236288 00000100:00100000:1.0:1787857759.599164:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188236288 00000100:00100000:1.0:1787857759.599177:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787857759.599182:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188236544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599209:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188236544:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857759.599214:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787857759.599223:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1787857759.599228:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188236160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599249:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188236160:12345-0@lo:400:kworker.0 Request processed in 22us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857759.599255:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1787857759.599265:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787857759.599270:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188236288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599290:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188236288:12345-0@lo:400:kworker.0 Request processed in 20us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857759.599295:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787857759.599313:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188236416 00000100:00100000:1.0:1787857759.599316:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188236416 00000100:00100000:1.0:1787857759.599334:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188236672 00000100:00100000:1.0:1787857759.599336:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188236672 00000100:00100000:1.0:1787857759.599351:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787857759.599356:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188236416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599381:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188236416:12345-0@lo:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857759.599387:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787857759.599402:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787857759.599407:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188236672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599428:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188236672:12345-0@lo:400:kworker.0 Request processed in 21us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857759.599434:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787857759.599471:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188236288:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599481:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188236160:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599489:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:1.0:1787857759.599494:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967352 committed transno 4294967353 00000004:00080000:1.0:1787857759.599516:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999901223480, transno 4294967353 00000100:00100000:1.0:1787857759.599523:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188236672:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599546:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:1.0:1787857759.599549:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967347 committed transno 4294967347 00000100:00100000:1.0:1787857759.599563:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188236416:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599570:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188236032:0@lo:400:kworker.0 00000100:00100000:1.0:1787857759.599578:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188236544:0@lo:400:kworker.0 00000100:00080000:0.0:1787857759.599835:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857759.599840:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857759.984176:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857760.110105:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857760.110130:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188236800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857760.110213:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857760.110284:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188236800 00000100:00100000:3.0:1787857760.110292:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188236800 00000100:00100000:3.0:1787857760.110341:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787857760.110349:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188236800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857760.110398:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73072640 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857760.110457:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188236800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857760.110464:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787857760.110519:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188236800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787857761.006067:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857761.103030:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857761.103208:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171649280 00000100:00100000:1.0:1787857761.103219:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171649280 00000100:00100000:1.0:1787857761.103302:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 986 00000100:00100000:1.0:1787857761.103313:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26528:x1874704171649280:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787857761.103426:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:26528:x1874704171649280:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 115us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857761.103451:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 986 00000100:00080000:0.0:1787857761.103547:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857762.030101:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857763.061920:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857763.140745:0:19539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 15:09:21 (1787857761) 00000100:00100000:3.0:1787857763.182363:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857763.182388:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188236928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857763.182461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857763.182540:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188236928 00000100:00100000:3.0:1787857763.182547:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188236928 00000100:00100000:3.0:1787857763.182607:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787857763.182617:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188236928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857763.182654:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857763.182701:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188236928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857763.182708:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787857763.182758:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188236928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787857763.182984:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857763.739146:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857763.739739:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171649408 00000100:00100000:2.0:1787857763.739760:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171649408 00000100:00100000:2.0:1787857763.739905:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 987 00000100:00100000:2.0:1787857763.739916:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:27177:x1874704171649408:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787857763.740033:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:27177:x1874704171649408:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 119us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857763.740041:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 987 00000100:00080000:1.0:1787857763.745672:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857763.773221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857763.773317:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171649536 00000100:00100000:3.0:1787857763.773328:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171649536 00000100:00100000:3.0:1787857763.773422:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 988 00000100:00100000:3.0:1787857763.773434:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+87:27178:x1874704171649536:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857763.773460:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857763.773493:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c23f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3974 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.773586:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.773603:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.773616:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.773631:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.773639:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.773646:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787857763.773923:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857763.776430:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776449:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776477:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776484:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857763.776502:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776522:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776541:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857763.776544:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857763.776549:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776555:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776568:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776574:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776581:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776586:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857763.776588:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776594:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776601:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff9998c3984300) 00010000:00010000:3.0:1787857763.776605:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857763.776607:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776623:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c24d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776674:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c23f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3974 expref: 88 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776685:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857763.776687:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857763.776692:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c23f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3974 expref: 88 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.776700:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:3.0:1787857763.776799:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+87:27178:x1874704171649536:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3368us (3589us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857763.776855:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 988 00000100:00100000:3.0:1787857763.783373:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857763.783477:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171649792 00000100:00100000:0.0:1787857763.783498:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171649792 00000100:00100000:0.0:1787857763.783565:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 989 00000100:00100000:0.0:1787857763.783575:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+87:27178:x1874704171649792:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1787857763.783634:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857763.783663:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7bf75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3886 expref: 87 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.783685:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:0.0:1787857763.783691:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857763.784061:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.784076:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.784099:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.784134:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.784149:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 39 pid: 5856 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857763.784164:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188237056:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857763.784262:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b7f240 going to sleep for 11 seconds 00000020:00080000:2.0:1787857763.790776:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 16 batchid updated 00000100:00100000:2.0:1787857763.791084:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857763.791114:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171649920 00000100:00100000:2.0:1787857763.791123:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171649920 00010000:00010000:2.0:1787857763.791166:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 40 pid: 5856 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857763.791200:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 300 00000100:00100000:2.0:1787857763.791210:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2350:x1874704171649920:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857763.791225:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857763.791232:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 40 pid: 5856 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.791262:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 40 pid: 5856 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.791285:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857763.791290:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.791300:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.791308:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.791329:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857763.791392:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2350:x1874704171649920:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 182us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857763.791400:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 300 00010000:00010000:3.0:1787857763.791689:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7bfb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd389b expref: 39 pid: 5856 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857763.791706:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188237056:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857763.791728:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.791738:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.791744:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.791773:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.791793:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.791801:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857763.793571:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00010000:00010000:3.0:1787857763.793592:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.793602:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.793610:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.793616:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857763.793620:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.793629:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.793645:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857763.793648:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857763.793653:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.793671:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c254 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857763.793944:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050d7c64d reply state 0000000085fb9424 transno 4294967940 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857763.793953:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000020:00080000:0.0:1787857763.794058:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000020:00080000:0.0:1787857763.794072:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000100:00100000:2.0:1787857763.794264:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+88:27178:x1874704171649792:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 10686us (10897us total) trans 4294967940 rc 0/0 00000100:00100000:2.0:1787857763.794274:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 989 00010000:00010000:3.0:1787857763.796205:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.796222:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.796230:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.796236:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857763.796240:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.796247:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.796261:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff9998c3984300) 00010000:00010000:3.0:1787857763.796264:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857763.796269:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.796276:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c25b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857763.808137:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857763.808257:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171650048 00000100:00100000:0.0:1787857763.808269:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171650048 00000100:00100000:0.0:1787857763.808350:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 990 00000100:00100000:0.0:1787857763.808360:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+87:27179:x1874704171650048:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857763.808388:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857763.808419:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c262 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd397b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.808507:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c269 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.808523:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.808548:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857763.808612:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857763.808616:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857763.808641:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.808669:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c262 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd397b expref: 89 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.808691:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c269 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd397b expref: 88 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.808700:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:0.0:1787857763.808702:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857763.808706:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857763.808772:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+88:27179:x1874704171650048:12345-192.168.204.36@tcp:101:bash.0 Request processed in 413us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857763.808779:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 990 00000100:00100000:2.0:1787857763.816340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857763.816441:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171650176 00000100:00100000:3.0:1787857763.816454:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171650176 00000100:00100000:3.0:1787857763.816535:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 991 00000100:00100000:3.0:1787857763.816546:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+88:27179:x1874704171650176:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857763.816570:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857763.816595:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3982 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.816679:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.816697:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.816711:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.816728:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.816735:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.816741:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817099:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c285 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817109:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817132:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857763.817172:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:3.0:1787857763.817176:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857763.817202:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817214:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817221:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817227:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817233:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857763.817237:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817245:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817257:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:3.0:1787857763.817260:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857763.817265:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817270:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817617:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817626:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817633:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817637:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857763.817640:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817646:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817656:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff9998c3984300) 00010000:00010000:3.0:1787857763.817658:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857763.817661:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817666:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c27e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817707:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3982 expref: 90 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817722:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52e00/0xd3f183cab4a7c285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3982 expref: 89 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.817742:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857763.817744:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787857763.817747:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52e00, rc 0) 00000100:00100000:3.0:1787857763.818311:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+89:27179:x1874704171650176:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1761us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857763.818321:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 991 00000100:00100000:2.0:1787857763.822374:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857763.822532:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171650304 00000100:00100000:0.0:1787857763.822541:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171650304 00000100:00100000:0.0:1787857763.822592:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 992 00000100:00100000:0.0:1787857763.822601:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:27179:x1874704171650304:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857763.822621:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857763.822642:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c28c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3989 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.822734:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.822748:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.822759:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.822775:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.822781:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.822800:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823010:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823018:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823024:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823030:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857763.823034:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823052:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823065:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:0.0:1787857763.823068:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857763.823073:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823079:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c293 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823094:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823100:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823106:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823111:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857763.823113:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823118:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823125:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff9998d8797f00) 00010000:00010000:0.0:1787857763.823127:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857763.823130:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823145:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c29a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823184:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c28c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3989 expref: 90 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823194:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:0.0:1787857763.823196:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857763.823200:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c28c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3989 expref: 90 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857763.823209:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857763.823283:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:27179:x1874704171650304:12345-192.168.204.36@tcp:101:bash.0 Request processed in 682us (919us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857763.823291:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 992 00000040:00080000:0.0:1787857763.824656:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857763.824664:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857763.824902:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 2 00000040:00080000:0.0:1787857763.824928:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857763.834691:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857763.834800:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171650432 00000100:00100000:1.0:1787857763.834811:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171650432 00000100:00100000:1.0:1787857763.834922:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 993 00000100:00100000:1.0:1787857763.834934:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+39:27180:x1874704171650432:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857763.834959:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857763.834980:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c2a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3990 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.835052:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.835069:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.835081:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857763.835163:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857763.835167:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857763.835191:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.835215:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c2a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 41 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.835254:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 40 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.835263:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:1.0:1787857763.835266:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857763.835269:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052c00, rc 0) 00000100:00100000:1.0:1787857763.835344:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:27180:x1874704171650432:12345-192.168.204.36@tcp:101:rm.0 Request processed in 399us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857763.835352:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 993 00000100:00100000:2.0:1787857763.842196:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857763.842273:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171650560 00000100:00100000:3.0:1787857763.842282:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171650560 00000100:00100000:3.0:1787857763.842352:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 994 00000100:00100000:3.0:1787857763.842362:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:27180:x1874704171650560:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857763.842383:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857763.842403:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c2af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3997 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842471:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842496:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842509:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842523:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842530:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842555:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842799:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c2c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842808:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.842913:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857763.843026:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:2.0:1787857763.843031:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857763.843058:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843163:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843170:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843177:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843183:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857763.843187:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843194:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843206:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:2.0:1787857763.843209:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.843214:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843220:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c2b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843234:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843240:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843245:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843258:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857763.843261:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843267:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843275:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff9998c3984300) 00010000:00010000:2.0:1787857763.843278:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.843281:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843287:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c2bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843323:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c2af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3997 expref: 42 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843408:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52200/0xd3f183cab4a7c2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3997 expref: 41 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.843415:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857763.843418:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857763.843420:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52200, rc 0) 00000100:00100000:2.0:1787857763.843613:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27180:x1874704171650560:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1251us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857763.843622:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 994 00000100:00100000:0.0:1787857763.848756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857763.848923:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171650688 00000100:00100000:1.0:1787857763.848937:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171650688 00000100:00100000:1.0:1787857763.849102:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 995 00000100:00100000:1.0:1787857763.849115:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27180:x1874704171650688:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857763.849139:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857763.849164:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c2cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd399e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849241:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849258:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849271:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849287:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849323:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849456:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849552:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849560:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849567:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849573:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857763.849578:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849587:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849601:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857763.849604:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857763.849609:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849615:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c2d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849628:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849641:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849647:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849652:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857763.849656:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849663:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849671:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff9998c4eb6d00) 00010000:00010000:1.0:1787857763.849674:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857763.849677:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849683:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c2d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849721:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c2cb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd399e expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849732:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857763.849734:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857763.849738:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c2cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd399e expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.849759:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:1.0:1787857763.849876:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27180:x1874704171650688:12345-192.168.204.36@tcp:101:rm.0 Request processed in 764us (1132us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857763.849884:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 995 00000100:00100000:1.0:1787857763.856722:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857763.856878:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171650816 00000100:00100000:2.0:1787857763.856903:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171650816 00000100:00100000:2.0:1787857763.856981:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 996 00000100:00100000:2.0:1787857763.856992:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27180:x1874704171650816:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857763.857018:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857763.857041:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c2e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39a5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857131:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857149:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857161:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857177:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857184:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857190:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857267:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857275:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857281:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857294:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857763.857299:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857306:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857318:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857763.857322:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.857326:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857665:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c2e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857682:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857687:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857694:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857699:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857763.857702:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857708:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857728:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff9998e18d9500) 00010000:00010000:2.0:1787857763.857731:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.857734:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857739:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857780:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c2e0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39a5 expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857801:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857763.857803:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.857807:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c2e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39a5 expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.857946:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75400, rc 0) 00000100:00100000:2.0:1787857763.858023:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27180:x1874704171650816:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1032us (1313us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857763.858031:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 996 00000100:00100000:3.0:1787857763.882907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857763.883623:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171650944 00000100:00100000:2.0:1787857763.883634:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171650944 00000100:00100000:2.0:1787857763.883708:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 997 00000100:00100000:2.0:1787857763.883719:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27181:x1874704171650944:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857763.883739:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857763.883761:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c2f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39ac expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.883905:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.883920:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.883931:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.883947:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.883953:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.883959:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884036:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884045:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884051:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884057:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857763.884061:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884156:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884168:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857763.884171:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.884176:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884182:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c2fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884196:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884202:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884208:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884212:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857763.884215:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884221:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884227:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff9998e18d9500) 00010000:00010000:2.0:1787857763.884229:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.884232:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884249:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c303 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884288:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c2f5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ac expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884633:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857763.884635:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.884641:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c2f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ac expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.884652:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75400, rc 0) 00000100:00100000:2.0:1787857763.886443:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27181:x1874704171650944:12345-192.168.204.36@tcp:101:cp.0 Request processed in 2714us (3536us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857763.886457:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 997 00000100:00100000:0.0:1787857763.898061:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857763.898239:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171651072 00000100:00100000:1.0:1787857763.898251:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171651072 00000100:00100000:1.0:1787857763.898322:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 998 00000100:00100000:1.0:1787857763.898574:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27181:x1874704171651072:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857763.898602:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857763.898634:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c30a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39b3 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.898766:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.898794:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.898809:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.898879:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.898887:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.898908:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.898992:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.898999:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899007:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899013:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857763.899017:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899025:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899037:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857763.899041:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857763.899045:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899051:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c311 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899083:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899090:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899103:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899108:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857763.899110:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899116:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899123:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff9998c4eb6d00) 00010000:00010000:1.0:1787857763.899126:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857763.899129:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899136:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899172:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c30a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39b3 expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899181:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857763.899184:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857763.899187:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c30a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39b3 expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.899195:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857763.899268:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27181:x1874704171651072:12345-192.168.204.36@tcp:101:cp.0 Request processed in 936us (1220us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857763.899284:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 998 00000100:00100000:1.0:1787857763.908886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857763.909055:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171651328 00000100:00100000:2.0:1787857763.909078:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171651328 00000100:00100000:2.0:1787857763.909149:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 999 00000100:00100000:2.0:1787857763.909159:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27181:x1874704171651328:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857763.909183:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857763.909206:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c31f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39ba expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.909364:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.909383:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.909412:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.909431:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.909439:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.909446:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857763.911792:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:2.0:1787857763.912265:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912285:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912298:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912355:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912363:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912370:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912377:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857763.912394:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912401:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912415:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857763.912418:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857763.912423:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912430:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c326 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857763.912446:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089411630 reply state 00000000a583027c transno 4294967941 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857763.912456:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857763.912495:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75400/0xd3f183cab4a7c31f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 44 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912522:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857763.912529:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:2.0:1787857763.912531:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857763.912534:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74400, rc 0) 00000100:00100000:2.0:1787857763.912623:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:27181:x1874704171651328:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3465us (3751us total) trans 4294967941 rc 0/0 00000100:00100000:2.0:1787857763.912633:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 999 00010000:00010000:3.0:1787857763.920659:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.920680:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.920688:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.920696:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857763.920701:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.920709:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.920728:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff9998e18d9500) 00010000:00010000:3.0:1787857763.920731:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857763.920753:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.920760:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c32d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857763.951179:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857763.951442:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171651456 00000100:00100000:3.0:1787857763.951452:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171651456 00000100:00100000:3.0:1787857763.951652:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 257 00000100:00100000:3.0:1787857763.951663:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171651456:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857763.951682:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857763.951703:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39c1 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857763.951731:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857763.951757:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1787857763.951762:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857763.951771:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 11 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.951799:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 11 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.951812:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:3.0:1787857763.951889:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171651456:12345-192.168.204.36@tcp:101:cp.0 Request processed in 229us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857763.951897:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 257 00000100:00100000:3.0:1787857763.959687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857763.959864:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171651584 00000100:00100000:1.0:1787857763.959874:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171651584 00000100:00100000:1.0:1787857763.959935:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 258 00000100:00100000:1.0:1787857763.959946:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:27181:x1874704171651584:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857763.959965:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857763.959984:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39c8 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.960015:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.960024:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857763.960029:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857763.960035:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.960064:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.960078:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 12 pid: 14028 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857763.960092:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188237184:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857763.960191:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc780 going to sleep for 11 seconds 00000100:00080000:2.0:1787857763.960563:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857763.969965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857763.970108:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188237184:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857763.970151:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857763.970174:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857763.970247:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:27181:x1874704171651584:12345-192.168.204.36@tcp:101:cp.0 Request processed in 10303us (10570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857763.970257:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 258 00000100:00100000:3.0:1787857763.970860:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171651712 00000100:00100000:3.0:1787857763.970870:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171651712 00010000:00010000:3.0:1787857763.970908:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 12 pid: 14028 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857763.970946:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 301 00000100:00100000:3.0:1787857763.970956:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171651712:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857763.970972:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857763.970995:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 12 pid: 14028 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.971008:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 12 pid: 14028 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.971035:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c342 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c1 expref: 12 pid: 14028 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.971052:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857763.971057:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857763.971066:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.971077:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857763.971118:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857763.971149:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8468:1874704188237312:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857763.971217:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857763.977414:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8468:1874704188237312:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857763.977444:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857763.977629:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171651712:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 6672us (7674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857763.977643:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 301 00000100:00100000:0.0:1787857763.981983:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857763.982186:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171651968 00000100:00100000:3.0:1787857763.982195:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171651968 00000100:00100000:3.0:1787857763.982311:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:3.0:1787857763.982322:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:27181:x1874704171651968:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:3.0:1787857763.982729:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:27181:x1874704171651968:12345-192.168.204.36@tcp:35:cp.0 Request processed in 409us (755us total) trans 4294967942 rc 0/0 00000100:00100000:3.0:1787857763.982738:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:2.0:1787857764.045184:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857764.045518:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171652096 00000100:00100000:0.0:1787857764.045530:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171652096 00000100:00100000:0.0:1787857764.045596:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1000 00000100:00100000:0.0:1787857764.045623:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:27184:x1874704171652096:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857764.045648:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857764.045671:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c350 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39cf expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045746:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045763:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045776:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045804:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045811:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045856:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045968:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045977:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.045984:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857764.046032:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:0.0:1787857764.046036:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857764.046053:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046567:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046582:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046588:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046595:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046601:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857764.046605:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046613:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046626:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:0.0:1787857764.046629:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857764.046634:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046640:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c357 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046670:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046677:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046683:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046688:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857764.046691:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046697:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046704:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff9998d8797f00) 00010000:00010000:0.0:1787857764.046707:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857764.046710:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046716:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7c35e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046751:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7c350 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 91 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046766:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 90 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.046798:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:0.0:1787857764.046800:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857764.046803:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70a00, rc 0) 00000100:00100000:0.0:1787857764.046925:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+90:27184:x1874704171652096:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1304us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.046934:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1000 00000100:00100000:0.0:1787857764.050800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857764.050904:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171652224 00000100:00100000:3.0:1787857764.050914:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171652224 00000100:00080000:2.0:1787857764.051035:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857764.051093:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 259 00000100:00100000:3.0:1787857764.051104:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171652224:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857764.051124:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857764.051146:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c36c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39d6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857764.051215:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188237440:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857764.051861:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee9c0 going to sleep for 11 seconds 00002000:00010000:3.0:1787857764.058440:0:6714:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787857764.058452:0:6714:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime: 0 -> 1787857763 00002000:00010000:3.0:1787857764.058454:0:6714:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime: 0 -> 1787857763 00002000:00010000:3.0:1787857764.058457:0:6714:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime: 0 -> 1787857763 00000100:00100000:2.0:1787857764.058714:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188237440:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857764.058760:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c36c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39d6 expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857764.058798:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3465082/0xd3f183cab4a7c36c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39d6 expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857764.058813:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:2.0:1787857764.058987:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171652224:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 7883us (8206us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857764.058997:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 259 00000100:00100000:2.0:1787857764.068719:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857764.068881:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171652352 00000100:00100000:1.0:1787857764.068892:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171652352 00000100:00100000:1.0:1787857764.068959:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1001 00000100:00100000:1.0:1787857764.068971:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+90:27184:x1874704171652352:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857764.068992:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857764.069014:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39dd expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.069099:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.069116:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.069128:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857764.069195:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:1.0:1787857764.069199:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857764.069243:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.069271:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 92 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.069291:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 91 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.069300:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857764.069303:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857764.069307:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:1.0:1787857764.069670:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+91:27184:x1874704171652352:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 699us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857764.069678:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1001 00000100:00100000:0.0:1787857764.075343:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857764.075501:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171652480 00000100:00100000:1.0:1787857764.075512:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171652480 00000100:00100000:1.0:1787857764.075579:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00100000:1.0:1787857764.075590:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171652480:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857764.075609:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857764.075628:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c381 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39e4 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857764.075689:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188237568:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857764.075775:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc780 going to sleep for 11 seconds 00010000:00010000:1.0:1787857764.077980:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857764.080711:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188237568:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857764.080796:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c381 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39e4 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.081113:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c381 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39e4 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.081131:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052a00, rc 0) 00000100:00100000:1.0:1787857764.081244:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171652480:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5654us (5921us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857764.081254:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00100000:2.0:1787857764.087076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857764.087176:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171652736 00000100:00100000:3.0:1787857764.087186:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171652736 00000100:00100000:3.0:1787857764.087250:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1002 00000100:00100000:3.0:1787857764.087261:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+91:27184:x1874704171652736:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:3.0:1787857764.087768:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 136 off11728 00000100:00100000:3.0:1787857764.088009:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+91:27184:x1874704171652736:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 747us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857764.088018:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1002 00000100:00100000:2.0:1787857764.433047:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857764.433103:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857764.433132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857764.433921:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171652992 00000100:00100000:0.0:1787857764.433932:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171652992 00000100:00080000:2.0:1787857764.434051:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857764.434282:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171653120 00000100:00100000:0.0:1787857764.434287:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171653120 00000100:00080000:2.0:1787857764.434337:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857764.434885:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 380 00000100:00100000:3.0:1787857764.434899:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2348:x1874704171652992:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857764.434985:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2348:x1874704171652992:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 90us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857764.434993:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 380 00000100:00100000:3.0:1787857764.435015:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 381 00000100:00100000:3.0:1787857764.435021:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171653120:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857764.435045:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171653120:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857764.435052:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 381 00000100:00100000:2.0:1787857764.436258:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171652864 00000100:00100000:2.0:1787857764.436269:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171652864 00000100:00100000:2.0:1787857764.436566:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 559 00000100:00100000:2.0:1787857764.436576:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171652864:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857764.436767:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171652864:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 192us (3662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857764.436803:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 559 00000100:00100000:0.0:1787857764.720356:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188237696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.720435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857764.722801:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188238208:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.722888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857764.722935:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857764.722944:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188238080:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.722974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857764.723019:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188237824:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.723046:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857764.723067:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188238336:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.723091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857764.723114:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857764.723121:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188237952:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.723155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857764.723191:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188237696 00000100:00100000:0.0:1787857764.723198:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188237696 00000100:00100000:0.0:1787857764.723242:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1787857764.723252:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188237696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.723310:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188237696:12345-0@lo:400:kworker.0 Request processed in 59us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.723318:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1787857764.723353:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188238208 00000100:00100000:0.0:1787857764.723357:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188238208 00000100:00100000:0.0:1787857764.723395:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188237824 00000100:00100000:0.0:1787857764.723399:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188237824 00000100:00100000:0.0:1787857764.723417:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188237952 00000100:00100000:0.0:1787857764.723420:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188237952 00000100:00100000:0.0:1787857764.723453:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787857764.723460:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188238208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.723497:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188238208:12345-0@lo:400:kworker.0 Request processed in 37us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.723504:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787857764.723516:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1787857764.723522:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188237824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.723555:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188237824:12345-0@lo:400:kworker.0 Request processed in 33us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.723561:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1787857764.723572:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787857764.723577:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188237952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.723603:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188237952:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.723615:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787857764.723638:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188238080 00000100:00100000:0.0:1787857764.727919:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188238080 00000100:00100000:0.0:1787857764.727992:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188238336 00000100:00100000:0.0:1787857764.727997:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188238336 00000100:00100000:0.0:1787857764.728032:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787857764.728042:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188238080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.728133:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188238080:12345-0@lo:400:kworker.0 Request processed in 92us (5157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.728141:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787857764.728162:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787857764.728170:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188238336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.728200:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188238336:12345-0@lo:400:kworker.0 Request processed in 33us (5108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.728207:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787857764.728269:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188238080:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.728282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188237696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.728295:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188238208:0@lo:400:kworker.0 00000100:00080000:0.0:1787857764.728328:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857764.728334:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857764.728361:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188237952:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.728373:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188237824:0@lo:400:kworker.0 00000100:00100000:0.0:1787857764.728385:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188238336:0@lo:400:kworker.0 00000040:00080000:3.0:1787857764.826264:0:19588:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857764.826272:0:19588:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857764.826325:0:19588:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 27 count 3 00000040:00080000:3.0:1787857764.826332:0:19588:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787857764.846132:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857764.846154:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857764.846213:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 27 count 3 00000040:00080000:0.0:1787857764.846221:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857764.846547:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d49e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188238464:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857764.846937:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857764.857934:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d49e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188238464:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857764.868753:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857764.868880:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171653248 00000100:00100000:2.0:1787857764.868891:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171653248 00000100:00100000:2.0:1787857764.868959:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1003 00000100:00100000:2.0:1787857764.868970:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:27194:x1874704171653248:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857764.869012:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857764.869132:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:27194:x1874704171653248:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 164us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857764.869140:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1003 00000100:00100000:1.0:1787857764.887385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857764.888178:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171653504 00000100:00100000:0.0:1787857764.888192:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171653504 00000100:00100000:0.0:1787857764.888262:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1004 00000100:00100000:0.0:1787857764.888275:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:27194:x1874704171653504:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857764.888300:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857764.888323:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c388 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39eb expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.888447:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c38f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.888475:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c38f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.889035:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c38f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857764.889049:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:0.0:1787857764.889270:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c388 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39eb expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.889289:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c38f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39eb expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.889317:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:0.0:1787857764.889319:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857764.889324:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857764.889401:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27194:x1874704171653504:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1129us (2028us total) trans 4294967943 rc 0/0 00000100:00100000:0.0:1787857764.889409:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1004 00000100:00100000:3.0:1787857764.896066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857764.896391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171653632 00000100:00100000:1.0:1787857764.896403:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171653632 00000100:00100000:1.0:1787857764.896487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:1.0:1787857764.896499:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2350:x1874704171653632:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857764.896517:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857764.896546:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c38f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39eb expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.896568:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:1.0:1787857764.896573:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857764.896639:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2350:x1874704171653632:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 142us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857764.896647:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:0.0:1787857764.905904:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857764.906073:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171653760 00000100:00100000:3.0:1787857764.906085:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171653760 00000100:00100000:3.0:1787857764.906154:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 261 00000100:00100000:3.0:1787857764.906167:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171653760:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857764.906426:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.906554:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.906564:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857764.906568:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857764.906572:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.906609:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.906625:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 11 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857764.906642:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188238592:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857764.907167:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857764.915246:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188238592:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857764.915286:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857764.915991:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857764.916194:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171653888 00000100:00100000:1.0:1787857764.916204:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171653888 00002000:00100000:1.0:1787857764.916530:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x16:0x0] (0->157) req@ffff9998dacc0f00 x1874704171653888/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:410/0 lens 648/0 e 0 to 0 dl 1787857775 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857764.916542:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dacc0f00 with x1874704171653888 ext(0->157) 00010000:00010000:1.0:1787857764.916551:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 12 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.916567:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 12 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857764.916575:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998dacc0f00 00000100:00100000:1.0:1787857764.916632:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:1.0:1787857764.916645:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171653888:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857764.918050:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171653888:12345-192.168.204.36@tcp:4:cp.0 Request processed in 1399us (2053us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787857764.918455:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00002000:00100000:1.0:1787857764.918681:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x16:0x0] (0->157) req@ffff9998dacc0f00 x1874704171653888/t4294967354(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:410/0 lens 648/448 e 0 to 0 dl 1787857775 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857764.918693:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dacc0f00 with x1874704171653888 ext(0->157) 00010000:00010000:1.0:1787857764.918706:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 14 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.919006:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 14 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857764.919029:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998dacc0f00 00000100:00100000:1.0:1787857764.926180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857764.926284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171654016 00000100:00100000:3.0:1787857764.926295:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171654016 00010000:00010000:3.0:1787857764.926339:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 14 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857764.926383:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 302 00000100:00100000:3.0:1787857764.926395:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171654016:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857764.926412:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857764.926436:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 14 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.926452:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 14 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.926477:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7c349 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39c8 expref: 14 pid: 6711 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.926498:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857764.926502:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857764.926509:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.926519:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857764.926650:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857764.926720:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171654016:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 326us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857764.926728:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 302 00010000:00010000:0.0:1787857764.927273:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.927286:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.927317:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.927326:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.927334:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.927341:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857764.927345:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.927361:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.927374:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.927382:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7c39d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857764.927490:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171653760:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 21324us (21592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.927499:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 261 00000100:00100000:1.0:1787857764.934352:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857764.934427:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171654272 00000100:00100000:0.0:1787857764.934437:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171654272 00000100:00100000:0.0:1787857764.934515:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1005 00000100:00100000:0.0:1787857764.934527:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:27194:x1874704171654272:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857764.934648:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:27194:x1874704171654272:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.934656:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1005 00000100:00100000:3.0:1787857764.941122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857764.941281:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171654400 00000100:00100000:0.0:1787857764.941293:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171654400 00000100:00100000:0.0:1787857764.941351:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00100000:0.0:1787857764.941362:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171654400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857764.941383:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857764.941414:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39f2 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857764.941443:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a908b63, atime: 0x0, ctime: 0x6a908b63, blocks: 0x1 00010000:00010000:0.0:1787857764.941476:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1787857764.941482:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857764.941493:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.941513:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857764.941527:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857764.941598:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171654400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 238us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857764.941606:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00100000:0.0:1787857764.953813:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857764.954159:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171654656 00000100:00100000:3.0:1787857764.954170:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171654656 00000100:00100000:3.0:1787857764.954233:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1006 00000100:00100000:3.0:1787857764.954243:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:27194:x1874704171654656:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857764.954364:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:27194:x1874704171654656:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 123us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857764.954373:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1006 00000100:00100000:0.0:1787857764.974304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857764.979585:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171654784 00000100:00100000:1.0:1787857764.979601:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171654784 00002000:00100000:1.0:1787857764.979662:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x16:0x0] (0->4095) req@ffff9998dacc21c0 x1874704171654784/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:410/0 lens 488/0 e 0 to 0 dl 1787857775 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857764.979676:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dacc21c0 with x1874704171654784 ext(0->4095) 00002000:00010000:1.0:1787857764.979682:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998dacc21c0 00000100:00100000:1.0:1787857764.979725:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 93 00000100:00100000:1.0:1787857764.979734:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171654784:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857764.979966:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171654784:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 232us (5672us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857764.979974:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 93 00002000:00100000:1.0:1787857764.979981:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x16:0x0] (0->4095) req@ffff9998dacc21c0 x1874704171654784/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:410/0 lens 488/4536 e 0 to 0 dl 1787857775 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857764.979989:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dacc21c0 with x1874704171654784 ext(0->4095) 00002000:00010000:1.0:1787857764.979994:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998dacc21c0 00000100:00100000:0.0:1787857764.994977:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857764.995249:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171654912 00000100:00100000:1.0:1787857764.995260:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171654912 00000100:00100000:1.0:1787857764.995325:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1007 00000100:00100000:1.0:1787857764.995336:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:27194:x1874704171654912:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857764.995362:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857764.995399:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c3ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd39f9 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.995441:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.995456:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.996641:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.996758:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c3ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.996788:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857764.996798:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:1.0:1787857764.996801:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857764.996805:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857764.997755:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27194:x1874704171654912:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2412us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857764.997778:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1007 00000100:00100000:0.0:1787857765.003357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857765.003442:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171655040 00000100:00100000:1.0:1787857765.003453:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171655040 00000100:00100000:1.0:1787857765.003529:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1008 00000100:00100000:1.0:1787857765.003540:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27194:x1874704171655040:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857765.003578:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857765.003701:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27194:x1874704171655040:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 163us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857765.003709:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1008 00000100:00080000:0.0:1787857765.003978:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857765.011188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857765.011231:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171655168 00000100:00100000:0.0:1787857765.011241:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171655168 00000100:00100000:0.0:1787857765.011311:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 263 00000100:00100000:0.0:1787857765.011322:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171655168:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857765.011376:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011406:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787857765.011411:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857765.011420:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011440:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011476:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011484:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011492:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011499:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857765.011504:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011513:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011528:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857765.011542:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c3b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857765.011618:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171655168:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 297us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857765.011627:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 263 00000100:00080000:0.0:1787857765.011661:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857765.015052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857765.015110:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171655424 00000100:00100000:2.0:1787857765.015120:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171655424 00000100:00100000:2.0:1787857765.015182:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1009 00000100:00100000:2.0:1787857765.015193:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27194:x1874704171655424:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857765.015281:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.015300:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.015310:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.015348:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.015363:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 46 pid: 19301 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857765.015393:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188238720:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857765.015494:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295600 going to sleep for 11 seconds 00000100:00100000:0.0:1787857765.025452:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857765.026712:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171655552 00000100:00100000:1.0:1787857765.026723:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171655552 00010000:00010000:1.0:1787857765.026783:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 47 pid: 19301 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857765.026878:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 303 00000100:00100000:1.0:1787857765.026889:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2349:x1874704171655552:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857765.026906:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857765.026914:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 47 pid: 19301 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857765.026930:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 47 pid: 19301 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857765.026958:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:1.0:1787857765.026964:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857765.026974:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857765.026982:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857765.027002:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857765.027063:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2349:x1874704171655552:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 176us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857765.027092:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 303 00010000:00010000:2.0:1787857765.027270:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c3b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f9 expref: 46 pid: 19301 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857765.027287:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188238720:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857765.027308:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027316:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027323:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027543:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027551:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027557:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027563:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857765.027567:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027585:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027595:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:2.0:1787857765.027598:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857765.027602:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857765.027608:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c3c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857765.028686:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27194:x1874704171655424:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 13487us (13636us total) trans 4294967944 rc 0/0 00000100:00100000:2.0:1787857765.028699:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1009 00000040:00080000:0.0:1787857765.030993:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857765.031004:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857765.031519:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787857765.031842:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857765.034340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857765.034382:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171655808 00000100:00100000:2.0:1787857765.034392:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171655808 00000100:00100000:2.0:1787857765.034453:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 199 00000100:00100000:2.0:1787857765.034463:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27194:x1874704171655808:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857765.034712:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:27194:x1874704171655808:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 249us (380us total) trans 4294967945 rc 0/0 00000100:00100000:2.0:1787857765.034720:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 199 00010000:00010000:3.0:1787857765.104803:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857765.230289:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857765.230484:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c30412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188238848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857765.230576:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857765.232382:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188238848 00000100:00100000:0.0:1787857765.232399:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188238848 00000100:00100000:0.0:1787857765.232465:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787857765.232476:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188238848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857765.232503:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 76480512 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857765.232613:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188238848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857765.232621:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787857765.232688:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c30412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188238848:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787857765.278094:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00010000:00010000:3.0:1787857766.126021:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857766.832977:0:19640:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857766.832989:0:19640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857766.833033:0:19640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 27 count 3 00000040:00080000:0.0:1787857766.833040:0:19640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857766.899285:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857766.899375:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171655936 00000100:00100000:3.0:1787857766.899386:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171655936 00000100:00100000:3.0:1787857766.899468:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 264 00000100:00100000:3.0:1787857766.899479:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171655936:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857766.899499:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857766.899517:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a00 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.899559:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857766.899564:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857766.899577:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.899595:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.899609:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:3.0:1787857766.899671:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171655936:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 195us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857766.899679:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 264 00000100:00080000:2.0:1787857766.900238:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857766.909761:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857766.913152:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171656192 00000100:00100000:1.0:1787857766.913168:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171656192 00000100:00100000:1.0:1787857766.913321:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1010 00000100:00100000:1.0:1787857766.913333:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+91:27204:x1874704171656192:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857766.913359:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857766.913385:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c3ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a07 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.913532:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c3d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.913559:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.913571:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857766.913590:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:1.0:1787857766.913742:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c3ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a07 expref: 94 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.913762:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c3d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a07 expref: 93 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.913771:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:1.0:1787857766.913778:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857766.913782:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053200, rc 0) 00000100:00100000:1.0:1787857766.913885:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+93:27204:x1874704171656192:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 554us (4138us total) trans 4294967946 rc 0/0 00000100:00100000:1.0:1787857766.913892:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1010 00000100:00080000:2.0:1787857766.915301:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857766.922855:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857766.923024:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171656320 00000100:00100000:1.0:1787857766.923044:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171656320 00000100:00100000:1.0:1787857766.923113:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:1.0:1787857766.923124:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2347:x1874704171656320:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:1.0:1787857766.923189:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.923214:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.923225:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.923233:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857766.923238:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857766.923243:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.923285:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.923305:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 13 pid: 6711 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857766.923336:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188238976:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857766.923439:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.923450:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 10 pid: 6714 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857766.923461:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188239104:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857766.923493:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857766.932240:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857766.932406:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857766.932585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171656448 00000100:00100000:0.0:1787857766.932594:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171656448 00010000:00010000:0.0:1787857766.932639:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 14 pid: 6711 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857766.932670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171656576 00000100:00100000:0.0:1787857766.932673:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171656576 00010000:00010000:0.0:1787857766.932685:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 11 pid: 6714 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857766.932707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 304 00000100:00100000:0.0:1787857766.932716:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+14:2350:x1874704171656448:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857766.932742:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787857766.932761:0:5842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1787857766.932768:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 14 pid: 6711 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857766.932781:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 14 pid: 6711 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857766.932807:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857766.932879:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+14:2350:x1874704171656448:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 163us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857766.932888:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 304 00000100:00100000:0.0:1787857766.932927:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 305 00000100:00100000:0.0:1787857766.932934:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171656576:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857766.932957:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857766.932968:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 11 pid: 6714 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857766.932980:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 11 pid: 6714 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857766.932994:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857766.932999:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857766.933004:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857766.933015:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857766.933049:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857766.933071:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171656576:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 137us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857766.933078:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 305 00010000:00010000:3.0:1787857766.936072:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7c3c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a00 expref: 13 pid: 6711 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857766.936096:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188238976:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857766.936110:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7c3a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39f2 expref: 10 pid: 6714 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857766.936120:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188239104:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857766.936147:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936668:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936676:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936736:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936745:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936754:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936762:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857766.936767:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936776:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936797:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.936837:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bc8781c/0xd3f183cab4a7c3e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857766.936935:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171656320:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 13810us (14091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857766.936946:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:3.0:1787857766.944114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857766.944203:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171656832 00000100:00100000:2.0:1787857766.944214:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171656832 00000100:00100000:2.0:1787857766.944281:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 200 00000100:00100000:2.0:1787857766.944291:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6120850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:27204:x1874704171656832:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:2.0:1787857766.944357:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c3d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a07 expref: 93 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857766.944720:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967947 00000001:00080000:2.0:1787857766.945429:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967948 00010000:00010000:2.0:1787857766.945492:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.945511:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.945519:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 96 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.945527:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 5/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.945562:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 96 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.945578:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 96 pid: 5857 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857766.945607:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d40b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188239232:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857766.945712:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.945721:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 46 pid: 5858 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857766.945743:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188239360:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857766.945768:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857766.948416:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d40b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188239232:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857766.948442:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188239360:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857766.948466:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857766.949207:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857766.949247:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857766.949403:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171656960 00000100:00100000:2.0:1787857766.949411:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171656960 00010000:00010000:2.0:1787857766.949459:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 97 pid: 5857 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857766.949488:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171657088 00000100:00100000:2.0:1787857766.949491:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171657088 00010000:00010000:2.0:1787857766.949503:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 47 pid: 5858 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857766.949524:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:2.0:1787857766.949533:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:2350:x1874704171656960:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857766.949547:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857766.949553:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 97 pid: 5857 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949585:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 97 pid: 5857 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949609:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c365 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39cf expref: 97 pid: 5857 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949629:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:2.0:1787857766.949634:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949643:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949649:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857766.949703:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+96:2350:x1874704171656960:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 171us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857766.949712:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:2.0:1787857766.949740:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 307 00000100:00100000:2.0:1787857766.949748:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171657088:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857766.949756:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857766.949760:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 47 pid: 5858 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949769:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 47 pid: 5858 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949796:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c334 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39ba expref: 47 pid: 5858 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949806:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:2.0:1787857766.949810:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949853:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949860:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.949883:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857766.950016:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2350:x1874704171657088:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 268us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857766.950024:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 307 00010000:00010000:2.0:1787857766.950233:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857766.950243:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857766.950379:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967949 00000001:00080000:2.0:1787857766.950594:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967950 00000001:00080000:2.0:1787857766.950652:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967951 00000100:00100000:2.0:1787857766.950740:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188239488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787857766.950807:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857766.950857:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fe600 going to sleep for 11 seconds 00000100:00100000:3.0:1787857766.951171:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188239488 00000100:00100000:3.0:1787857766.951178:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188239488 00000100:00100000:3.0:1787857766.951240:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787857766.951248:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188239488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787857766.951322:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188239488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857766.951329:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787857766.952406:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857766.952460:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188239488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787857766.952887:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967952 00000100:00100000:2.0:1787857766.953047:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188239616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787857766.953095:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857766.953122:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857766.953210:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188239616 00000100:00100000:3.0:1787857766.953217:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188239616 00000100:00100000:3.0:1787857766.953260:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787857766.953269:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188239616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787857766.953494:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5860:x1874704188239616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 225us (397us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787857766.953502:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787857766.953693:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188239616:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:1.0:1787857766.953717:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.953742:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.953751:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.953769:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857766.953774:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.953783:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.953804:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:1.0:1787857766.953808:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787857766.953813:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.953844:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c3ea lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857766.954057:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x3f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787857766.954164:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9096 00000004:00080000:1.0:1787857766.954178:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 591004360040ns, next at 592004357780ns, rc = 0 00000001:00080000:1.0:1787857766.954185:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967953 00010000:00010000:1.0:1787857766.954221:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998e18d9600) 00010000:00010000:1.0:1787857766.954224:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857766.954232:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c3d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a07 expref: 100 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857766.954335:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6120850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+99:27204:x1874704171656832:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 10043us (10230us total) trans 4294967954 rc 0/0 00000100:00100000:1.0:1787857766.954343:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 200 00000020:00080000:1.0:1787857766.954347:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787857766.977959:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857766.978243:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171657216 00000100:00100000:1.0:1787857766.978255:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171657216 00000100:00100000:1.0:1787857766.978364:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1011 00000100:00100000:1.0:1787857766.978375:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+99:27205:x1874704171657216:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:1.0:1787857766.978414:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857766.978446:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c3f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a0e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978519:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978535:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978548:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978565:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978573:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978580:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978693:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c406 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978700:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978717:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857766.978767:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:1.0:1787857766.978772:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857766.978793:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978807:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978844:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978852:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978857:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978863:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857766.978867:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978875:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978888:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857766.978891:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857766.978896:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978910:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c3f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978923:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978929:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978935:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978940:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857766.978943:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978949:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978957:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff9998c4eb6700) 00010000:00010000:1.0:1787857766.978959:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857766.978962:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.978968:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c3ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.979000:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c3f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a0e expref: 101 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.979038:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c406 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a0e expref: 100 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857766.979046:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998c4eb6d00) 00010000:00010000:1.0:1787857766.979048:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857766.979050:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052a00, rc 0) 00000100:00100000:1.0:1787857766.979109:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:27205:x1874704171657216:12345-192.168.204.36@tcp:101:diff.0 Request processed in 736us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857766.979117:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1011 00000100:00100000:2.0:1787857766.983245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857766.983372:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171657472 00000100:00100000:3.0:1787857766.983389:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171657472 00000100:00100000:3.0:1787857766.983593:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1012 00000100:00100000:3.0:1787857766.983605:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+100:27205:x1874704171657472:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:3.0:1787857766.983626:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857766.983647:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c40d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a15 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.983773:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c414 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.983787:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.983798:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857766.983809:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:3.0:1787857766.983966:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c40d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a15 expref: 103 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.983980:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c414 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a15 expref: 102 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.983988:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998c4eb6d00) 00010000:00010000:3.0:1787857766.983991:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857766.983994:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:3.0:1787857766.984058:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+102:27205:x1874704171657472:12345-192.168.204.36@tcp:101:diff.0 Request processed in 455us (822us total) trans 4294967955 rc 0/0 00000100:00100000:3.0:1787857766.984066:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1012 00000100:00100000:3.0:1787857766.988564:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857766.988613:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171657600 00000100:00100000:3.0:1787857766.988624:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171657600 00000100:00100000:3.0:1787857766.988685:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:3.0:1787857766.988697:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+102:2349:x1874704171657600:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857766.988713:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857766.988756:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c414 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a15 expref: 102 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.988775:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998c4eb6d00) 00010000:00010000:3.0:1787857766.988781:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857766.988851:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+101:2349:x1874704171657600:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 157us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857766.989017:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:0.0:1787857766.989503:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857766.989654:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171657856 00000100:00100000:3.0:1787857766.989659:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171657856 00000100:00100000:3.0:1787857766.989699:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:3.0:1787857766.989706:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+101:27205:x1874704171657856:12345-192.168.204.36@tcp:103:diff.0 00010000:00010000:3.0:1787857766.989715:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857766.989740:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c406 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a0e expref: 101 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.989753:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998c4eb6d00) 00010000:00010000:3.0:1787857766.989763:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857766.989794:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+100:27205:x1874704171657856:12345-192.168.204.36@tcp:103:diff.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857766.989802:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:1.0:1787857766.996035:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857766.996482:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171657984 00000100:00100000:3.0:1787857766.996492:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171657984 00000100:00100000:3.0:1787857766.996580:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1013 00000100:00100000:3.0:1787857766.996590:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:27205:x1874704171657984:12345-192.168.204.36@tcp:58:diff.0 00010000:00010000:3.0:1787857766.996692:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.996709:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857766.996732:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857766.997012:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 136 off11864 00000100:00100000:3.0:1787857766.997134:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:27205:x1874704171657984:12345-192.168.204.36@tcp:58:diff.0 Request processed in 545us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857766.997143:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1013 00000100:00100000:0.0:1787857767.014163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857767.014683:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171658112 00000100:00100000:1.0:1787857767.014695:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171658112 00000100:00100000:1.0:1787857767.014903:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1014 00000100:00100000:1.0:1787857767.014915:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:27205:x1874704171658112:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:1.0:1787857767.014935:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857767.014959:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c429 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a1c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.015027:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.015039:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c429 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a1c expref: 101 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.015059:0:5856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.015096:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c429 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a1c expref: 101 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.015112:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998d1291c00) 00010000:00010000:1.0:1787857767.015115:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857767.015119:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c429 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a1c expref: 101 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.015127:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053800, rc 0) 00000100:00100000:1.0:1787857767.015199:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+101:27205:x1874704171658112:12345-192.168.204.36@tcp:101:diff.0 Request processed in 286us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857767.015207:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1014 00000040:00080000:0.0:1787857767.087321:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857767.087330:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857767.087370:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 4 00000040:00080000:0.0:1787857767.087378:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857767.089169:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188239744:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857767.089298:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6ed43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857767.093329:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188239744:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857767.095457:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857767.096191:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171658240 00000100:00100000:1.0:1787857767.096204:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171658240 00000100:00100000:1.0:1787857767.096298:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1015 00000100:00100000:1.0:1787857767.096308:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27206:x1874704171658240:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857767.096349:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857767.096482:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27206:x1874704171658240:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 175us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857767.096489:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1015 00000100:00080000:2.0:1787857767.096569:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857767.114885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.115001:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171658368 00000100:00100000:3.0:1787857767.115012:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171658368 00000100:00100000:3.0:1787857767.115077:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1016 00000100:00100000:3.0:1787857767.115087:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27206:x1874704171658368:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857767.115197:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.115217:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.115231:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.115269:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.115278:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.115285:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115523:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115535:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115544:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857767.115593:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:2.0:1787857767.115597:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857767.115611:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115623:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115630:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115636:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115654:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.115658:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115666:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115679:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857767.115682:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857767.115687:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115694:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7c430 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115707:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115714:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115794:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115801:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.115804:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115810:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115856:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2b74b2f9 (ffff9998d1291200) 00010000:00010000:2.0:1787857767.115858:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857767.115862:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115868:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7c437 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115885:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115891:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115897:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115903:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.115906:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115912:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115920:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998d1291c00) 00010000:00010000:2.0:1787857767.115922:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857767.115925:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.115931:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c43e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.116023:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27206:x1874704171658368:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 936us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857767.116040:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1016 00000100:00100000:1.0:1787857767.121323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.121534:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171658624 00000100:00100000:3.0:1787857767.121546:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171658624 00000100:00100000:3.0:1787857767.121678:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1017 00000100:00100000:3.0:1787857767.121690:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:27206:x1874704171658624:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857767.121717:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857767.121753:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c445 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a23 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.121891:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.121907:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.121920:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857767.121930:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:3.0:1787857767.122289:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122321:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122328:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122334:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857767.122339:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122349:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122363:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998d1291c00) 00010000:00010000:3.0:1787857767.122367:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857767.122373:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122379:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c44c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122434:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c445 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a23 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122445:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857767.122448:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857767.122452:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c445 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a23 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.122462:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72a00, rc 0) 00000100:00100000:3.0:1787857767.122537:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:27206:x1874704171658624:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 849us (1229us total) trans 4294967956 rc 301/301 00000100:00100000:3.0:1787857767.122545:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1017 00000100:00100000:0.0:1787857767.130086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.130711:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171658752 00000100:00100000:2.0:1787857767.130731:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171658752 00000100:00100000:2.0:1787857767.130798:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1018 00000100:00100000:2.0:1787857767.130808:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:27206:x1874704171658752:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857767.131041:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857767.131169:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:27206:x1874704171658752:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 361us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857767.131176:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1018 00000100:00100000:2.0:1787857767.144979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.145285:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171659008 00000100:00100000:0.0:1787857767.145296:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171659008 00000100:00100000:0.0:1787857767.145369:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1019 00000100:00100000:0.0:1787857767.145381:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:27206:x1874704171659008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857767.145404:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857767.145439:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c45a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a2a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.146684:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c461 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.146702:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.146713:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857767.146736:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00010000:00010000:0.0:1787857767.146790:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c45a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a2a expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.146810:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c461 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a2a expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.146866:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:0.0:1787857767.146883:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857767.146886:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857767.147018:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:27206:x1874704171659008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1638us (2058us total) trans 4294967957 rc 0/0 00000100:00100000:0.0:1787857767.147084:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1019 00010000:00010000:2.0:1787857767.152642:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857767.159628:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.159838:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171659264 00000100:00100000:3.0:1787857767.159849:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171659264 00000100:00100000:3.0:1787857767.159925:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1020 00000100:00100000:3.0:1787857767.159936:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:27206:x1874704171659264:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857767.160000:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857767.160030:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c461 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a2a expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.160056:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:3.0:1787857767.160072:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857767.160102:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.160119:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 100 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.160129:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.160173:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 100 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.160189:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 100 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857767.160233:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188239872:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857767.160442:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857767.164436:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188239872:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857767.164472:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857767.165698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.166069:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171659392 00000100:00100000:3.0:1787857767.166080:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171659392 00010000:00010000:3.0:1787857767.166119:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 101 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857767.166160:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 308 00000100:00100000:3.0:1787857767.166170:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+101:2349:x1874704171659392:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857767.166186:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857767.166194:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 101 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.166209:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 101 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.166237:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c37a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd39dd expref: 101 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.166255:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:3.0:1787857767.166260:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.166288:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.166296:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.166331:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857767.166398:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+100:2349:x1874704171659392:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 230us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857767.166406:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 308 00010000:00010000:1.0:1787857767.168140:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168184:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168216:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168231:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168244:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168339:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168346:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168353:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168359:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857767.168363:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168370:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168384:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:1.0:1787857767.168386:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857767.168391:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168404:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c46f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168429:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168436:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168442:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168447:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857767.168450:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168457:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168464:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x99eb576e (ffff9998c4eb6700) 00010000:00010000:1.0:1787857767.168467:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857767.168470:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.168476:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c476 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x99eb576e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857767.168577:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:27206:x1874704171659264:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 8638us (8956us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857767.168586:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1020 00000100:00100000:1.0:1787857767.174807:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.174956:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171659520 00000100:00100000:2.0:1787857767.174967:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171659520 00000100:00100000:2.0:1787857767.175033:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1021 00000100:00100000:2.0:1787857767.175043:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:27206:x1874704171659520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857767.175067:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857767.175096:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c47d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.175139:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.175154:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.175213:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.175323:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c47d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.175341:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.175350:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:2.0:1787857767.175353:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857767.175356:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857767.175419:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:27206:x1874704171659520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 377us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857767.175426:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1021 00000100:00100000:0.0:1787857767.180509:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857767.180605:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171659776 00000100:00100000:1.0:1787857767.180615:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171659776 00000100:00100000:1.0:1787857767.180693:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1022 00000100:00100000:1.0:1787857767.180704:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:27206:x1874704171659776:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857767.180798:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.180853:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.180866:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857767.181090:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091a51e5a reply state 00000000bfeff38a transno 4294967958 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857767.181101:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857767.181200:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:27206:x1874704171659776:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 498us (702us total) trans 4294967958 rc 0/0 00000100:00100000:1.0:1787857767.181207:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1022 00010000:00010000:2.0:1787857767.184127:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.184143:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.184150:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.184156:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.184160:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.184180:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.184216:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:2.0:1787857767.184220:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787857767.184225:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.184231:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c48b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857767.194414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.196397:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171659904 00000100:00100000:3.0:1787857767.196414:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171659904 00000100:00100000:3.0:1787857767.197052:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1023 00000100:00100000:3.0:1787857767.197065:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:27206:x1874704171659904:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857767.197089:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857767.197111:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a38 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.197170:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.197186:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.197196:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:3.0:1787857767.197199:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857767.197203:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72200, rc 0) 00000100:00100000:3.0:1787857767.197303:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:27206:x1874704171659904:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 241us (2901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857767.197311:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1023 00000100:00100000:3.0:1787857767.200635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.202302:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171660032 00000100:00100000:2.0:1787857767.202317:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171660032 00000100:00100000:2.0:1787857767.202389:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 201 00000100:00100000:2.0:1787857767.202399:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:27206:x1874704171660032:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787857767.202992:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:27206:x1874704171660032:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 592us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857767.203002:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 201 00000100:00100000:1.0:1787857767.208675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.208864:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171660288 00000100:00100000:2.0:1787857767.208873:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171660288 00000100:00100000:2.0:1787857767.208939:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 202 00000100:00100000:2.0:1787857767.208950:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:27206:x1874704171660288:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857767.209350:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:27206:x1874704171660288:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 401us (686us total) trans 4294967959 rc 0/0 00000100:00100000:2.0:1787857767.209359:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 202 00000100:00100000:1.0:1787857767.215674:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.215933:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171660544 00000100:00100000:0.0:1787857767.215944:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171660544 00000100:00100000:0.0:1787857767.216009:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1024 00000100:00100000:0.0:1787857767.216020:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:27206:x1874704171660544:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857767.216153:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:27206:x1874704171660544:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 134us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857767.216161:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1024 00000100:00100000:3.0:1787857767.226135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.226934:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171660800 00000100:00100000:2.0:1787857767.226949:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171660800 00000100:00100000:2.0:1787857767.227041:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1025 00000100:00100000:2.0:1787857767.227061:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:27206:x1874704171660800:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857767.227102:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857767.227126:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a3f expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.227233:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.227249:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.227259:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.227291:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.227304:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 53 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.227319:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7049a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188240000:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857767.227437:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857767.236125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.236665:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171660928 00000100:00100000:0.0:1787857767.236675:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171660928 00010000:00010000:0.0:1787857767.236735:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 54 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857767.236790:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 309 00000100:00100000:0.0:1787857767.236799:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171660928:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857767.236854:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857767.236862:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 54 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.236876:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 54 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.236921:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:0.0:1787857767.236926:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.236936:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.236944:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.236963:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857767.237015:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171660928:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 218us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857767.237023:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 309 00010000:00010000:2.0:1787857767.237191:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c492 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a38 expref: 54 pid: 5856 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.237213:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7049a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188240000:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857767.237234:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.237255:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.237262:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857767.237292:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00000004:00080000:2.0:1787857767.237657:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:2.0:1787857767.238158:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238167:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238173:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238179:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.238183:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238191:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238204:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:2.0:1787857767.238208:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857767.238212:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238218:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4a0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238790:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c499 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a3f expref: 53 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238804:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9998c3984500) 00010000:00010000:2.0:1787857767.238806:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857767.238810:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a3f expref: 53 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.238904:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75c00, rc 0) 00000100:00100000:2.0:1787857767.238958:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:27206:x1874704171660800:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 11907us (12833us total) trans 4294967960 rc 301/301 00000100:00100000:2.0:1787857767.238966:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1025 00000100:00100000:3.0:1787857767.242400:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.243221:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171661184 00000100:00100000:2.0:1787857767.243233:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171661184 00000100:00100000:2.0:1787857767.243315:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:2.0:1787857767.243325:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:27206:x1874704171661184:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857767.243734:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:27206:x1874704171661184:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 393us (1331us total) trans 4294967961 rc 0/0 00000100:00100000:2.0:1787857767.243743:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:1.0:1787857767.248894:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.248958:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171661312 00000100:00100000:3.0:1787857767.248968:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171661312 00000100:00100000:3.0:1787857767.249040:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1026 00000100:00100000:3.0:1787857767.249060:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:27206:x1874704171661312:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857767.249085:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857767.249106:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c4ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a46 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.249201:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c4b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.249216:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.249228:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857767.249265:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00000004:00200000:3.0:1787857767.249281:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857767.249302:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.249329:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c4ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a46 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.249359:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a46 expref: 54 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.249379:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:3.0:1787857767.249383:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787857767.249386:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857767.249679:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:27206:x1874704171661312:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 629us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857767.249687:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1026 00000100:00100000:3.0:1787857767.258665:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.258776:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171661440 00000100:00100000:0.0:1787857767.258786:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171661440 00000100:00100000:0.0:1787857767.258892:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:0.0:1787857767.258903:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171661440:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857767.258922:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857767.258944:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a4d expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857767.258972:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857767.258993:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1787857767.258998:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857767.259008:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787857767.259151:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857767.259335:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.259352:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71000, rc 0) 00000100:00100000:0.0:1787857767.259612:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171661440:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 710us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857767.259620:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:1.0:1787857767.262955:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.263488:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171661696 00000100:00100000:0.0:1787857767.263498:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171661696 00000100:00100000:0.0:1787857767.263617:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1027 00000100:00100000:0.0:1787857767.263628:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:27206:x1874704171661696:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857767.263753:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:27206:x1874704171661696:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 126us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857767.263760:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1027 00000100:00100000:1.0:1787857767.268811:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.268911:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171661824 00000100:00100000:3.0:1787857767.268921:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171661824 00000100:00100000:3.0:1787857767.268965:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 267 00000100:00100000:3.0:1787857767.268973:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:27206:x1874704171661824:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857767.268992:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857767.269007:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a54 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.269057:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.269066:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857767.269071:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857767.269076:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.269128:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.269143:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 10 pid: 8490 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857767.269156:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188240128:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857767.269250:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857767.272582:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.272727:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188240128:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857767.272766:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.272787:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72c00, rc 0) 00000100:00100000:0.0:1787857767.272888:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:27206:x1874704171661824:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3914us (4086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857767.272898:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 267 00000100:00100000:2.0:1787857767.278688:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171661952 00000100:00100000:2.0:1787857767.278707:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171661952 00010000:00010000:2.0:1787857767.278777:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 10 pid: 8490 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.278926:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 310 00000100:00100000:2.0:1787857767.278953:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171661952:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857767.278971:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857767.278998:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 10 pid: 8490 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.279025:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 10 pid: 8490 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.279060:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028c7edf/0xd3f183cab4a7c4bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a4d expref: 10 pid: 8490 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.279080:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857767.279085:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857767.279093:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.279105:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.279146:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.279163:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7049a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874704188240256:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857767.279260:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857767.284942:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.285026:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171662080 00000100:00100000:3.0:1787857767.285038:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171662080 00002000:00100000:3.0:1787857767.285318:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x14:0x0] (0->157) req@ffff9998f7044b40 x1874704171662080/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:413/0 lens 648/0 e 0 to 0 dl 1787857778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857767.285329:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7044b40 with x1874704171662080 ext(0->157) 00002000:00010000:3.0:1787857767.285335:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7044b40 00000100:00100000:3.0:1787857767.285380:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 94 00000100:00100000:3.0:1787857767.285391:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171662080:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787857767.288371:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171662080:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 2970us (3430us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787857767.288385:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 94 00002000:00100000:3.0:1787857767.288400:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x14:0x0] (0->157) req@ffff9998f7044b40 x1874704171662080/t4294967348(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:413/0 lens 648/448 e 0 to 0 dl 1787857778 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857767.288427:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7044b40 with x1874704171662080 ext(0->157) 00002000:00010000:3.0:1787857767.288433:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7044b40 00000100:00100000:3.0:1787857767.288868:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7049a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874704188240256:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857767.288896:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857767.288978:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171661952:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 10027us (16408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857767.288987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 310 00000100:00100000:0.0:1787857767.293003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.293254:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171662208 00000100:00100000:2.0:1787857767.293271:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171662208 00000100:00100000:2.0:1787857767.293342:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1028 00000100:00100000:2.0:1787857767.293352:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:27206:x1874704171662208:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787857767.382048:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967957 is committed 00000001:00080000:1.0:1787857767.382096:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967958 is committed 00000001:00080000:1.0:1787857767.382103:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967954 is committed 00000004:00080000:1.0:1787857767.382107:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000001:00080000:1.0:1787857767.382134:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967961 is committed 00000020:00080000:1.0:1787857767.382147:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998f70fe600 refcount 2 committed 0 result 0 batchid 17 00000020:00080000:1.0:1787857767.382153:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9999013d1800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998f70fea80 00000020:00080000:1.0:1787857767.382156:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9999013d1d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998ffb55800 00000001:00080000:1.0:1787857767.382206:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967955 is committed 00000020:00080000:1.0:1787857767.382223:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 17 committed batchid 16 00000020:00080000:1.0:1787857767.382444:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000100:00100000:3.0:1787857767.382762:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857767.382783:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188240384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787857767.382873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857767.382934:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188240384 00000100:00100000:3.0:1787857767.382942:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188240384 00000100:00100000:3.0:1787857767.382991:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787857767.383000:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188240384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787857767.383027:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00002000:00010000:3.0:1787857767.383071:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a908b63, atime: 0x0, ctime: 0x6a908b63, blocks: 0xb 00010000:00010000:3.0:1787857767.383079:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383097:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1787857767.383102:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857767.383109:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383121:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383143:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383152:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383172:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857767.383800:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874704188240384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 798us (925us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787857767.383810:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00010000:3.0:1787857767.383867:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857767.383874:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383883:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857767.383887:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383897:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383914:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383921:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e02ba9/0xd3f183cab4a7c4ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.383949:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857767.383951:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857767.383953:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787857767.383984:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999901452940/2, rc 0, transno 4294967356 00000100:00100000:3.0:1787857767.383991:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188240384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787857767.384545:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:27206:x1874704171662208:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 91190us (91549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857767.384556:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1028 00000100:00100000:1.0:1787857767.387449:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.387545:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171662336 00000100:00100000:0.0:1787857767.387559:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171662336 00000100:00100000:0.0:1787857767.387619:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 269 00000100:00100000:0.0:1787857767.387629:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171662336:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787857767.467652:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171662336:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 80012us (80199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857767.467668:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 269 00000001:00080000:0.0:1787857767.467724:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000100:00100000:0.0:1787857767.472534:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.472624:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171662592 00000100:00100000:2.0:1787857767.472635:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171662592 00000100:00100000:2.0:1787857767.472699:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1029 00000100:00100000:2.0:1787857767.472709:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:27206:x1874704171662592:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857767.472806:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857767.472856:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c4b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a46 expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.472877:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:2.0:1787857767.472883:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857767.472913:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.472929:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.472939:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857767.473145:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d73a4120 reply state 00000000caeea330 transno 4294967962 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.473155:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857767.473274:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:27206:x1874704171662592:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 564us (749us total) trans 4294967962 rc 0/0 00000100:00100000:2.0:1787857767.473281:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1029 00010000:00010000:2.0:1787857767.475915:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.475933:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.475941:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.475947:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.475952:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.475960:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.475977:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:2.0:1787857767.475981:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857767.475986:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.475991:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c4d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857767.476531:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.476620:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171662720 00000100:00100000:0.0:1787857767.476632:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171662720 00000100:00100000:0.0:1787857767.476771:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1030 00000100:00100000:0.0:1787857767.476783:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:27206:x1874704171662720:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857767.476808:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857767.476846:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a5b expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.476909:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 44 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.476923:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 44 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.476943:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:0.0:1787857767.476946:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857767.476949:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70000, rc 0) 00000100:00100000:0.0:1787857767.477051:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:27206:x1874704171662720:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 261us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857767.477085:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1030 00000100:00100000:1.0:1787857767.480734:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.480852:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171662848 00000100:00100000:0.0:1787857767.480862:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171662848 00000100:00100000:0.0:1787857767.480983:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:0.0:1787857767.480995:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171662848:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787857767.481310:0:6714:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787857767.481314:0:6714:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1787857763 00002000:00010000:0.0:1787857767.481317:0:6714:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb atime from disk: 0 -> 1787857763 00002000:00010000:0.0:1787857767.481319:0:6714:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1787857763 00002000:00010000:0.0:1787857767.481321:0:6714:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787857767.481405:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171662848:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 411us (696us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787857767.481418:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:1.0:1787857767.483606:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.483752:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171663104 00000100:00100000:2.0:1787857767.483762:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171663104 00000100:00100000:2.0:1787857767.483854:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1031 00000100:00100000:2.0:1787857767.483863:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:27206:x1874704171663104:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787857767.483947:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.483965:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 44 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.483975:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.484011:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 44 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.484025:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 44 pid: 5858 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.484040:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704b840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188240512:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857767.484133:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fe300 going to sleep for 11 seconds 00000100:00100000:2.0:1787857767.488322:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704b840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188240512:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857767.488355:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857767.489363:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.490568:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171663232 00000100:00100000:3.0:1787857767.490587:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171663232 00010000:00010000:3.0:1787857767.490658:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 45 pid: 5858 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857767.490787:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 311 00000100:00100000:3.0:1787857767.490802:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2349:x1874704171663232:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857767.490868:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857767.490877:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 45 pid: 5858 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.490894:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 45 pid: 5858 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.490939:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c484 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a31 expref: 45 pid: 5858 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.490963:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:3.0:1787857767.490969:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.491001:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.491011:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.491043:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857767.491151:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171663232:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 351us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857767.491160:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 311 00010000:00010000:2.0:1787857767.493539:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.493559:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.493596:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.493623:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.493631:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.493637:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.493642:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.493650:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.493669:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:2.0:1787857767.493672:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787857767.493677:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.493683:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c4df lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.493865:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:27206:x1874704171663104:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 9998us (10264us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787857767.493875:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1031 00000100:00100000:3.0:1787857767.498884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.499070:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171663360 00000100:00100000:0.0:1787857767.499080:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171663360 00000100:00100000:0.0:1787857767.499141:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 271 00000100:00100000:0.0:1787857767.499150:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171663360:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857767.499195:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.499214:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.499223:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857767.499227:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857767.499244:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.499275:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.499289:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 10 pid: 6714 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857767.499304:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3041680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188240640:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857767.499383:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb7fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857767.501439:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3041680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188240640:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857767.501474:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857767.506649:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857767.508438:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171663488 00000100:00100000:2.0:1787857767.508460:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171663488 00010000:00010000:2.0:1787857767.508529:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 11 pid: 6714 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.508580:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 312 00000100:00100000:2.0:1787857767.508613:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171663488:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857767.508634:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857767.508670:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 11 pid: 6714 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.508687:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 11 pid: 6714 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.508730:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7c4c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a54 expref: 11 pid: 6714 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.508760:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857767.508766:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857767.508773:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.508785:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.508869:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857767.508952:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171663488:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 340us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857767.508960:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 312 00010000:00010000:3.0:1787857767.509429:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.509441:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.509472:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.509480:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.509489:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.509512:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857767.509517:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.509527:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.509541:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.509548:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c4e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857767.509770:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171663360:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 10617us (10895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857767.509780:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 271 00000100:00100000:2.0:1787857767.512656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.512812:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171663744 00000100:00100000:0.0:1787857767.512865:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171663744 00000100:00100000:0.0:1787857767.512945:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1032 00000100:00100000:0.0:1787857767.512958:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:27206:x1874704171663744:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787857767.513109:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.513133:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.513148:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.513505:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.513517:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 44 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.513528:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.513595:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 44 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857767.513613:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 44 pid: 19301 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857767.513635:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188240768:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857767.514018:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857767.516604:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188240768:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857767.516646:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.518065:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.518461:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171663872 00000100:00100000:3.0:1787857767.518473:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171663872 00010000:00010000:3.0:1787857767.518528:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 45 pid: 19301 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857767.518628:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 313 00000100:00100000:3.0:1787857767.518640:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2350:x1874704171663872:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857767.518662:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857767.518689:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 45 pid: 19301 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.518706:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 45 pid: 19301 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.518751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c4d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a5b expref: 45 pid: 19301 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.518774:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:3.0:1787857767.518781:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.518793:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.518802:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.518914:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857767.518990:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2350:x1874704171663872:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 351us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857767.518998:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 313 00010000:00010000:2.0:1787857767.519326:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.519335:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857767.519614:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967963 00000001:00080000:2.0:1787857767.519808:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967964 00000001:00080000:2.0:1787857767.519932:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967965 00000100:00100000:2.0:1787857767.520047:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188240896:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787857767.520122:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857767.520193:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857767.520630:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188240896 00000100:00100000:3.0:1787857767.520638:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188240896 00000100:00100000:3.0:1787857767.520753:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787857767.520762:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188240896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787857767.520903:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188240896:12345-0@lo:1000:mdt00_002.0 Request processed in 141us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857767.520930:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787857767.521029:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857767.521074:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188240896:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787857767.521614:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967966 00000100:00100000:2.0:1787857767.522005:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b43480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188241024:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787857767.522068:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857767.522167:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857767.522209:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188241024 00000100:00100000:3.0:1787857767.522217:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188241024 00000100:00100000:3.0:1787857767.522306:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787857767.522317:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188241024:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787857767.522581:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1874704188241024:12345-0@lo:1000:mdt00_002.0 Request processed in 265us (511us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787857767.522590:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787857767.522665:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b43480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188241024:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787857767.522812:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967967 00010000:00010000:2.0:1787857767.522871:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.522884:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.522892:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.522915:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.522921:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.522930:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.522951:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9800) 00010000:00010000:2.0:1787857767.522954:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857767.522960:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.522967:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c4f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523009:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523015:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523021:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523026:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857767.523030:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523036:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523055:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998d1291c00) 00010000:00010000:2.0:1787857767.523057:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857767.523066:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c429 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a1c expref: 88 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523079:0:5858:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c429 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a1c expref: 88 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523090:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a1c expref: 88 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.523128:0:5858:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053800/0xd3f183cab4a7c429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a1c expref: 88 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.523143:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188241152:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857767.523237:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eeef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857767.532959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857767.533055:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171664000 00000100:00100000:1.0:1787857767.533068:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171664000 00000100:00100000:1.0:1787857767.533147:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:1.0:1787857767.533160:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:27205:x1874704171664000:12345-192.168.204.36@tcp:49:diff.0 00000100:00100000:1.0:1787857767.533363:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:27205:x1874704171664000:12345-192.168.204.36@tcp:49:diff.0 Request processed in 206us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857767.533371:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:3.0:1787857767.536354:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188241152:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857767.536404:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.536418:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7c422 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857767.538007:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:0.0:1787857767.538194:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.538258:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171664128 00000100:00100000:2.0:1787857767.538270:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171664128 00010000:00010000:0.0:1787857767.538380:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538398:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538438:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538446:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538455:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538462:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857767.538468:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538478:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538496:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998d1291c00) 00010000:00010000:0.0:1787857767.538499:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857767.538505:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538512:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7c4fb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538530:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538538:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538545:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538558:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857767.538561:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857767.538569:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 272 00010000:00010000:0.0:1787857767.538572:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538585:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff9998d1291c00) 00000100:00100000:2.0:1787857767.538586:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:27205:x1874704171664128:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:0.0:1787857767.538592:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857767.538597:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857767.538604:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c4ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.538612:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857767.538636:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7c502 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a62 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857767.538674:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 158, mtime: 0x6a908b63, atime: 0x6a908b63, ctime: 0x6a908b63, blocks: 0xb 00010000:00010000:2.0:1787857767.538708:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=591s v=(0 0) 00010000:00010000:2.0:1787857767.538725:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857767.538738:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7c502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a62 expref: 14 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.538757:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d4f5032/0xd3f183cab4a7c502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a62 expref: 14 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.538771:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75400, rc 0) 00000100:00100000:2.0:1787857767.538876:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+14:27205:x1874704171664128:12345-192.168.204.36@tcp:101:diff.0 Request processed in 295us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857767.538884:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 272 00000100:00100000:0.0:1787857767.539365:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:27206:x1874704171663744:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 26332us (26648us total) trans 4294967968 rc 0/0 00000100:00100000:0.0:1787857767.539378:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1032 00000020:00080000:0.0:1787857767.539384:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787857767.539635:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857767.539642:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00080000:3.0:1787857767.540469:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787857767.540491:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787857767.540503:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857767.543904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857767.543967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857767.544056:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171664512 00000100:00100000:0.0:1787857767.544070:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171664512 00000100:00100000:2.0:1787857767.544121:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171664384 00000100:00100000:2.0:1787857767.544128:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171664384 00002000:00100000:0.0:1787857767.544149:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x14:0x0] (0->4095) req@ffff9997c2ca0780 x1874704171664512/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:413/0 lens 488/0 e 0 to 0 dl 1787857778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857767.544172:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2ca0780 with x1874704171664512 ext(0->4095) 00002000:00010000:0.0:1787857767.544182:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c2ca0780 00000100:00100000:2.0:1787857767.544188:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 205 00000100:00100000:2.0:1787857767.544202:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6120c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:27206:x1874704171664384:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857767.544367:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 95 00000100:00100000:0.0:1787857767.544377:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+14:2350:x1874704171664512:12345-192.168.204.36@tcp:3:diff.0 00000100:00100000:0.0:1787857767.544668:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+14:2350:x1874704171664512:12345-192.168.204.36@tcp:3:diff.0 Request processed in 291us (698us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857767.544677:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 95 00002000:00100000:0.0:1787857767.544685:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x14:0x0] (0->4095) req@ffff9997c2ca0780 x1874704171664512/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:413/0 lens 488/4536 e 0 to 0 dl 1787857778 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857767.544694:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2ca0780 with x1874704171664512 ext(0->4095) 00002000:00010000:0.0:1787857767.544698:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c2ca0780 00000004:00080000:2.0:1787857767.545446:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x1c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787857767.545581:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967969 00010000:00010000:2.0:1787857767.545648:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.545669:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.545696:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.545707:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.545727:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.545735:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.545909:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857767.546030:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6120c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:27206:x1874704171664384:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1826us (2139us total) trans 4294967970 rc 0/0 00000100:00100000:2.0:1787857767.546041:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 205 00000020:00080000:2.0:1787857767.546047:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787857767.548071:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857767.548089:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.548102:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857767.548107:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.548118:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.548139:0:17404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff9998e18d9a00) 00010000:00010000:3.0:1787857767.548142:0:17404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857767.548173:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857767.548180:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c509 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857767.548634:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857767.548638:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857767.548640:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857767.554393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857767.554542:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171664768 00000100:00100000:3.0:1787857767.554555:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171664768 00000100:00100000:3.0:1787857767.554629:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 206 00000100:00100000:3.0:1787857767.554641:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:27205:x1874704171664768:12345-192.168.204.36@tcp:35:diff.0 00000100:00100000:3.0:1787857767.555014:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+90:27205:x1874704171664768:12345-192.168.204.36@tcp:35:diff.0 Request processed in 375us (639us total) trans 4294967971 rc 0/0 00000100:00100000:3.0:1787857767.555025:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 206 00010000:00010000:1.0:1787857768.180480:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857768.303306:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857768.303338:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188241280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857768.303447:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857768.303534:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188241280 00000100:00100000:3.0:1787857768.303545:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188241280 00000100:00100000:3.0:1787857768.303602:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787857768.303611:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188241280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857768.303641:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3854565376 00000100:00100000:3.0:1787857768.303692:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188241280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857768.303712:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787857768.303769:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188241280:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787857768.671673:0:19692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857768.673702:0:19692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857768.674012:0:19692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 4 00000040:00080000:1.0:1787857768.674020:0:19692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857769.198208:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857769.551592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857769.553421:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171664896 00000100:00100000:1.0:1787857769.553436:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171664896 00000100:00100000:1.0:1787857769.553530:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 561 00000100:00100000:1.0:1787857769.553542:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171664896:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857769.553630:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171664896:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 90us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857769.553639:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 561 00000100:00100000:0.0:1787857769.569482:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857769.569599:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857769.570644:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171665152 00000100:00100000:3.0:1787857769.570663:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171665152 00000100:00100000:3.0:1787857769.570799:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 384 00000100:00100000:3.0:1787857769.570875:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171665152:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857769.571002:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171665152:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 134us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857769.571011:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 384 00000100:00100000:1.0:1787857769.572001:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171665024 00000100:00100000:1.0:1787857769.572020:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171665024 00000100:00080000:2.0:1787857769.572611:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857769.574923:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00100000:3.0:1787857769.574938:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+90:2347:x1874704171665024:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857769.575091:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+90:2347:x1874704171665024:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 156us (5620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857769.575099:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00080000:2.0:1787857769.575233:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857769.580502:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857769.580540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857769.580573:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857769.580609:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171665280 00000100:00100000:0.0:1787857769.580617:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857769.580621:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171665280 00000100:00080000:0.0:1787857769.580666:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857769.580694:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171665536 00000100:00100000:2.0:1787857769.580698:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171665536 00000100:00100000:2.0:1787857769.580734:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171665664 00000100:00100000:2.0:1787857769.580737:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171665664 00000100:00080000:0.0:1787857769.580772:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857769.580776:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857769.580779:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 385 00000100:00100000:2.0:1787857769.580792:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171665280:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857769.580898:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 386 00000100:00100000:0.0:1787857769.580909:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171665536:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857769.580924:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171665280:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 133us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857769.580935:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 385 00000100:00100000:0.0:1787857769.580947:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171665536:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857769.580955:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 386 00000100:00100000:2.0:1787857769.580962:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 387 00000100:00100000:2.0:1787857769.580973:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171665664:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857769.581002:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171665664:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857769.581010:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 387 00000100:00100000:1.0:1787857769.582174:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171665408 00000100:00100000:1.0:1787857769.582185:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171665408 00000100:00100000:1.0:1787857769.582248:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00100000:1.0:1787857769.582256:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2347:x1874704171665408:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857769.582316:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2347:x1874704171665408:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 61us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857769.582323:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00080000:2.0:1787857769.582485:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857769.838039:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188241536:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857769.838167:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188242048:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838194:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857769.838233:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787857769.838240:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188241408:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857769.838292:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188241920:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857769.838342:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188241664:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857769.838385:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857769.838390:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188241792:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857769.838444:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188241536 00000100:00100000:0.0:1787857769.838451:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188241536 00000100:00100000:0.0:1787857769.838494:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188241920 00000100:00100000:0.0:1787857769.838497:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188241920 00000100:00100000:0.0:1787857769.838523:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188241664 00000100:00100000:0.0:1787857769.838526:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188241664 00000100:00100000:0.0:1787857769.838543:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787857769.838552:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188241536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838600:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188241536:12345-0@lo:400:kworker.0 Request processed in 49us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857769.838607:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787857769.838626:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787857769.838632:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188241920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838659:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188241920:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857769.838665:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787857769.838758:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1787857769.838771:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188241664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838806:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188241664:12345-0@lo:400:kworker.0 Request processed in 36us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857769.838812:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1787857769.838853:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188242048 00000100:00100000:0.0:1787857769.838857:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188242048 00000100:00100000:0.0:1787857769.838883:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188241792 00000100:00100000:0.0:1787857769.838886:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188241792 00000100:00100000:0.0:1787857769.838904:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787857769.838911:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188242048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838941:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188242048:12345-0@lo:400:kworker.0 Request processed in 31us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857769.838947:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787857769.838959:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787857769.838965:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188241792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.838991:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188241792:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857769.838996:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787857769.839013:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188241408 00000100:00100000:0.0:1787857769.839016:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188241408 00000100:00100000:0.0:1787857769.839040:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1787857769.839046:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188241408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.839075:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188241408:12345-0@lo:400:kworker.0 Request processed in 29us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857769.839081:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00080000:0.0:1787857769.839121:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857769.839124:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857769.839132:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857769.839172:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188241792:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.839182:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188241664:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.839208:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188241408:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.839216:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188241920:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.839226:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188241536:0@lo:400:kworker.0 00000100:00100000:0.0:1787857769.839236:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188242048:0@lo:400:kworker.0 00010000:00010000:2.0:1787857770.222961:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857770.351460:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188242176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857770.351561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857770.351668:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188242176 00000100:00100000:2.0:1787857770.351677:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188242176 00000100:00100000:2.0:1787857770.351738:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787857770.351749:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188242176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857770.351795:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857770.351880:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188242176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857770.351888:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787857770.351944:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188242176:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787857770.419114:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967356 is committed 00010000:00010000:2.0:1787857771.246116:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857772.272966:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787857772.469297:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000001:00080000:3.0:1787857772.469332:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000001:00080000:2.0:1787857772.477711:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967963 is committed 00000020:00080000:2.0:1787857772.477741:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 17 batchid updated 00000001:00080000:2.0:1787857772.477761:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967970 is committed 00000020:00080000:2.0:1787857772.477780:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998f0df4b40 refcount 2 committed 0 result 0 batchid 18 00000020:00080000:2.0:1787857772.477786:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998efad8300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998f0df4c00 00000020:00080000:2.0:1787857772.477790:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998efad8c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998f9ae2000 00000001:00080000:2.0:1787857772.477809:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967971 is committed 00000020:00080000:2.0:1787857772.477842:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 18 committed batchid 17 00000020:00080000:2.0:1787857772.478137:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17 00010000:00010000:2.0:1787857773.294015:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857773.422057:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188242304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857773.422142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857773.422304:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188242304 00000100:00100000:3.0:1787857773.422321:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188242304 00000100:00100000:3.0:1787857773.422383:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787857773.422392:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188242304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857773.422426:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857773.422467:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188242304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857773.422473:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1787857773.422619:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857773.422646:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967350 gen 2 00000004:00080000:0.0:1787857773.422652:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967350 committed transno 4294967350 00000100:00100000:0.0:1787857773.422680:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188242304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857773.495774:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857773.496619:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171665792 00000100:00100000:2.0:1787857773.496634:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171665792 00000100:00080000:0.0:1787857773.496814:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857773.496927:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1033 00000100:00100000:3.0:1787857773.496941:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27177:x1874704171665792:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787857773.497050:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:27177:x1874704171665792:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 113us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857773.497057:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1033 00000040:00080000:3.0:1787857773.678442:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857773.678451:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857773.679209:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 3 00000040:00080000:3.0:1787857773.679218:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857774.318253:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857774.677977:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857774.678026:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857774.678059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857774.678087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857774.678482:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171666048 00000100:00100000:0.0:1787857774.678497:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171666048 00000100:00080000:2.0:1787857774.678601:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857774.678603:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:0.0:1787857774.678617:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:2348:x1874704171666048:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857774.678645:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171666304 00000100:00100000:2.0:1787857774.678649:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171666304 00000100:00100000:2.0:1787857774.678686:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171666560 00000100:00100000:2.0:1787857774.678688:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171666560 00000100:00100000:2.0:1787857774.678710:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 390 00000100:00100000:2.0:1787857774.678718:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171666304:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857774.678726:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+89:2348:x1874704171666048:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 113us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857774.678734:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:2.0:1787857774.678761:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171666304:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 45us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857774.678767:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 391 00000100:00100000:0.0:1787857774.678796:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171666560:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857774.678848:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171666560:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 53us (788us total) trans 0 rc 0/0 00000100:00080000:3.0:1787857774.678916:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857774.678920:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857774.678962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857774.678987:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857774.679015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857774.679034:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171666176 00000100:00100000:3.0:1787857774.679038:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171666176 00000100:00100000:1.0:1787857774.679208:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171666688 00000100:00100000:1.0:1787857774.679212:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171666688 00000100:00100000:2.0:1787857774.684562:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 390 00000100:00080000:2.0:1787857774.685516:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857774.685529:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857774.685583:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171666432 00000100:00100000:2.0:1787857774.685596:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171666432 00000100:00100000:2.0:1787857774.685682:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:2.0:1787857774.685694:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:2348:x1874704171666432:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857774.685866:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:2348:x1874704171666432:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 174us (6875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857774.685874:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:2.0:1787857774.685981:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171665920 00000100:00100000:2.0:1787857774.685986:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171665920 00000100:00100000:2.0:1787857774.686017:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 563 00000100:00100000:2.0:1787857774.686037:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171665920:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857774.686082:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171665920:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 59us (7993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857774.686088:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 563 00000100:00100000:0.0:1787857774.686696:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 391 00000100:00100000:2.0:1787857774.691374:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00100000:2.0:1787857774.691405:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171666176:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857774.691533:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171666176:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 143us (12570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857774.691543:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00100000:2.0:1787857774.691585:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00100000:2.0:1787857774.691595:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171666688:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857774.691630:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171666688:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (12613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857774.691637:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00100000:1.0:1787857774.958603:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188242432:0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.958722:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857774.958806:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188242944:0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.958870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857774.958901:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787857774.958906:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188242560:0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.958956:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857774.958980:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188243072:0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.959006:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857774.959056:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188242944 00000100:00100000:1.0:1787857774.959065:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188242944 00000100:00100000:1.0:1787857774.959344:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188242560 00000100:00100000:1.0:1787857774.959349:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188242560 00000100:00100000:1.0:1787857774.959372:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787857774.959383:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188242944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.959447:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188242944:12345-0@lo:400:kworker.0 Request processed in 66us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857774.959456:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787857774.959480:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1787857774.959487:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188242560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.959519:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188242560:12345-0@lo:400:kworker.0 Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857774.959526:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1787857774.959585:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188242560:0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.959598:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188242944:0@lo:400:kworker.0 00000100:00100000:2.0:1787857774.961957:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188242432 00000100:00100000:2.0:1787857774.961975:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188242432 00000100:00100000:2.0:1787857774.962082:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1787857774.962104:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188242432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857774.962261:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188242432:12345-0@lo:400:kworker.0 Request processed in 160us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857774.962270:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00080000:2.0:1787857774.962339:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857774.962588:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188242688:0@lo:400:kworker.0 00000100:00100000:3.0:1787857774.962644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857774.962697:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857774.962705:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188242816:0@lo:400:kworker.0 00000100:00100000:3.0:1787857774.962747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857774.962781:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188242688 00000100:00100000:3.0:1787857774.962787:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188242688 00000100:00100000:3.0:1787857774.962893:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1787857774.962902:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188242688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857774.962949:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188242688:12345-0@lo:400:kworker.0 Request processed in 50us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857774.962955:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00080000:3.0:1787857774.962972:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857774.963007:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188242688:0@lo:400:kworker.0 00000100:00100000:0.0:1787857774.963458:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188243072 00000100:00100000:0.0:1787857774.963466:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188243072 00000100:00100000:0.0:1787857774.963520:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188242816 00000100:00100000:0.0:1787857774.963524:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188242816 00000100:00100000:0.0:1787857774.963547:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787857774.963555:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188243072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857774.963733:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188243072:12345-0@lo:400:kworker.0 Request processed in 169us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857774.963741:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787857774.963760:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787857774.963767:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188242816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857774.963804:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188242816:12345-0@lo:400:kworker.0 Request processed in 38us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857774.963809:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787857774.963873:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188242816:0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.964398:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967356 gen 2 00000004:00080000:1.0:1787857774.964409:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967355 committed transno 4294967356 00000004:00080000:1.0:1787857774.964434:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999901452940, transno 4294967356 00000100:00100000:1.0:1787857774.964463:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188243072:0@lo:400:kworker.0 00000100:00100000:1.0:1787857774.964478:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188242432:0@lo:400:kworker.0 00000100:00080000:3.0:1787857774.965135:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787857775.342096:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857775.470688:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188243200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857775.470771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857775.471270:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188243200 00000100:00100000:3.0:1787857775.471279:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188243200 00000100:00100000:3.0:1787857775.471344:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787857775.471354:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188243200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857775.471390:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857775.471462:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188243200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857775.471469:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787857775.471522:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188243200:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787857776.021303:0:19894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 15:09:33 (1787857773) 00010000:00010000:1.0:1787857776.365990:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857777.390021:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787857777.610227:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 18 batchid updated 00000020:00080000:0.0:1787857777.610263:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00000020:00080000:0.0:1787857777.610276:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00000001:02000400:2.0:1787857777.928561:0:19943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 00010000:00010000:2.0:1787857778.414121:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857778.542555:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188243328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857778.542631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857778.542807:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188243328 00000100:00100000:2.0:1787857778.542868:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188243328 00000100:00100000:2.0:1787857778.542939:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787857778.542949:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188243328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857778.542984:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787857778.543056:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857778.545564:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188243328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2608us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857778.545582:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787857778.549494:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188243328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857779.438018:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857779.796642:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857779.796683:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857779.796715:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857779.796738:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857779.796754:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857779.796780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857779.796806:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857779.796861:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171667328 00000100:00100000:3.0:1787857779.796869:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171667328 00000100:00100000:3.0:1787857779.796919:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171666944 00000100:00100000:3.0:1787857779.796921:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171666944 00000100:00100000:3.0:1787857779.796938:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00100000:3.0:1787857779.796947:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:2349:x1874704171667328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857779.797019:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:2349:x1874704171667328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857779.797026:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00100000:3.0:1787857779.797043:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:3.0:1787857779.797048:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:2349:x1874704171666944:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857779.797067:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+89:2349:x1874704171666944:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 19us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857779.797086:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:1.0:1787857779.797388:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171667072 00000100:00100000:1.0:1787857779.797394:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171667072 00000100:00100000:1.0:1787857779.797433:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171667584 00000100:00100000:1.0:1787857779.797436:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171667584 00000100:00100000:1.0:1787857779.797451:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171667200 00000100:00100000:1.0:1787857779.797453:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171667200 00000100:00100000:1.0:1787857779.797464:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171667456 00000100:00100000:1.0:1787857779.797466:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171667456 00000100:00100000:1.0:1787857779.797491:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 396 00000100:00100000:1.0:1787857779.797499:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+14:2349:x1874704171667072:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857779.797542:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+14:2349:x1874704171667072:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 43us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857779.797549:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 396 00000100:00100000:1.0:1787857779.797564:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:1.0:1787857779.797570:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171667584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857779.797595:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171667584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857779.797601:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:1.0:1787857779.797613:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:1.0:1787857779.797618:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171667200:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857779.797642:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171667200:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857779.797645:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 399 00000100:00100000:3.0:1787857779.797656:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171667456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857779.797661:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:3.0:1787857779.797694:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171667456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857779.797702:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 399 00000100:00100000:0.0:1787857779.798355:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171666816 00000100:00100000:0.0:1787857779.798362:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171666816 00000100:00100000:0.0:1787857779.798410:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 565 00000100:00100000:0.0:1787857779.798419:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171666816:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857779.798460:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171666816:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 44us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857779.798487:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 565 00000100:00080000:0.0:1787857779.798531:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857779.798535:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857779.798538:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857780.084192:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188243712:0@lo:400:kworker.0 00000100:00100000:0.0:1787857780.084277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857780.084337:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857780.084344:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188243840:0@lo:400:kworker.0 00000100:00100000:0.0:1787857780.084371:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857780.084409:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188243712 00000100:00100000:0.0:1787857780.084415:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188243712 00000100:00100000:0.0:1787857780.084501:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1787857780.084511:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188243712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857780.084562:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188243712:12345-0@lo:400:kworker.0 Request processed in 53us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857780.084569:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1787857780.084598:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188243840 00000100:00100000:0.0:1787857780.084601:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188243840 00000100:00100000:0.0:1787857780.084630:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787857780.084637:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188243840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857780.084668:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188243840:12345-0@lo:400:kworker.0 Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857780.084685:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00080000:0.0:1787857780.084703:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857780.084707:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857780.084742:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188243840:0@lo:400:kworker.0 00000100:00100000:0.0:1787857780.084753:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188243712:0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085221:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188243584:0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857780.085289:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188244096:0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857780.085339:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787857780.085345:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188243456:0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085372:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857780.085396:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188243968:0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085420:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857780.085450:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188244096 00000100:00100000:3.0:1787857780.085454:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188244096 00000100:00100000:3.0:1787857780.085509:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1787857780.085517:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188244096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085554:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188244096:12345-0@lo:400:kworker.0 Request processed in 38us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857780.085561:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1787857780.085581:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188243456 00000100:00100000:3.0:1787857780.085584:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188243456 00000100:00100000:3.0:1787857780.085617:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1787857780.085623:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188243456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085652:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188243456:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857780.085657:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1787857780.085684:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188243584 00000100:00100000:3.0:1787857780.085687:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188243584 00000100:00100000:3.0:1787857780.085708:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188243968 00000100:00100000:3.0:1787857780.085711:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188243968 00000100:00100000:3.0:1787857780.085730:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1787857780.085736:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188243584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085779:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188243584:12345-0@lo:400:kworker.0 Request processed in 43us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857780.085785:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1787857780.085796:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787857780.085812:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188243968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085863:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188243968:12345-0@lo:400:kworker.0 Request processed in 61us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857780.085869:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787857780.085898:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188243456:0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085909:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188243968:0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085918:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188243584:0@lo:400:kworker.0 00000100:00100000:3.0:1787857780.085926:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188244096:0@lo:400:kworker.0 00000100:00080000:0.0:1787857780.088131:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857780.088142:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1787857780.280754:0:19991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 15:09:38 (1787857778) 00010000:00010000:1.0:1787857780.462915:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857780.592053:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188244224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857780.592151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857780.592792:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188244224 00000100:00100000:2.0:1787857780.592803:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188244224 00000100:00100000:2.0:1787857780.592910:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787857780.592922:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188244224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857780.592967:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857780.593041:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188244224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857780.593048:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787857780.593349:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188244224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857780.819097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857780.819196:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171667712 00000100:00100000:0.0:1787857780.819207:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171667712 00000100:00100000:0.0:1787857780.819284:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1034 00000100:00100000:0.0:1787857780.819296:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:28106:x1874704171667712:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857780.819422:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:28106:x1874704171667712:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 128us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857780.819430:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1034 00000040:00080000:3.0:1787857780.846528:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857780.846538:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857780.846575:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 3 00000040:00080000:3.0:1787857780.846581:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857780.864256:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857780.864902:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171667840 00000100:00100000:3.0:1787857780.864915:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171667840 00000100:00100000:3.0:1787857780.864990:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1035 00000100:00100000:3.0:1787857780.865000:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+89:28107:x1874704171667840:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857780.865024:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857780.865047:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c510 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865128:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865147:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865161:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865176:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865183:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865215:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865726:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865737:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.865744:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866040:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857780.866045:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866053:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866066:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:3.0:1787857780.866069:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.866073:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866079:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866092:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866097:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866109:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866114:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857780.866116:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866121:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866128:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff9998d1291e00) 00010000:00010000:3.0:1787857780.866130:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.866132:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866138:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c51e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866228:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c510 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a69 expref: 90 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866237:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:3.0:1787857780.866239:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.866243:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c510 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a69 expref: 90 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.866251:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72400, rc 0) 00000100:00100000:3.0:1787857780.866612:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+89:28107:x1874704171667840:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1610us (2362us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857780.866629:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1035 00000100:00100000:1.0:1787857780.874237:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857780.874469:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171668096 00000100:00100000:0.0:1787857780.874481:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171668096 00000100:00100000:0.0:1787857780.874579:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1036 00000100:00100000:0.0:1787857780.874591:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+89:28107:x1874704171668096:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1787857780.874657:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857780.874687:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c269 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd397b expref: 89 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.874708:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:0.0:1787857780.874713:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857780.875082:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.875099:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 40 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.875107:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.875142:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 40 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.875173:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 40 pid: 19301 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857780.875189:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188244352:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857780.875915:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f73cf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857780.880585:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188244352:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857780.880626:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857780.880781:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857780.881263:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171668224 00000100:00100000:3.0:1787857780.881274:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171668224 00010000:00010000:3.0:1787857780.881387:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 41 pid: 19301 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857780.881475:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 314 00000100:00100000:3.0:1787857780.881486:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:2349:x1874704171668224:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857780.881504:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857780.881513:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 41 pid: 19301 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.881526:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 41 pid: 19301 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.881555:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c2a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3990 expref: 41 pid: 19301 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.881573:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:3.0:1787857780.881578:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.881590:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.881599:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.881655:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857780.881720:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:2349:x1874704171668224:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 235us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857780.881728:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 314 00010000:00010000:1.0:1787857780.881793:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.881801:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.881846:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.881857:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.881865:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857780.883366:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00010000:00010000:1.0:1787857780.883389:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.883400:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.883409:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.883416:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857780.883440:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.883451:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.883476:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d8797b00) 00010000:00010000:1.0:1787857780.883480:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857780.883486:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.883492:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c525 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857780.883515:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044e42a5f reply state 0000000081fbc54c transno 4294967972 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857780.883525:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857780.883635:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+90:28107:x1874704171668096:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 9040us (9403us total) trans 4294967972 rc 0/0 00000100:00100000:1.0:1787857780.883644:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1036 00010000:00010000:2.0:1787857780.892138:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.892233:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.892242:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.892249:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857780.892254:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.892263:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.892287:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff9998c4eb6700) 00010000:00010000:2.0:1787857780.892290:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857780.892298:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.892304:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c52c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857780.910499:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857780.910761:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171668352 00000100:00100000:3.0:1787857780.910772:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171668352 00000100:00100000:3.0:1787857780.910891:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1037 00000100:00100000:3.0:1787857780.910903:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+89:28108:x1874704171668352:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857780.910929:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857780.910956:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a70 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.911033:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c53a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.911049:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c53a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.911060:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c53a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857780.911129:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857780.911134:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857780.911173:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c53a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.911199:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a70 expref: 91 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.911242:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c53a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a70 expref: 90 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.911250:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857780.911253:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857780.911255:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72800, rc 0) 00000100:00100000:3.0:1787857780.911318:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+90:28108:x1874704171668352:12345-192.168.204.36@tcp:101:bash.0 Request processed in 418us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857780.911325:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1037 00000100:00100000:1.0:1787857780.914994:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857780.915082:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171668480 00000100:00100000:3.0:1787857780.915092:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171668480 00000100:00100000:3.0:1787857780.915155:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1038 00000100:00100000:3.0:1787857780.915166:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+90:28108:x1874704171668480:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857780.915186:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857780.915206:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a77 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915274:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915302:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915314:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915329:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915351:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915358:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915492:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73000/0xd3f183cab4a7c556 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915501:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73000/0xd3f183cab4a7c556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915507:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73000/0xd3f183cab4a7c556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857780.915539:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:3.0:1787857780.915543:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857780.915565:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73000/0xd3f183cab4a7c556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915576:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915583:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915589:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915595:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857780.915599:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915613:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915625:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857780.915628:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.915633:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915639:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915654:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915660:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915675:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915680:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857780.915683:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915689:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915696:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff9998d1291200) 00010000:00010000:3.0:1787857780.915699:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.915701:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915716:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c54f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915745:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a77 expref: 92 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915772:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73000/0xd3f183cab4a7c556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a77 expref: 91 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.915779:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857780.915781:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787857780.915784:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73000, rc 0) 00000100:00100000:3.0:1787857780.915881:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+91:28108:x1874704171668480:12345-192.168.204.36@tcp:101:bash.0 Request processed in 717us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857780.915887:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1038 00000100:00100000:2.0:1787857780.921769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857780.921901:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171668608 00000100:00100000:0.0:1787857780.921913:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171668608 00000100:00100000:0.0:1787857780.921977:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1039 00000100:00100000:0.0:1787857780.921987:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+91:28108:x1874704171668608:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857780.922007:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857780.922029:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c55d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a7e expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922121:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922138:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922149:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922175:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922183:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922198:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922276:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922284:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922291:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922297:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857780.922301:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922328:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922342:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857780.922345:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857780.922350:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922356:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922370:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922376:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922382:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922386:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857780.922389:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922395:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922403:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff9998c6b34400) 00010000:00010000:0.0:1787857780.922405:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857780.922408:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922421:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c56b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922468:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c55d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a7e expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922479:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857780.922481:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857780.922484:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c55d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a7e expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857780.922495:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857780.922557:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+91:28108:x1874704171668608:12345-192.168.204.36@tcp:101:bash.0 Request processed in 571us (799us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857780.922565:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1039 00000100:00100000:2.0:1787857780.946868:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857780.947080:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171668736 00000100:00100000:1.0:1787857780.947090:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171668736 00000100:00100000:1.0:1787857780.947167:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1040 00000100:00100000:1.0:1787857780.947178:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+40:28109:x1874704171668736:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857780.947201:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857780.947222:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a85 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.947326:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.947342:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.947355:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857780.947864:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857780.947870:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857780.947900:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.947928:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053e00/0xd3f183cab4a7c572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.947946:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857780.947954:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:1.0:1787857780.947957:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857780.947961:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053200, rc 0) 00000100:00100000:1.0:1787857780.948030:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:28109:x1874704171668736:12345-192.168.204.36@tcp:101:rm.0 Request processed in 854us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857780.948037:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1040 00000100:00100000:1.0:1787857780.953563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857780.954124:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171668864 00000100:00100000:3.0:1787857780.954135:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171668864 00000100:00100000:3.0:1787857780.954208:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1041 00000100:00100000:3.0:1787857780.954219:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:28109:x1874704171668864:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857780.954239:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857780.954258:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a8c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954339:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954355:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954386:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954403:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954410:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954418:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954613:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c595 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954623:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954631:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857780.954664:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:3.0:1787857780.954668:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857780.954693:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954706:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954713:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954730:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954737:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857780.954740:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954748:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954760:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857780.954763:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.954767:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954774:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c587 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954788:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954795:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954801:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954806:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857780.954810:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954877:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954886:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff9998d1291200) 00010000:00010000:3.0:1787857780.954888:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.954891:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954897:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c58e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954931:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a8c expref: 43 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954944:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72400/0xd3f183cab4a7c595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a8c expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.954952:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857780.954954:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787857780.954957:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72400, rc 0) 00000100:00100000:3.0:1787857780.955026:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28109:x1874704171668864:12345-192.168.204.36@tcp:101:rm.0 Request processed in 809us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857780.955034:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1041 00000100:00100000:2.0:1787857780.970374:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857780.970548:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171668992 00000100:00100000:3.0:1787857780.970560:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171668992 00000100:00100000:3.0:1787857780.970628:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1042 00000100:00100000:3.0:1787857780.970639:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28109:x1874704171668992:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857780.970685:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857780.970711:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c59c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a93 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970812:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970862:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970874:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970889:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970896:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970901:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970969:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970976:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970983:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.970989:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857780.970999:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971007:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971020:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857780.971023:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.971027:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971033:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c5a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971048:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971054:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971061:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971065:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857780.971068:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971073:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971080:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff9998d1291200) 00010000:00010000:3.0:1787857780.971083:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.971092:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971098:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c5aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971133:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c59c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a93 expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971145:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857780.971147:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857780.971150:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c59c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a93 expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857780.971158:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857780.971221:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28109:x1874704171668992:12345-192.168.204.36@tcp:101:rm.0 Request processed in 584us (858us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857780.971228:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1042 00000100:00100000:2.0:1787857780.980612:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857780.980706:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171669120 00000100:00100000:3.0:1787857780.980715:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171669120 00000100:00100000:3.0:1787857780.980793:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1043 00000100:00100000:3.0:1787857780.980803:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28109:x1874704171669120:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857780.981074:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857780.981097:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c5b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3a9a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981198:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981212:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981224:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981238:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981245:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981252:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981558:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981568:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981575:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981581:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857780.981585:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981604:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981618:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:2.0:1787857780.981621:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857780.981626:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981632:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c5b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981648:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981654:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981659:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981665:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857780.981668:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981674:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981681:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff9998e18d9300) 00010000:00010000:2.0:1787857780.981684:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857780.981687:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981703:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c5bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981757:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c5b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a9a expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981769:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:2.0:1787857780.981771:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857780.981776:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c5b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a9a expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857780.981786:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75200, rc 0) 00000100:00100000:2.0:1787857780.982223:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28109:x1874704171669120:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1420us (1619us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857780.982232:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1043 00000100:00100000:0.0:1787857781.012507:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857781.012607:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171669248 00000100:00100000:1.0:1787857781.012632:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171669248 00000100:00100000:1.0:1787857781.012719:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1044 00000100:00100000:1.0:1787857781.012731:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28110:x1874704171669248:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857781.012767:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857781.012792:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c5c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3aa1 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.012923:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.012941:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.012954:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.012971:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.012977:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.012984:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013052:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013060:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013067:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013080:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857781.013085:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013093:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013107:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:1.0:1787857781.013110:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857781.013114:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013121:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c5cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013135:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013140:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013146:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013163:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857781.013165:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013172:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013192:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff9998c4eb6100) 00010000:00010000:1.0:1787857781.013195:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857781.013198:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013204:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c5d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013240:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c5c6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aa1 expref: 43 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013250:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:1.0:1787857781.013252:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857781.013256:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c5c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aa1 expref: 43 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.013265:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052a00, rc 0) 00000100:00080000:0.0:1787857781.013880:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857781.013998:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28110:x1874704171669248:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1267us (1498us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857781.014008:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1044 00000100:00100000:1.0:1787857781.028039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.030137:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171669376 00000100:00100000:0.0:1787857781.030162:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171669376 00000100:00100000:0.0:1787857781.030255:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1045 00000100:00100000:0.0:1787857781.030266:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28110:x1874704171669376:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857781.030290:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857781.030327:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c5db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3aa8 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030403:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030446:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030466:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030483:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030489:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030495:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030565:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030572:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030578:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030584:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857781.030589:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030598:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030611:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857781.030620:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857781.030625:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030632:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c5e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030648:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030654:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030660:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030665:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857781.030668:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030675:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030681:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff9998c6b34400) 00010000:00010000:0.0:1787857781.030684:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857781.030687:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030693:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c5e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.030731:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c5db lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aa8 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.031259:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857781.031264:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857781.031269:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7c5db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aa8 expref: 43 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.031281:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70c00, rc 0) 00000100:00100000:0.0:1787857781.031368:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28110:x1874704171669376:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1103us (3339us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857781.031377:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1045 00000100:00100000:2.0:1787857781.035442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.035534:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171669632 00000100:00100000:0.0:1787857781.035544:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171669632 00000100:00100000:0.0:1787857781.035606:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1046 00000100:00100000:0.0:1787857781.035617:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28110:x1874704171669632:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857781.035636:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857781.035656:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c5f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3aaf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.035795:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.035810:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.035857:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.035872:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.035892:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.035898:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857781.036584:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:0.0:1787857781.036761:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036774:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036782:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036848:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036856:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036862:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036868:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857781.036873:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036880:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036905:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857781.036908:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857781.036913:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036919:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7c5f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857781.036934:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001362c503 reply state 00000000b99b37de transno 4294967973 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857781.036943:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857781.036979:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7c5f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 45 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.036994:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 44 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.037001:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:0.0:1787857781.037003:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857781.037005:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857781.037087:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28110:x1874704171669632:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1471us (1664us total) trans 4294967973 rc 0/0 00000100:00100000:0.0:1787857781.037095:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1046 00010000:00010000:3.0:1787857781.040481:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.040500:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.040507:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.040528:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857781.040533:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.040541:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.040560:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff9998c6b34800) 00010000:00010000:3.0:1787857781.040563:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857781.040569:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.040575:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c5fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857781.051028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.051879:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171669760 00000100:00100000:0.0:1787857781.051892:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171669760 00000100:00100000:0.0:1787857781.051971:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 273 00000100:00100000:0.0:1787857781.051981:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171669760:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857781.052015:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857781.052035:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ab6 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857781.052061:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857781.052082:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=605s v=(0 0) 00010000:00010000:0.0:1787857781.052086:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857781.052096:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.052115:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.052127:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857781.052202:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171669760:12345-192.168.204.36@tcp:101:cp.0 Request processed in 223us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857781.052210:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 273 00000100:00080000:2.0:1787857781.052737:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857781.062090:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.062557:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171669888 00000100:00100000:0.0:1787857781.062567:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171669888 00000100:00100000:0.0:1787857781.062627:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 274 00000100:00100000:0.0:1787857781.062639:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:28110:x1874704171669888:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857781.062659:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857781.062679:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3abd expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.062716:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.062741:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857781.062758:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857781.062765:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.062803:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.062836:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 12 pid: 6713 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857781.062852:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188244480:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857781.062951:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4e43540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857781.068093:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188244480:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857781.068138:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.068172:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71000, rc 0) 00000100:00100000:0.0:1787857781.068242:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:28110:x1874704171669888:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5605us (6160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857781.068254:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 274 00000100:00100000:2.0:1787857781.068524:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857781.068850:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171670016 00000100:00100000:1.0:1787857781.068858:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171670016 00010000:00010000:1.0:1787857781.068892:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 12 pid: 6713 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857781.068930:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 315 00000100:00100000:1.0:1787857781.068953:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171670016:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857781.068969:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857781.068994:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 12 pid: 6713 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.069007:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 12 pid: 6713 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.069029:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027defac7/0xd3f183cab4a7c613 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ab6 expref: 12 pid: 6713 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.069045:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857781.069049:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857781.069057:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.069066:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.069102:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857781.069116:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa870c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188244608:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857781.069206:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857781.084095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857781.084213:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa870c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188244608:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857781.084253:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857781.084322:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171670016:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 15369us (15798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857781.084332:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 315 00000100:00100000:3.0:1787857781.084622:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171670272 00000100:00100000:3.0:1787857781.084629:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171670272 00000100:00100000:3.0:1787857781.084676:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 207 00000100:00100000:3.0:1787857781.084686:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28110:x1874704171670272:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:3.0:1787857781.085060:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28110:x1874704171670272:12345-192.168.204.36@tcp:35:cp.0 Request processed in 375us (973us total) trans 4294967974 rc 0/0 00000100:00100000:3.0:1787857781.085067:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 207 00000100:00100000:0.0:1787857781.156932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857781.157078:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171670400 00000100:00100000:1.0:1787857781.157088:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171670400 00000100:00080000:2.0:1787857781.157243:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857781.157329:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1047 00000100:00100000:1.0:1787857781.157342:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+91:28113:x1874704171670400:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857781.157366:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857781.157387:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c621 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ac4 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157492:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157508:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157521:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157537:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157544:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157551:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157676:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157691:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157698:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857781.157754:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00000004:00200000:1.0:1787857781.157759:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857781.157780:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157791:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157801:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157807:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157871:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157879:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857781.157884:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157891:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157912:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:1.0:1787857781.157915:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857781.157920:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157926:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157941:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157946:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157952:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157958:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857781.157961:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157965:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157972:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff9998c4eb6100) 00010000:00010000:1.0:1787857781.157974:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857781.157976:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.157982:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c62f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.158024:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7c621 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 93 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.158037:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.158044:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:1.0:1787857781.158046:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857781.158049:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:1.0:1787857781.158120:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+92:28113:x1874704171670400:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 781us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857781.158127:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1047 00000100:00100000:2.0:1787857781.163484:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.163931:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171670528 00000100:00100000:0.0:1787857781.163943:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171670528 00000100:00100000:0.0:1787857781.164047:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 275 00000100:00100000:0.0:1787857781.164057:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171670528:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857781.164079:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857781.164100:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7c63d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3acb expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787857781.164240:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857781.164297:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188244736:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857781.164403:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4e43540 going to sleep for 11 seconds 00002000:00010000:0.0:1787857781.181491:0:8490:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1787857781.181501:0:8490:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb mtime: 0 -> 1787857780 00002000:00010000:0.0:1787857781.181503:0:8490:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb atime: 0 -> 1787857780 00002000:00010000:0.0:1787857781.181505:0:8490:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb ctime: 0 -> 1787857780 00000100:00100000:0.0:1787857781.181530:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188244736:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857781.181571:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7c63d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3acb expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.181598:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7c63d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3acb expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.181613:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:0.0:1787857781.181882:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171670528:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 17825us (18407us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857781.181892:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 275 00000100:00100000:3.0:1787857781.186999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.187385:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171670656 00000100:00100000:0.0:1787857781.187395:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171670656 00000100:00100000:0.0:1787857781.187471:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1048 00000100:00100000:0.0:1787857781.187498:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:28113:x1874704171670656:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857781.187520:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857781.187541:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ad2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.187612:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.187627:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.187640:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857781.187718:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:0.0:1787857781.187722:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857781.187745:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.187771:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.187790:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 93 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.187797:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857781.187800:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857781.187803:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70600, rc 0) 00000100:00100000:0.0:1787857781.188022:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:28113:x1874704171670656:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 526us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857781.188040:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1048 00000100:00100000:2.0:1787857781.193365:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857781.193463:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171670784 00000100:00100000:1.0:1787857781.193474:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171670784 00000100:00100000:1.0:1787857781.193535:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 276 00000100:00100000:1.0:1787857781.193545:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171670784:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857781.193564:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857781.193583:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c652 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ad9 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857781.193688:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa870c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188244864:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857781.193773:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787857781.202615:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa870c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188244864:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857781.202674:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c652 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad9 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.202725:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c652 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad9 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.202739:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052a00, rc 0) 00000100:00100000:1.0:1787857781.202841:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171670784:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 9270us (9459us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857781.202852:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 276 00000100:00100000:0.0:1787857781.209716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857781.209856:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171671040 00000100:00100000:3.0:1787857781.209866:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171671040 00000100:00100000:3.0:1787857781.209934:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1049 00000100:00100000:3.0:1787857781.209945:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+93:28113:x1874704171671040:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:3.0:1787857781.210321:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 136 off12000 00000100:00100000:3.0:1787857781.210546:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+93:28113:x1874704171671040:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 593us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857781.210554:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1049 00010000:00010000:2.0:1787857781.493905:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857781.871449:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857781.871472:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857781.871519:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 29 count 4 00000040:00080000:2.0:1787857781.871526:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857781.871811:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188244992:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857781.871932:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857781.889670:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188244992:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857781.900681:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857781.901230:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171671168 00000100:00100000:3.0:1787857781.901627:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171671168 00000100:00100000:3.0:1787857781.901701:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1050 00000100:00100000:3.0:1787857781.901713:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28124:x1874704171671168:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857781.904335:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857781.904472:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28124:x1874704171671168:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 2756us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857781.904482:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1050 00000100:00100000:2.0:1787857781.913268:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857781.913508:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171671424 00000100:00100000:3.0:1787857781.913518:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171671424 00000100:00100000:3.0:1787857781.913584:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1051 00000100:00100000:3.0:1787857781.913596:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28124:x1874704171671424:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857781.913622:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857781.913646:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c659 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.913766:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c660 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.913781:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.913794:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857781.913846:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:3.0:1787857781.913975:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c659 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae0 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.913994:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae0 expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.914004:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:3.0:1787857781.914006:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857781.914010:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:3.0:1787857781.914072:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28124:x1874704171671424:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 477us (814us total) trans 4294967975 rc 0/0 00000100:00100000:3.0:1787857781.914079:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1051 00000100:00100000:0.0:1787857781.923636:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857781.923984:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171671552 00000100:00100000:2.0:1787857781.923993:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171671552 00000100:00100000:2.0:1787857781.924053:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:2.0:1787857781.924064:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2349:x1874704171671552:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857781.924080:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857781.924108:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c660 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae0 expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857781.924129:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:2.0:1787857781.924134:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857781.924193:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2349:x1874704171671552:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 131us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857781.924201:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:3.0:1787857781.927682:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857781.927797:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171671680 00000100:00100000:1.0:1787857781.927806:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171671680 00000100:00100000:1.0:1787857781.927885:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 277 00000100:00100000:1.0:1787857781.927895:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171671680:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857781.927939:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.927960:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.927968:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857781.927972:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857781.927977:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.928009:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.928039:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 11 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857781.928055:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa870c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188245120:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857781.928146:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857781.932569:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa870c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188245120:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857781.932606:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857781.933707:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857781.934558:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171671808 00000100:00100000:2.0:1787857781.934569:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171671808 00002000:00100000:2.0:1787857781.934628:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x17:0x0] (0->1515) req@ffff9997c3a21e00 x1874704171671808/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:427/0 lens 2008/0 e 0 to 0 dl 1787857792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857781.934640:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c3a21e00 with x1874704171671808 ext(0->1515) 00010000:00010000:2.0:1787857781.934648:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 12 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857781.934679:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 12 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857781.934687:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9997c3a21e00 00000100:00100000:2.0:1787857781.934725:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:2.0:1787857781.934743:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171671808:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:2.0:1787857781.935953:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171671808:12345-192.168.204.36@tcp:4:cp.0 Request processed in 1204us (2245us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1787857781.935964:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00002000:00100000:2.0:1787857781.935974:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x17:0x0] (0->1515) req@ffff9997c3a21e00 x1874704171671808/t4294967357(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:427/0 lens 2008/448 e 0 to 0 dl 1787857792 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857781.935983:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c3a21e00 with x1874704171671808 ext(0->1515) 00010000:00010000:2.0:1787857781.935992:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 14 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857781.936006:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 14 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857781.936013:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9997c3a21e00 00000100:00100000:2.0:1787857781.947365:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857781.947555:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171671936 00000100:00100000:1.0:1787857781.947565:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171671936 00010000:00010000:1.0:1787857781.947617:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 14 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857781.947657:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 316 00000100:00100000:1.0:1787857781.947666:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2348:x1874704171671936:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857781.947682:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857781.947707:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 14 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.947721:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 14 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.947746:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000028c7edf/0xd3f183cab4a7c61a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3abd expref: 14 pid: 6714 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.947766:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857781.947771:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857781.947793:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.947804:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.947856:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857781.947911:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171671936:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 245us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857781.947919:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 316 00010000:00010000:1.0:1787857781.948113:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.948123:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.948156:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.948168:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.948176:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.948183:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857781.948188:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.948205:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.948218:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857781.948225:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7c66e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857781.948597:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2347:x1874704171671680:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 20394us (20616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857781.948609:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 277 00000100:00100000:3.0:1787857781.955546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.955704:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171672192 00000100:00100000:0.0:1787857781.955715:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171672192 00000100:00100000:0.0:1787857781.955785:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1052 00000100:00100000:0.0:1787857781.955796:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28124:x1874704171672192:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857781.955928:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28124:x1874704171672192:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 134us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857781.955936:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1052 00000100:00100000:1.0:1787857781.959998:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.960588:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171672320 00000100:00100000:0.0:1787857781.960600:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171672320 00000100:00100000:0.0:1787857781.960664:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 278 00000100:00100000:0.0:1787857781.960675:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171672320:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857781.960693:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857781.960712:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ae7 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857781.960739:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 1516, mtime: 0x6a908b74, atime: 0x0, ctime: 0x6a908b74, blocks: 0x1 00010000:00010000:0.0:1787857781.960758:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1787857781.960769:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857781.960778:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.960797:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857781.960835:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857781.960888:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171672320:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 216us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857781.960895:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 278 00000100:00100000:1.0:1787857781.967928:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857781.969469:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171672576 00000100:00100000:3.0:1787857781.969484:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171672576 00000100:00100000:3.0:1787857781.969575:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1053 00000100:00100000:3.0:1787857781.969587:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28124:x1874704171672576:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857781.969712:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28124:x1874704171672576:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 128us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857781.969720:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1053 00000100:00100000:3.0:1787857781.974894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857781.975287:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171672704 00000100:00100000:0.0:1787857781.975298:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171672704 00002000:00100000:0.0:1787857781.975349:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (0->4095) req@ffff9997c3a22940 x1874704171672704/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:427/0 lens 488/0 e 0 to 0 dl 1787857792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857781.975360:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c3a22940 with x1874704171672704 ext(0->4095) 00002000:00010000:0.0:1787857781.975365:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c3a22940 00000100:00100000:0.0:1787857781.975401:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 96 00000100:00100000:0.0:1787857781.975411:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171672704:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787857781.975655:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171672704:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 245us (770us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857781.975664:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 96 00002000:00100000:0.0:1787857781.975672:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (0->4095) req@ffff9997c3a22940 x1874704171672704/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:427/0 lens 488/4536 e 0 to 0 dl 1787857792 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857781.975681:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c3a22940 with x1874704171672704 ext(0->4095) 00002000:00010000:0.0:1787857781.975691:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c3a22940 00000100:00100000:1.0:1787857781.983432:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857781.984067:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171672832 00000100:00100000:3.0:1787857781.984090:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171672832 00000100:00100000:3.0:1787857781.984171:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1054 00000100:00100000:3.0:1787857781.984181:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28124:x1874704171672832:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857781.984203:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857781.984225:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c67c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3aee expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.984267:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.984282:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.984298:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.984413:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c67c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.984442:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857781.984451:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:3.0:1787857781.984453:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857781.984457:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73600, rc 0) 00000100:00100000:3.0:1787857781.984519:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28124:x1874704171672832:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 339us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857781.984527:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1054 00000100:00100000:2.0:1787857782.013238:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857782.013366:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171672960 00000100:00100000:0.0:1787857782.013376:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171672960 00000100:00100000:0.0:1787857782.013458:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1055 00000100:00100000:0.0:1787857782.013470:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28124:x1874704171672960:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857782.013507:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857782.013635:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28124:x1874704171672960:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 167us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857782.013643:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1055 00000100:00100000:3.0:1787857782.023128:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857782.025381:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171673088 00000100:00100000:1.0:1787857782.025398:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171673088 00000100:00100000:1.0:1787857782.025483:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00100000:1.0:1787857782.025492:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171673088:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857782.025541:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025559:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857782.025563:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857782.025568:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025595:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025628:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025636:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025644:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025651:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857782.025655:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025664:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025679:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.025686:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7c68a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857782.025781:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171673088:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 290us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857782.025789:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00100000:1.0:1787857782.029676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857782.029779:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171673344 00000100:00100000:3.0:1787857782.029789:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171673344 00000100:00100000:3.0:1787857782.030120:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1056 00000100:00100000:3.0:1787857782.030141:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28124:x1874704171673344:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857782.030486:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.030507:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.030516:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.030559:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.030573:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 47 pid: 5856 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.030589:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188245248:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857782.030711:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4e43840 going to sleep for 11 seconds 00000100:00100000:2.0:1787857782.049855:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857782.049973:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188245248:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857782.050002:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857782.050120:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171673472 00000100:00100000:3.0:1787857782.050127:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171673472 00010000:00010000:3.0:1787857782.050175:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 48 pid: 5856 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857782.050211:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 317 00000100:00100000:3.0:1787857782.050220:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2350:x1874704171673472:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857782.050235:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857782.050242:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 48 pid: 5856 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.050254:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 48 pid: 5856 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.050278:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c683 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aee expref: 48 pid: 5856 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.050295:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:3.0:1787857782.050301:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.050311:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.050334:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.050361:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857782.050410:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171673472:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 190us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857782.050418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 317 00010000:00010000:1.0:1787857782.050621:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.050630:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.050926:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.050934:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.050940:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.050947:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857782.050951:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.050958:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.050974:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:1.0:1787857782.050977:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857782.050981:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.050988:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7c691 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857782.051107:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28124:x1874704171673344:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 20977us (21441us total) trans 4294967976 rc 0/0 00000100:00100000:1.0:1787857782.051116:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1056 00000040:00080000:3.0:1787857782.051670:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857782.051676:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857782.054719:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787857782.057181:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857782.065423:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857782.065949:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171673728 00000100:00100000:3.0:1787857782.065960:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171673728 00000100:00100000:3.0:1787857782.066024:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 208 00000100:00100000:3.0:1787857782.066034:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28124:x1874704171673728:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857782.067352:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28124:x1874704171673728:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1310us (1931us total) trans 4294967977 rc 0/0 00000100:00100000:3.0:1787857782.067366:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 208 00000040:00080000:1.0:1787857782.284772:0:20041:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857782.284783:0:20041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857782.284881:0:20041:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 29 count 4 00000040:00080000:1.0:1787857782.284887:0:20041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857782.363731:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857782.364020:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171673856 00000100:00100000:0.0:1787857782.364030:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171673856 00000100:00100000:0.0:1787857782.364099:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 280 00000100:00100000:0.0:1787857782.364109:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171673856:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857782.364130:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857782.364149:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3af5 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.364174:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857782.364179:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857782.364188:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.364206:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.364219:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857782.364323:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2347:x1874704171673856:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 215us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857782.364331:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 280 00000100:00100000:1.0:1787857782.391573:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857782.393534:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171674112 00000100:00100000:3.0:1787857782.393548:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171674112 00000100:00100000:3.0:1787857782.393630:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1057 00000100:00100000:3.0:1787857782.393639:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:28125:x1874704171674112:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857782.393661:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857782.393684:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c69f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3afc expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.393804:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.393848:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.393860:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857782.393872:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:3.0:1787857782.393997:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c69f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3afc expref: 96 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.394014:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3afc expref: 95 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.394022:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:3.0:1787857782.394026:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857782.394029:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857782.394091:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+95:28125:x1874704171674112:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 453us (2528us total) trans 4294967978 rc 0/0 00000100:00100000:3.0:1787857782.394098:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1057 00000100:00100000:3.0:1787857782.397870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857782.397948:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171674240 00000100:00100000:1.0:1787857782.397958:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171674240 00000100:00100000:1.0:1787857782.398016:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 281 00000100:00100000:1.0:1787857782.398026:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171674240:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:1.0:1787857782.398079:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.398100:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.398109:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.398125:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857782.398130:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857782.398135:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.398171:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.398186:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 13 pid: 6714 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857782.398203:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188245376:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857782.398294:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.398317:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 12 pid: 8490 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857782.398327:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188245504:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857782.398352:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857782.401923:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857782.401950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857782.401980:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171674368 00000100:00100000:1.0:1787857782.402000:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171674368 00010000:00010000:1.0:1787857782.402038:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 14 pid: 6714 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857782.402183:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188245376:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857782.402195:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188245504:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857782.402221:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857782.402422:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171674496 00000100:00100000:1.0:1787857782.402436:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171674496 00010000:00010000:1.0:1787857782.402454:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 13 pid: 8490 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.403252:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:0.0:1787857782.403269:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171674368:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857782.403286:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857782.403327:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 14 pid: 6714 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403341:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 14 pid: 6714 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403375:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7c698 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3af5 expref: 14 pid: 6714 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403392:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857782.403466:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2348:x1874704171674368:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 203us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857782.403474:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:0.0:1787857782.403496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00100000:0.0:1787857782.403503:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171674496:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857782.403512:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857782.403522:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 13 pid: 8490 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403533:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 13 pid: 8490 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403547:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7c675 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ae7 expref: 13 pid: 8490 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403558:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857782.403562:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857782.403568:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403590:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403627:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857782.403647:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171674496:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 145us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857782.403654:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 319 00010000:00010000:0.0:1787857782.403676:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403685:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403709:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403718:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403726:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403733:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857782.403737:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403758:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403770:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.403777:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093833cd9/0xd3f183cab4a7c6b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.403842:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171674240:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 5818us (5981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857782.403850:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 281 00000100:00100000:1.0:1787857782.407528:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857782.407855:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171674752 00000100:00100000:0.0:1787857782.407864:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171674752 00000100:00100000:0.0:1787857782.407924:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 209 00000100:00100000:0.0:1787857782.407933:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:28125:x1874704171674752:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:0.0:1787857782.407999:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3afc expref: 95 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857782.408514:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967979 00000001:00080000:0.0:1787857782.409563:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967980 00010000:00010000:0.0:1787857782.409634:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.409653:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.409666:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.409674:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 5/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.409708:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.409724:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 98 pid: 19301 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.409744:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188245632:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857782.409863:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.409874:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 47 pid: 5858 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.409883:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188245760:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857782.409907:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4e43540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857782.425345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857782.425391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857782.425482:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188245632:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857782.425495:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188245760:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857782.425525:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.425559:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171674880 00000100:00100000:0.0:1787857782.425565:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171674880 00010000:00010000:0.0:1787857782.425599:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 48 pid: 5858 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.425633:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171675008 00000100:00100000:0.0:1787857782.425637:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171675008 00010000:00010000:0.0:1787857782.425649:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 99 pid: 19301 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.425673:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 320 00000100:00100000:0.0:1787857782.425682:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171674880:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857782.425696:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857782.425703:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 48 pid: 5858 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425714:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 48 pid: 5858 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425738:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c605 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3aaf expref: 48 pid: 5858 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425755:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:0.0:1787857782.425760:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425769:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425776:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857782.425852:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2349:x1874704171674880:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 170us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857782.425859:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 320 00000100:00100000:0.0:1787857782.425880:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 321 00000100:00100000:0.0:1787857782.425887:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+99:2349:x1874704171675008:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857782.425894:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857782.425898:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 99 pid: 19301 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425907:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 99 pid: 19301 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425920:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c636 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ac4 expref: 99 pid: 19301 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425928:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:0.0:1787857782.425931:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425939:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425947:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.425967:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857782.425988:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+98:2349:x1874704171675008:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 103us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857782.425994:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 321 00010000:00010000:0.0:1787857782.426121:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.426128:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857782.426268:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967981 00000001:00080000:0.0:1787857782.427647:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967982 00000001:00080000:0.0:1787857782.427764:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967983 00000100:00100000:0.0:1787857782.427883:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188245888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787857782.427954:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857782.428000:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb7f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857782.428488:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188245888 00000100:00100000:2.0:1787857782.428496:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188245888 00000100:00100000:2.0:1787857782.428554:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787857782.428565:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188245888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787857782.428655:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188245888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857782.428663:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787857782.428684:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857782.429046:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188245888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787857782.431310:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967984 00000100:00100000:0.0:1787857782.431415:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188246016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787857782.431493:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857782.431534:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4e43540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857782.432983:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188246016 00000100:00100000:3.0:1787857782.432995:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188246016 00000100:00100000:3.0:1787857782.433050:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787857782.433061:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188246016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787857782.433305:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188246016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 245us (1811us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1787857782.433313:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787857782.433970:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188246016:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:0.0:1787857782.434000:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.434010:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.434017:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.434027:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857782.434032:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.434039:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.434054:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:0.0:1787857782.434056:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787857782.434060:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.434067:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7c6bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857782.434310:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x41:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787857782.434486:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9160 00000004:00080000:0.0:1787857782.434499:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 606484681527ns, next at 607484678955ns, rc = 0 00000001:00080000:0.0:1787857782.434508:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967985 00010000:00010000:0.0:1787857782.434554:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998c6b34000) 00010000:00010000:0.0:1787857782.434557:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787857782.434564:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6a6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3afc expref: 102 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857782.435048:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+101:28125:x1874704171674752:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 27114us (27527us total) trans 4294967986 rc 0/0 00000100:00100000:0.0:1787857782.435059:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 209 00000020:00080000:0.0:1787857782.435064:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787857782.466220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857782.466258:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171675264 00000100:00100000:3.0:1787857782.466267:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171675264 00000100:00100000:3.0:1787857782.466321:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1058 00000100:00100000:3.0:1787857782.466331:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+101:28126:x1874704171675264:12345-192.168.204.36@tcp:101:cmp.0 00010000:00010000:3.0:1787857782.466354:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857782.466374:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c6c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b03 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466462:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466477:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466487:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466501:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466521:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466528:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466668:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7c6d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466677:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7c6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466683:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7c6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857782.466691:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:3.0:1787857782.466787:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466795:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466802:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466807:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857782.466812:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466841:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466864:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857782.466867:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857782.466872:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466877:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c6c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466889:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466894:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466899:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466904:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857782.466906:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466912:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466920:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff9998d1291200) 00010000:00010000:3.0:1787857782.466921:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857782.466924:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466929:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c6d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.466997:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c6c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b03 expref: 104 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.467011:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7c6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b03 expref: 103 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.467018:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:3.0:1787857782.467019:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857782.467022:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73e00, rc 0) 00000100:00100000:3.0:1787857782.467085:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+103:28126:x1874704171675264:12345-192.168.204.36@tcp:101:cmp.0 Request processed in 756us (876us total) trans 4294967987 rc 0/0 00000100:00100000:3.0:1787857782.467093:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1058 00000100:00100000:0.0:1787857782.474915:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857782.474972:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171675520 00000100:00100000:0.0:1787857782.474982:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171675520 00000100:00100000:0.0:1787857782.475039:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:0.0:1787857782.475049:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+103:28126:x1874704171675520:12345-192.168.204.36@tcp:103:cmp.0 00010000:00010000:0.0:1787857782.475065:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857782.475095:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7c6d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b03 expref: 103 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857782.475113:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:0.0:1787857782.475125:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857782.475183:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:28126:x1874704171675520:12345-192.168.204.36@tcp:103:cmp.0 Request processed in 135us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857782.475190:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:1.0:1787857782.485403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857782.489217:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171675648 00000100:00100000:3.0:1787857782.489237:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171675648 00000100:00100000:3.0:1787857782.489306:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1059 00000100:00100000:3.0:1787857782.489317:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+102:28126:x1874704171675648:12345-192.168.204.36@tcp:58:cmp.0 00010000:00010000:3.0:1787857782.489437:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.489455:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.489467:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857782.489646:0:19301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].29, 136 off12136 00000100:00100000:3.0:1787857782.489750:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+102:28126:x1874704171675648:12345-192.168.204.36@tcp:58:cmp.0 Request processed in 434us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857782.489773:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1059 00000100:00100000:2.0:1787857782.495283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857782.498201:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171675776 00000100:00100000:3.0:1787857782.498218:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171675776 00000100:00100000:3.0:1787857782.498281:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1060 00000100:00100000:3.0:1787857782.498291:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+102:28126:x1874704171675776:12345-192.168.204.36@tcp:101:cmp.0 00010000:00010000:3.0:1787857782.498312:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857782.498335:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73c00/0xd3f183cab4a7c6ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b0a expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.498397:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.498409:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73c00/0xd3f183cab4a7c6ec lrc: 4/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b0a expref: 103 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.498441:0:7656:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.498455:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73c00/0xd3f183cab4a7c6ec lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b0a expref: 103 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.498469:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:3.0:1787857782.498472:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857782.498476:0:7656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73c00/0xd3f183cab4a7c6ec lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b0a expref: 103 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857782.498483:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73c00, rc 0) 00000100:00100000:3.0:1787857782.498564:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+103:28126:x1874704171675776:12345-192.168.204.36@tcp:101:cmp.0 Request processed in 275us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857782.498571:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1060 00010000:00010000:2.0:1787857782.511406:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787857782.716591:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967986 is committed 00000004:00080000:3.0:1787857782.716608:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000020:00080000:3.0:1787857782.716631:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998f0df4300 refcount 2 committed 0 result 0 batchid 19 00000020:00080000:3.0:1787857782.716637:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c18d0600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998f0df4b40 00000020:00080000:3.0:1787857782.716640:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c18d0c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff999901472c00 00000001:00080000:3.0:1787857782.716675:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967973 is committed 00000020:00080000:2.0:1787857782.716799:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 19 committed batchid 18 00000020:00080000:2.0:1787857782.717061:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00000100:00100000:2.0:1787857782.717348:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188246144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787857782.717436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857782.717629:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188246144 00000100:00100000:1.0:1787857782.717639:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188246144 00000100:00100000:1.0:1787857782.717697:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787857782.717717:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188246144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787857782.717749:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00002000:00010000:1.0:1787857782.717783:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 1516, mtime: 0x6a908b74, atime: 0x0, ctime: 0x6a908b74, blocks: 0x1 00010000:00010000:1.0:1787857782.717792:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.717807:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1787857782.717812:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857782.717840:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.717853:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.717880:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.717888:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.717905:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857782.718764:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874704188246144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1046us (1325us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1787857782.718774:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00010000:1.0:1787857782.718802:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857782.718810:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.718848:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857782.718852:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.718862:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.718880:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.718887:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c6f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857782.718916:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857782.718918:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857782.718920:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787857782.719050:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967976 is committed 00000001:00080000:3.0:1787857782.719083:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967987 is committed 00000001:00080000:3.0:1787857782.719090:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967977 is committed 00000004:00080000:2.0:1787857782.721455:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998e185e1c0/2, rc 0, transno 4294967359 00000100:00100000:2.0:1787857782.721472:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188246144:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1787857783.086251:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857783.086261:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857783.086720:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 30 count 3 00000040:00080000:3.0:1787857783.086728:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857783.086896:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188246272:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857783.087197:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990155ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857783.098697:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188246272:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857783.101370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.103340:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171675904 00000100:00100000:1.0:1787857783.103356:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171675904 00000100:00100000:1.0:1787857783.103461:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1061 00000100:00100000:1.0:1787857783.103474:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28127:x1874704171675904:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857783.103517:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857783.103659:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28127:x1874704171675904:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 187us (2298us total) trans 0 rc 0/0 00000100:00080000:2.0:1787857783.104204:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857783.104382:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1061 00000100:00100000:2.0:1787857783.113342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.113452:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171676032 00000100:00100000:3.0:1787857783.113461:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171676032 00000100:00100000:3.0:1787857783.113527:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1062 00000100:00100000:3.0:1787857783.113537:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28127:x1874704171676032:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857783.113629:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113677:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113692:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113710:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113716:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113722:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113748:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113756:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113762:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857783.113803:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00000004:00200000:3.0:1787857783.113808:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857783.113871:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113884:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113901:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113908:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113916:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.113920:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113929:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113942:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857783.113945:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857783.113951:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113959:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c6fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113973:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113990:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.113997:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114003:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.114011:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114018:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114026:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3e15321 (ffff9998c3984a00) 00010000:00010000:3.0:1787857783.114029:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857783.114031:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114038:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c701 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114051:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114057:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114063:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114068:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.114071:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114077:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114083:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:3.0:1787857783.114085:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857783.114091:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.114098:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c708 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857783.114183:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28127:x1874704171676032:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 646us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.114190:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1062 00000100:00100000:0.0:1787857783.122949:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857783.123147:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171676288 00000100:00100000:2.0:1787857783.123158:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171676288 00000100:00100000:2.0:1787857783.123222:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1063 00000100:00100000:2.0:1787857783.123232:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28127:x1874704171676288:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857783.123253:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857783.123273:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c70f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b11 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123403:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123428:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123440:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857783.123451:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:2.0:1787857783.123596:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123604:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123611:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123902:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857783.123909:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123918:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123931:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:2.0:1787857783.123933:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857783.123938:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.123955:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c716 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.124005:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c70f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b11 expref: 44 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.124015:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857783.124018:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857783.124021:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c70f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b11 expref: 44 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.124031:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857783.124587:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28127:x1874704171676288:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1353us (1646us total) trans 4294967988 rc 301/301 00000100:00100000:2.0:1787857783.124597:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1063 00000100:00100000:1.0:1787857783.140027:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.140385:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171676416 00000100:00100000:3.0:1787857783.140396:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171676416 00000100:00100000:3.0:1787857783.140475:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1064 00000100:00100000:3.0:1787857783.140486:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28127:x1874704171676416:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857783.140530:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857783.140862:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28127:x1874704171676416:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 376us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.140871:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1064 00000100:00100000:2.0:1787857783.144987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.146148:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171676672 00000100:00100000:3.0:1787857783.146162:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171676672 00000100:00100000:3.0:1787857783.146282:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1065 00000100:00100000:3.0:1787857783.146305:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28127:x1874704171676672:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857783.146325:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857783.146349:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c724 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b18 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.147364:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c72b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.147381:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c72b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.147400:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c72b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857783.147422:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00010000:00010000:3.0:1787857783.147478:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c724 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b18 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.147496:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c72b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b18 expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.147504:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984a00) 00010000:00010000:3.0:1787857783.147507:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857783.147511:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73600, rc 0) 00000100:00100000:3.0:1787857783.147589:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28127:x1874704171676672:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1286us (2611us total) trans 4294967989 rc 0/0 00000100:00100000:3.0:1787857783.147597:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1065 00000100:00100000:0.0:1787857783.164067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.164164:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171676928 00000100:00100000:1.0:1787857783.164174:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171676928 00000100:00100000:1.0:1787857783.164233:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1066 00000100:00100000:1.0:1787857783.164244:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28127:x1874704171676928:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857783.164317:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857783.164344:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7c72b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b18 expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.164364:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984a00) 00010000:00010000:1.0:1787857783.164375:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857783.164399:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.164423:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 91 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.164449:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.164485:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 91 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.164500:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 91 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.164514:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188246400:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857783.164612:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857783.171872:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188246400:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857783.171905:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857783.177662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.179291:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171677056 00000100:00100000:3.0:1787857783.179304:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171677056 00010000:00010000:3.0:1787857783.179444:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 92 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787857783.179487:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857783.179490:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 322 00000100:00100000:3.0:1787857783.179500:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:2348:x1874704171677056:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857783.179533:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857783.179541:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 92 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.179556:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 92 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.179703:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c64b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ad2 expref: 92 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.180075:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:3.0:1787857783.180082:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.180093:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.180102:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.180382:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857783.180449:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+91:2348:x1874704171677056:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 949us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.180458:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 322 00010000:00010000:1.0:1787857783.182571:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.182589:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.182630:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.182644:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.182655:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183352:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183375:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183382:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183388:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857783.183394:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183402:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183427:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:1.0:1787857783.183430:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857783.183436:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183442:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c739 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183457:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183464:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183471:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183475:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857783.183484:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183491:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183498:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0xe2920460 (ffff9998c4eb6d00) 00010000:00010000:1.0:1787857783.183501:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857783.183504:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.183510:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c740 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0xe2920460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.183700:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28127:x1874704171676928:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 19449us (19647us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857783.183961:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1066 00000100:00100000:2.0:1787857783.192039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.192407:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171677184 00000100:00100000:3.0:1787857783.192429:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171677184 00000100:00100000:3.0:1787857783.192496:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1067 00000100:00100000:3.0:1787857783.192506:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28127:x1874704171677184:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857783.192547:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857783.192571:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c747 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b1f expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.192606:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.192631:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.192645:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.192755:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c747 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.192774:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 45 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.192783:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:3.0:1787857783.192785:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857783.192788:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857783.192886:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28127:x1874704171677184:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 382us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.192894:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1067 00000100:00100000:3.0:1787857783.200551:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.200814:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171677440 00000100:00100000:0.0:1787857783.200870:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171677440 00000100:00100000:0.0:1787857783.200947:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1068 00000100:00100000:0.0:1787857783.200957:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28127:x1874704171677440:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857783.201043:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.201072:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.201085:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857783.201304:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6f5967d reply state 000000001a98c604 transno 4294967990 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857783.201315:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857783.201428:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28127:x1874704171677440:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 472us (895us total) trans 4294967990 rc 0/0 00000100:00100000:0.0:1787857783.201437:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1068 00000100:00100000:0.0:1787857783.209193:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.209385:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171677568 00000100:00100000:1.0:1787857783.209395:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171677568 00000100:00100000:1.0:1787857783.209519:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1069 00000100:00100000:1.0:1787857783.209531:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28127:x1874704171677568:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857783.209557:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857783.209579:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b26 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.209654:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.209668:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.209696:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:1.0:1787857783.209698:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857783.209703:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857783.209942:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28127:x1874704171677568:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 413us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857783.209949:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1069 00010000:00010000:2.0:1787857783.210218:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.210228:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.210235:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.210241:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857783.210252:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.210261:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.210274:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:2.0:1787857783.210276:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787857783.210280:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.210299:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c755 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.216210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.216843:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171677696 00000100:00100000:3.0:1787857783.216854:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171677696 00000100:00100000:3.0:1787857783.216912:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 210 00000100:00100000:3.0:1787857783.216934:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6122850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28127:x1874704171677696:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787857783.217066:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6122850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28127:x1874704171677696:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 133us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.217073:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 210 00000100:00100000:0.0:1787857783.224101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.224184:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171677952 00000100:00100000:3.0:1787857783.224194:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171677952 00000100:00100000:3.0:1787857783.224251:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 211 00000100:00100000:3.0:1787857783.224261:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28127:x1874704171677952:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857783.224549:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28127:x1874704171677952:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 288us (458us total) trans 4294967991 rc 0/0 00000100:00100000:3.0:1787857783.224558:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 211 00000100:00100000:2.0:1787857783.239694:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.239863:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171678208 00000100:00100000:3.0:1787857783.239872:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171678208 00000100:00100000:3.0:1787857783.239934:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1070 00000100:00100000:3.0:1787857783.239944:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28127:x1874704171678208:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857783.240075:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28127:x1874704171678208:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 131us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.240082:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1070 00000100:00100000:1.0:1787857783.243999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.244087:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171678464 00000100:00100000:3.0:1787857783.244097:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171678464 00000100:00100000:3.0:1787857783.244204:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1071 00000100:00100000:3.0:1787857783.244215:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28127:x1874704171678464:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857783.244235:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857783.244256:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c763 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b2d expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.244400:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.244429:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.244439:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.244472:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.244485:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 49 pid: 5856 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857783.244498:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a23480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188246528:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857783.244583:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857783.249559:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a23480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188246528:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857783.249593:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.255297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.255475:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171678592 00000100:00100000:3.0:1787857783.255487:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171678592 00010000:00010000:3.0:1787857783.255538:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 50 pid: 5856 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857783.255580:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 323 00000100:00100000:3.0:1787857783.255607:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2350:x1874704171678592:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857783.255636:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857783.255644:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 50 pid: 5856 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.255659:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 50 pid: 5856 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.255686:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c75c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b26 expref: 50 pid: 5856 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.255713:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:3.0:1787857783.255719:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.255734:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.255743:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.255775:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857783.255863:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2350:x1874704171678592:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 258us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.255870:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 323 00010000:00010000:0.0:1787857783.256217:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.256226:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857783.256245:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00000004:00080000:0.0:1787857783.256908:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:0.0:1787857783.257083:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257092:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257099:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257106:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857783.257110:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257122:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257136:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:0.0:1787857783.257139:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857783.257143:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257149:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7c76a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257208:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c763 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b2d expref: 49 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257218:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9998d1291100) 00010000:00010000:0.0:1787857783.257220:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857783.257224:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7c763 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b2d expref: 49 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.257233:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72e00, rc 0) 00000100:00100000:0.0:1787857783.257297:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28127:x1874704171678464:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 13077us (13303us total) trans 4294967992 rc 301/301 00000100:00100000:0.0:1787857783.257305:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1071 00000100:00100000:1.0:1787857783.260405:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.260518:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171678848 00000100:00100000:3.0:1787857783.260529:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171678848 00000100:00100000:3.0:1787857783.260586:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 212 00000100:00100000:3.0:1787857783.260597:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28127:x1874704171678848:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857783.261702:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28127:x1874704171678848:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1101us (1302us total) trans 4294967993 rc 0/0 00000100:00100000:3.0:1787857783.261713:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 212 00000100:00100000:2.0:1787857783.267656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.267760:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171678976 00000100:00100000:3.0:1787857783.267777:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171678976 00000100:00100000:3.0:1787857783.267912:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1072 00000100:00100000:2.0:1787857783.267968:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28127:x1874704171678976:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857783.267999:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857783.268023:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c778 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b34 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.268179:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c77f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.268194:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.268206:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857783.268245:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1787857783.269148:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857783.269185:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.269218:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c778 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b34 expref: 51 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.269237:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b34 expref: 50 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.269246:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:2.0:1787857783.269250:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787857783.269254:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74e00, rc 0) 00000100:00100000:2.0:1787857783.270788:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:28127:x1874704171678976:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2853us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857783.270800:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1072 00000100:00100000:2.0:1787857783.281394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.281546:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171679104 00000100:00100000:0.0:1787857783.281559:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171679104 00000100:00100000:0.0:1787857783.281727:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 283 00000100:00100000:0.0:1787857783.281742:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171679104:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857783.281769:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857783.281797:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b3b expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857783.281853:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857783.281883:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=607s v=(0 0) 00010000:00010000:0.0:1787857783.281889:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857783.281900:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.281926:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.281943:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70600, rc 0) 00000100:00100000:0.0:1787857783.282041:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171679104:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 303us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857783.282049:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 283 00000100:00080000:2.0:1787857783.282143:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857783.289080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.289515:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171679360 00000100:00100000:3.0:1787857783.289534:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171679360 00000100:00100000:3.0:1787857783.289628:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1073 00000100:00100000:3.0:1787857783.289639:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:28127:x1874704171679360:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857783.289993:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:28127:x1874704171679360:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 354us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.290001:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1073 00000100:00100000:1.0:1787857783.294269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.295340:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171679488 00000100:00100000:0.0:1787857783.295357:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171679488 00000100:00100000:0.0:1787857783.295448:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 284 00000100:00100000:0.0:1787857783.295458:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:28127:x1874704171679488:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857783.295482:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857783.295504:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b42 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.295553:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.295565:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857783.295571:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857783.295577:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.295631:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.295647:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 10 pid: 8490 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857783.295666:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188246656:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857783.295794:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4e43000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857783.305441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.305642:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188246656:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857783.305690:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.305730:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71c00, rc 0) 00000100:00100000:0.0:1787857783.305809:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:28127:x1874704171679488:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 10352us (11556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857783.305865:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 284 00000100:00100000:1.0:1787857783.306058:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171679616 00000100:00100000:1.0:1787857783.306071:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171679616 00010000:00010000:1.0:1787857783.306119:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 10 pid: 8490 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.306155:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 324 00000100:00100000:1.0:1787857783.306164:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171679616:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857783.306181:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857783.306208:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 10 pid: 8490 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.306223:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 10 pid: 8490 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.306279:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d2527f1/0xd3f183cab4a7c786 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b3b expref: 10 pid: 8490 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.306462:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857783.306466:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857783.306477:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.306489:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.306528:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.306542:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188246784:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857783.306608:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857783.314071:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188246784:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857783.314124:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857783.314212:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171679616:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 8047us (8782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857783.314227:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 324 00000100:00100000:1.0:1787857783.314723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.314905:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171679744 00000100:00100000:0.0:1787857783.314915:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171679744 00002000:00100000:0.0:1787857783.314978:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x15:0x0] (0->1515) req@ffff9998e185f0c0 x1874704171679744/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:429/0 lens 2008/0 e 0 to 0 dl 1787857794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857783.314991:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998e185f0c0 with x1874704171679744 ext(0->1515) 00002000:00010000:0.0:1787857783.314997:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998e185f0c0 00000100:00100000:0.0:1787857783.315126:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 97 00000100:00100000:0.0:1787857783.315138:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171679744:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787857783.315872:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171679744:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 733us (1147us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787857783.315881:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 97 00002000:00100000:0.0:1787857783.315890:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x15:0x0] (0->1515) req@ffff9998e185f0c0 x1874704171679744/t4294967351(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:429/0 lens 2008/448 e 0 to 0 dl 1787857794 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857783.315899:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998e185f0c0 with x1874704171679744 ext(0->1515) 00002000:00010000:0.0:1787857783.315904:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998e185f0c0 00000100:00100000:1.0:1787857783.318974:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.319092:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171679872 00000100:00100000:0.0:1787857783.319106:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171679872 00000100:00100000:0.0:1787857783.319187:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1074 00000100:00100000:0.0:1787857783.319199:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:28127:x1874704171679872:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787857783.419062:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967992 is committed 00000020:00080000:2.0:1787857783.419360:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 19 batchid updated 00000001:00080000:2.0:1787857783.419383:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967993 is committed 00000020:00080000:0.0:1787857783.419549:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 19 00000100:00100000:3.0:1787857783.419550:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28127:x1874704171679872:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 100342us (100580us total) trans 0 rc 0/0 00000020:00080000:0.0:1787857783.419563:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 19 00000100:00100000:3.0:1787857783.419568:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1074 00000100:00100000:1.0:1787857783.424079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.426183:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171680000 00000100:00100000:0.0:1787857783.426208:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171680000 00000100:00100000:0.0:1787857783.426315:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 285 00000100:00100000:0.0:1787857783.426328:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171680000:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787857783.478067:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00000100:00100000:1.0:1787857783.478584:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171680000:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 52250us (54513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857783.478600:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 285 00000100:00100000:2.0:1787857783.481612:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.482032:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171680256 00000100:00100000:1.0:1787857783.482046:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171680256 00000100:00100000:1.0:1787857783.482142:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1075 00000100:00100000:1.0:1787857783.482154:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28127:x1874704171680256:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857783.482240:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857783.482293:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c77f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b34 expref: 44 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.482325:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:1.0:1787857783.482332:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857783.482461:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.482481:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.482494:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857783.482909:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f7dfb8a reply state 000000007315f02c transno 4294967994 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857783.482921:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857783.483116:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28127:x1874704171680256:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 955us (1511us total) trans 4294967994 rc 0/0 00000100:00100000:2.0:1787857783.483124:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1075 00000100:00100000:1.0:1787857783.486751:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.487135:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171680384 00000100:00100000:0.0:1787857783.487150:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171680384 00000100:00100000:0.0:1787857783.487241:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1076 00000100:00100000:0.0:1787857783.487253:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28127:x1874704171680384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857783.487290:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857783.487319:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b49 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.487402:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.487431:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.487457:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:0.0:1787857783.487460:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857783.487465:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00010000:00010000:3.0:1787857783.489586:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.489612:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.489622:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.489629:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.489661:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.489671:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.489695:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:3.0:1787857783.489712:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857783.489719:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.489726:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c794 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857783.490080:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28127:x1874704171680384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2819us (3334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857783.490092:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1076 00000100:00100000:1.0:1787857783.496097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.496279:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171680512 00000100:00100000:0.0:1787857783.496294:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171680512 00000100:00100000:0.0:1787857783.496432:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 286 00000100:00100000:0.0:1787857783.496447:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171680512:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787857783.496797:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:0.0:1787857783.496803:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb mtime from disk: 0 -> 1787857780 00002000:00010000:0.0:1787857783.496806:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb atime from disk: 0 -> 1787857780 00002000:00010000:0.0:1787857783.496808:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb ctime from disk: 0 -> 1787857780 00002000:00010000:0.0:1787857783.496810:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787857783.496930:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171680512:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 485us (846us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787857783.496940:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 286 00000100:00100000:3.0:1787857783.500113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.500240:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171680768 00000100:00100000:1.0:1787857783.500252:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171680768 00000100:00100000:1.0:1787857783.500337:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1077 00000100:00100000:1.0:1787857783.500350:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28127:x1874704171680768:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787857783.500459:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.500482:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 45 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.500493:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.500540:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 45 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.500556:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 45 pid: 19301 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.500601:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188246912:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857783.500726:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857783.503889:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188246912:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857783.503935:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857783.506010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.506531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171680896 00000100:00100000:0.0:1787857783.506546:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171680896 00010000:00010000:0.0:1787857783.506610:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 46 pid: 19301 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857783.506669:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 325 00000100:00100000:0.0:1787857783.506683:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2349:x1874704171680896:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857783.506707:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857783.506715:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 46 pid: 19301 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.506730:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 46 pid: 19301 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.506761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7c74e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b1f expref: 46 pid: 19301 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.506787:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:0.0:1787857783.506794:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.506805:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.506813:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.506891:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857783.506966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2349:x1874704171680896:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 286us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857783.506975:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 325 00010000:00010000:3.0:1787857783.507083:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.507092:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.507146:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.507154:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.507185:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.507192:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.507196:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.507206:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.507217:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:3.0:1787857783.507220:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787857783.507224:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.507232:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c7a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857783.507284:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28127:x1874704171680768:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 6936us (7199us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787857783.507308:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1077 00000100:00100000:1.0:1787857783.511774:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857783.514828:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171681024 00000100:00100000:0.0:1787857783.514922:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171681024 00000100:00100000:0.0:1787857783.515123:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 287 00000100:00100000:0.0:1787857783.515137:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171681024:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857783.515202:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.515228:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.515238:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857783.515243:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857783.515249:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.515313:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.515331:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 10 pid: 14028 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857783.515350:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188247040:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857783.515499:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857783.524031:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188247040:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857783.524073:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.526350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.526802:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171681152 00000100:00100000:3.0:1787857783.526850:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171681152 00010000:00010000:3.0:1787857783.526909:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 11 pid: 14028 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857783.526962:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 326 00000100:00100000:3.0:1787857783.526974:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171681152:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857783.527021:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857783.527052:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 11 pid: 14028 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.527069:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 11 pid: 14028 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.527114:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7c78d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b42 expref: 11 pid: 14028 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.527138:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857783.527143:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857783.527150:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.527162:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.527192:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857783.527277:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171681152:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 304us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.527286:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 326 00010000:00010000:0.0:1787857783.527412:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.527425:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.527460:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.527469:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.527485:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.527493:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857783.527499:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.527509:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.527524:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.527533:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7c7a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857783.527596:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171681024:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 12462us (15839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857783.527606:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 287 00000100:00100000:1.0:1787857783.531576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857783.531711:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171681408 00000100:00100000:2.0:1787857783.531724:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171681408 00000100:00100000:2.0:1787857783.531807:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1078 00000100:00100000:2.0:1787857783.531853:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28127:x1874704171681408:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857783.531965:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.531988:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.532003:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.532303:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.532317:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.532326:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.532396:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.532424:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 45 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857783.532443:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188247168:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857783.532558:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4df9cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787857783.536693:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857783.537116:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.537511:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171681536 00000100:00100000:1.0:1787857783.537525:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171681536 00010000:00010000:1.0:1787857783.537585:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 46 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857783.537640:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 327 00000100:00100000:1.0:1787857783.537652:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2350:x1874704171681536:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857783.537673:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857783.537681:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 46 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.537703:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 46 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.537735:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:1.0:1787857783.537743:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.537754:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.537787:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.537813:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857783.537923:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2350:x1874704171681536:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 273us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857783.537933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 327 00010000:00010000:0.0:1787857783.539484:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c79b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b49 expref: 45 pid: 5857 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857783.539515:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188247168:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857783.539549:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.539563:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857783.539570:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857783.540170:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967995 00000001:00080000:0.0:1787857783.540385:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967996 00000001:00080000:0.0:1787857783.540455:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967997 00000100:00100000:0.0:1787857783.540571:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188247296:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787857783.540659:0:19301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857783.540718:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0df4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857783.540842:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188247296 00000100:00100000:3.0:1787857783.540853:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188247296 00000100:00100000:3.0:1787857783.540945:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787857783.540958:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188247296:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787857783.541084:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188247296:12345-0@lo:1000:mdt00_004.0 Request processed in 128us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.541092:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787857783.541138:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188247296:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787857783.541567:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967998 00000100:00100000:3.0:1787857783.541628:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a212c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188247424:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787857783.541670:0:19301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857783.541694:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857783.541712:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188247424 00000100:00100000:3.0:1787857783.541715:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188247424 00000100:00100000:3.0:1787857783.541736:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787857783.541741:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188247424:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787857783.541964:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19301:x1874704188247424:12345-0@lo:1000:mdt00_004.0 Request processed in 221us (293us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787857783.541971:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787857783.542009:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a212c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188247424:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787857783.542097:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967999 00010000:00010000:3.0:1787857783.542128:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542139:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542147:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542154:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.542167:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542177:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542200:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998c3984300) 00010000:00010000:3.0:1787857783.542204:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857783.542210:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542216:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c7b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542256:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542262:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542268:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542273:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.542276:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542281:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542289:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:3.0:1787857783.542292:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857783.542307:0:19301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73c00/0xd3f183cab4a7c6ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b0a expref: 90 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542321:0:19301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73c00/0xd3f183cab4a7c6ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b0a expref: 90 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542332:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73c00/0xd3f183cab4a7c6ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b0a expref: 90 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.542365:0:19301:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73c00/0xd3f183cab4a7c6ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b0a expref: 90 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857783.542379:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188247552:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857783.542479:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bfd80 going to sleep for 11 seconds 00000100:00080000:2.0:1787857783.542723:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857783.547029:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a230c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188247552:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857783.547072:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547086:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c6e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547142:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547160:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547176:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547230:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547237:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547244:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547250:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.547255:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547263:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547279:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:3.0:1787857783.547283:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857783.547286:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547292:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c7be lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547304:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547311:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547317:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547330:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857783.547333:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547340:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547350:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff9998d34a6d00) 00010000:00010000:3.0:1787857783.547352:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857783.547355:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.547361:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c7b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857783.547691:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28127:x1874704171681408:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 15871us (16130us total) trans 4294968000 rc 0/0 00000100:00100000:3.0:1787857783.547704:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1078 00000020:00080000:3.0:1787857783.547712:0:19301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787857783.547977:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857783.547983:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857783.548465:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857783.548476:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857783.550534:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.550629:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171681664 00000100:00100000:1.0:1787857783.550643:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171681664 00000100:00100000:1.0:1787857783.550712:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 213 00000100:00100000:1.0:1787857783.550722:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+91:28126:x1874704171681664:12345-192.168.204.36@tcp:49:cmp.0 00000100:00100000:1.0:1787857783.550923:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+91:28126:x1874704171681664:12345-192.168.204.36@tcp:49:cmp.0 Request processed in 202us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857783.550931:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 213 00000100:00100000:1.0:1787857783.553627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857783.553736:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171681920 00000100:00100000:3.0:1787857783.553749:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171681920 00000100:00100000:3.0:1787857783.553849:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 214 00000100:00100000:3.0:1787857783.553862:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28127:x1874704171681920:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787857783.554751:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787857783.554927:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968001 00010000:00010000:3.0:1787857783.554990:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.555025:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.555039:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.555049:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.555056:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.555062:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857783.555095:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857783.555241:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:28127:x1874704171681920:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1378us (1626us total) trans 4294968002 rc 0/0 00000100:00100000:3.0:1787857783.555252:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 214 00000020:00080000:3.0:1787857783.555259:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787857783.555437:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857783.555447:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.555457:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857783.555462:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.555471:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.555488:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff9998d34a6a00) 00010000:00010000:2.0:1787857783.555492:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787857783.555498:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.555513:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7c7c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857783.555537:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857783.555539:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857783.555541:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857783.560768:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.560912:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171682048 00000100:00100000:1.0:1787857783.560927:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171682048 00000100:00100000:1.0:1787857783.561031:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 288 00000100:00100000:1.0:1787857783.561043:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+14:28126:x1874704171682048:12345-192.168.204.36@tcp:101:cmp.0 00010000:00010000:1.0:1787857783.561069:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857783.561112:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093833cd9/0xd3f183cab4a7c7cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b50 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857783.561151:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 1516, mtime: 0x6a908b74, atime: 0x6a908b74, ctime: 0x6a908b74, blocks: 0xb 00010000:00010000:1.0:1787857783.561181:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1787857783.561187:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857783.561219:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093833cd9/0xd3f183cab4a7c7cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b50 expref: 15 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.561243:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093833cd9/0xd3f183cab4a7c7cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b50 expref: 15 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857783.561260:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053e00, rc 0) 00000100:00100000:1.0:1787857783.561362:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:28126:x1874704171682048:12345-192.168.204.36@tcp:101:cmp.0 Request processed in 320us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857783.561371:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 288 00000100:00080000:2.0:1787857783.562189:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857783.569137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857783.569285:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171682176 00000100:00100000:2.0:1787857783.569298:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171682176 00002000:00100000:2.0:1787857783.569372:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x15:0x0] (0->4095) req@ffff9998daac0000 x1874704171682176/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:429/0 lens 488/0 e 0 to 0 dl 1787857794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857783.569385:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998daac0000 with x1874704171682176 ext(0->4095) 00002000:00010000:2.0:1787857783.569391:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998daac0000 00000100:00100000:2.0:1787857783.569443:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 98 00000100:00100000:2.0:1787857783.569455:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2350:x1874704171682176:12345-192.168.204.36@tcp:3:cmp.0 00000100:00100000:2.0:1787857783.569752:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2350:x1874704171682176:12345-192.168.204.36@tcp:3:cmp.0 Request processed in 298us (641us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857783.569760:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 98 00002000:00100000:2.0:1787857783.569767:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x15:0x0] (0->4095) req@ffff9998daac0000 x1874704171682176/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:429/0 lens 488/4536 e 0 to 0 dl 1787857794 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857783.569775:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998daac0000 with x1874704171682176 ext(0->4095) 00002000:00010000:2.0:1787857783.569779:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998daac0000 00000100:00100000:3.0:1787857783.576335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857783.576471:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171682432 00000100:00100000:1.0:1787857783.576485:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171682432 00000100:00100000:1.0:1787857783.576605:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 215 00000100:00100000:1.0:1787857783.576618:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+91:28126:x1874704171682432:12345-192.168.204.36@tcp:35:cmp.0 00000100:00100000:1.0:1787857783.576994:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:28126:x1874704171682432:12345-192.168.204.36@tcp:35:cmp.0 Request processed in 377us (674us total) trans 4294968003 rc 0/0 00000100:00100000:1.0:1787857783.577004:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 215 00000100:00100000:2.0:1787857783.663350:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188247680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857783.663487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857783.664115:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188247680 00000100:00100000:3.0:1787857783.664128:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188247680 00000100:00100000:3.0:1787857783.664204:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787857783.664217:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188247680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857783.664253:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3854565376 00000100:00100000:3.0:1787857783.664345:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188247680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857783.664355:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787857783.664598:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188247680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857784.558467:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857784.925593:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857784.925645:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857784.925693:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857784.925720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857784.925740:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857784.925774:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857784.925802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857784.925867:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171683072 00000100:00100000:3.0:1787857784.925877:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171683072 00000100:00100000:3.0:1787857784.925930:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171682688 00000100:00100000:3.0:1787857784.925934:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171682688 00000100:00100000:3.0:1787857784.925955:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 407 00000100:00100000:3.0:1787857784.925966:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171683072:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857784.926052:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171683072:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 87us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857784.926060:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 407 00000100:00100000:3.0:1787857784.926077:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:3.0:1787857784.926096:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:2349:x1874704171682688:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857784.926125:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:2349:x1874704171682688:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857784.926131:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:3.0:1787857784.926152:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171682816 00000100:00100000:3.0:1787857784.926156:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171682816 00000100:00100000:3.0:1787857784.926181:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171683328 00000100:00100000:3.0:1787857784.926184:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171683328 00000100:00100000:3.0:1787857784.926207:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171682944 00000100:00100000:3.0:1787857784.926210:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171682944 00000100:00100000:3.0:1787857784.926244:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171683200 00000100:00100000:3.0:1787857784.926247:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171683200 00000100:00100000:3.0:1787857784.926261:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00100000:3.0:1787857784.926266:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171682816:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857784.926294:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171682816:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857784.926300:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00100000:3.0:1787857784.926312:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:3.0:1787857784.926319:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171683328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857784.926346:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171683328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857784.926352:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:3.0:1787857784.926370:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 404 00000100:00100000:3.0:1787857784.926388:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171682944:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857784.926412:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171682944:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857784.926419:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 404 00000100:00100000:3.0:1787857784.926430:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 405 00000100:00100000:3.0:1787857784.926435:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171683200:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857784.926459:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171683200:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857784.926465:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 405 00000100:00080000:3.0:1787857784.926616:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857784.926986:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171682560 00000100:00100000:0.0:1787857784.926992:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171682560 00000100:00100000:0.0:1787857784.927026:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 567 00000100:00100000:0.0:1787857784.927033:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171682560:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857784.927083:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171682560:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 51us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857784.927090:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 567 00000100:00100000:3.0:1787857785.198878:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188247936:0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.198963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857785.199009:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3042d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188248448:0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.199035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857785.199065:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857785.199271:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188248064:0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.199301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857785.199339:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188247936 00000100:00100000:3.0:1787857785.199345:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188247936 00000100:00100000:3.0:1787857785.199399:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188248064 00000100:00100000:3.0:1787857785.199403:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188248064 00000100:00100000:3.0:1787857785.199432:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1787857785.199441:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188247936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.199490:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188247936:12345-0@lo:400:kworker.0 Request processed in 50us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857785.199498:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1787857785.199519:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1787857785.199526:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188248064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.199554:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188248064:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857785.199559:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1787857785.199574:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188248448 00000100:00100000:3.0:1787857785.199577:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188248448 00000100:00100000:3.0:1787857785.199603:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787857785.199609:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188248448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.199640:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188248448:12345-0@lo:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857785.199646:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00080000:3.0:1787857785.199675:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857785.199680:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857785.199710:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188248064:0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.199721:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188247936:0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.199731:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3042d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188248448:0@lo:400:kworker.0 00000100:00100000:0.0:1787857785.199812:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188247808:0@lo:400:kworker.0 00000100:00100000:0.0:1787857785.199868:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857785.199895:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188248320:0@lo:400:kworker.0 00000100:00100000:0.0:1787857785.199920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857785.199941:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857785.199946:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188248192:0@lo:400:kworker.0 00000100:00100000:0.0:1787857785.199968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857785.199997:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188248192 00000100:00100000:0.0:1787857785.200001:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188248192 00000100:00100000:0.0:1787857785.200034:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1787857785.200041:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188248192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857785.200190:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188248192:12345-0@lo:400:kworker.0 Request processed in 149us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857785.200197:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00080000:0.0:1787857785.200218:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857785.200235:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188248192:0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.201222:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188247808 00000100:00100000:3.0:1787857785.201230:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188247808 00000100:00100000:3.0:1787857785.201264:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1787857785.201271:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188247808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857785.201322:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188247808:12345-0@lo:400:kworker.0 Request processed in 52us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857785.201329:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:0.0:1787857785.201434:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188247808:0@lo:400:kworker.0 00000100:00100000:0.0:1787857785.201911:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188248320 00000100:00100000:0.0:1787857785.201916:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188248320 00000100:00100000:0.0:1787857785.201963:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1787857785.201970:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188248320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857785.202015:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188248320:12345-0@lo:400:kworker.0 Request processed in 46us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857785.202021:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00080000:0.0:1787857785.202051:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857785.202149:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3042940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188248320:0@lo:400:kworker.0 00010000:00010000:1.0:1787857785.582061:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857785.710569:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857785.715240:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188248576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857785.716241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857785.716396:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188248576 00000100:00100000:0.0:1787857785.716412:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188248576 00000100:00100000:0.0:1787857785.717813:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787857785.717854:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188248576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857785.717911:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 78184448 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857785.718024:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188248576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857785.718036:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787857785.721154:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188248576:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787857785.837509:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967359 is committed 00000001:00080000:1.0:1787857785.838194:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967357 is committed 00010000:00010000:2.0:1787857786.610441:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857787.632426:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857788.654378:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857788.785053:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188248704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857788.785170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857788.788424:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188248704 00000100:00100000:1.0:1787857788.788446:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188248704 00000100:00100000:1.0:1787857788.788617:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787857788.788631:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188248704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857788.788689:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857788.788812:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188248704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (3643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857788.788840:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1787857788.791732:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857788.791873:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188248704:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787857788.916646:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967998 is committed 00000001:00080000:2.0:1787857788.916671:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968003 is committed 00000001:00080000:2.0:1787857788.916682:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968002 is committed 00000020:00080000:2.0:1787857788.916700:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998d09bf240 refcount 2 committed 0 result 0 batchid 20 00000020:00080000:2.0:1787857788.916707:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f0cec900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998d09bf840 00000020:00080000:2.0:1787857788.916711:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f0cec600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c2bfd800 00000020:00080000:2.0:1787857788.916732:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 20 committed batchid 19 00000020:00080000:2.0:1787857788.916897:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 19 00000001:00080000:3.0:1787857788.939884:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00000001:00080000:3.0:1787857788.939911:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00000100:00100000:3.0:1787857789.173769:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857789.178884:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171683456 00000100:00100000:0.0:1787857789.178900:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171683456 00000100:00100000:0.0:1787857789.178993:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1079 00000100:00100000:0.0:1787857789.179005:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28106:x1874704171683456:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787857789.179133:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28106:x1874704171683456:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 131us (5380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857789.179152:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1079 00000100:00080000:0.0:1787857789.179186:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857789.678045:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857790.038260:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857790.038313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857790.038321:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171683584 00000100:00100000:3.0:1787857790.038330:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171683584 00000100:00100000:1.0:1787857790.038339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857790.038358:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857790.038373:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 569 00000100:00100000:1.0:1787857790.038376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857790.038383:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171683584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857790.038400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857790.038424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857790.038456:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171683584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857790.038466:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 569 00000100:00100000:0.0:1787857790.039900:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171684096 00000100:00100000:0.0:1787857790.039909:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171684096 00000100:00100000:0.0:1787857790.039962:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171683712 00000100:00100000:0.0:1787857790.039965:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171683712 00000100:00100000:0.0:1787857790.040018:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 412 00000100:00100000:0.0:1787857790.040026:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:2348:x1874704171684096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857790.040401:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171683840 00000100:00100000:1.0:1787857790.040406:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171683840 00000100:00100000:1.0:1787857790.040434:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171684352 00000100:00100000:1.0:1787857790.040437:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171684352 00000100:00100000:1.0:1787857790.040447:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171683968 00000100:00100000:1.0:1787857790.040450:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171683968 00000100:00100000:1.0:1787857790.040460:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171684224 00000100:00100000:1.0:1787857790.040462:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171684224 00000100:00100000:1.0:1787857790.040475:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:1.0:1787857790.040481:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2348:x1874704171683840:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857790.040516:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2348:x1874704171683840:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857790.040546:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:1.0:1787857790.040566:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:1.0:1787857790.040572:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171684352:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857790.040756:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171684352:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 182us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857790.040763:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:1.0:1787857790.040775:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 410 00000100:00100000:1.0:1787857790.040781:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171683968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857790.040801:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171683968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857790.040807:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 410 00000100:00100000:1.0:1787857790.040831:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 411 00000100:00100000:1.0:1787857790.040838:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171684224:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857790.040859:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171684224:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857790.040865:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 411 00000100:00100000:1.0:1787857790.040882:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:1.0:1787857790.040888:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+91:2348:x1874704171683712:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857790.040908:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+91:2348:x1874704171683712:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857790.040914:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:0.0:1787857790.043209:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:2348:x1874704171684096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 3166us (4851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857790.043226:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 412 00000100:00080000:0.0:1787857790.043272:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857790.043291:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857790.043295:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857790.319084:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188248832:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.319204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857790.319282:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188249344:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.319316:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857790.319363:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857790.319371:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188249216:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.319406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857790.319458:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188248960:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.319492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857790.319516:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188249472:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.319543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857790.319566:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857790.319572:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188249088:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.319596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857790.319636:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188248832 00000100:00100000:0.0:1787857790.319648:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188248832 00000100:00100000:0.0:1787857790.319707:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1787857790.319718:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188248832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.319784:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188248832:12345-0@lo:400:kworker.0 Request processed in 68us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857790.319793:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1787857790.319886:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188249344 00000100:00100000:0.0:1787857790.319892:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188249344 00000100:00100000:0.0:1787857790.319941:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188248960 00000100:00100000:0.0:1787857790.319944:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188248960 00000100:00100000:0.0:1787857790.319967:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188249088 00000100:00100000:0.0:1787857790.319969:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188249088 00000100:00100000:0.0:1787857790.319986:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1787857790.319993:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188249344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320033:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188249344:12345-0@lo:400:kworker.0 Request processed in 41us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857790.320040:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1787857790.320054:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787857790.320061:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188248960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320098:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188248960:12345-0@lo:400:kworker.0 Request processed in 38us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857790.320105:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787857790.320121:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1787857790.320128:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188249088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320177:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188249088:12345-0@lo:400:kworker.0 Request processed in 50us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857790.320183:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1787857790.320209:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188249216 00000100:00100000:0.0:1787857790.320213:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188249216 00000100:00100000:0.0:1787857790.320250:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188249472 00000100:00100000:0.0:1787857790.320254:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188249472 00000100:00100000:0.0:1787857790.320296:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787857790.320305:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188249216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320347:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188249216:12345-0@lo:400:kworker.0 Request processed in 44us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857790.320354:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787857790.320370:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1787857790.320379:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188249472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320415:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188249472:12345-0@lo:400:kworker.0 Request processed in 39us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857790.320422:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1787857790.320492:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:0.0:1787857790.320500:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967353 committed transno 4294967353 00000100:00100000:0.0:1787857790.320533:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188249216:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320549:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188248832:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320564:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188249344:0@lo:400:kworker.0 00000100:00080000:0.0:1787857790.320599:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857790.320605:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857790.320610:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857790.320646:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188249088:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320660:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188248960:0@lo:400:kworker.0 00000100:00100000:0.0:1787857790.320673:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:0.0:1787857790.320683:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967358 committed transno 4294967359 00000004:00080000:0.0:1787857790.320705:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9998e185e1c0, transno 4294967359 00000100:00100000:0.0:1787857790.320719:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188249472:0@lo:400:kworker.0 00010000:00010000:2.0:1787857790.706118:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787857790.783443:0:20246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12n: Import/implicit restore/release == 15:09:48 (1787857788) 00000100:00100000:1.0:1787857790.830071:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857790.830097:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188249600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857790.830495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857790.830784:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188249600 00000100:00100000:2.0:1787857790.830793:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188249600 00000100:00100000:2.0:1787857790.831315:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787857790.831327:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188249600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857790.831362:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857790.832480:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188249600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1151us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857790.832492:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787857790.835329:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188249600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857791.009269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.009336:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171684480 00000100:00100000:3.0:1787857791.009354:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171684480 00000100:00100000:3.0:1787857791.009461:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1080 00000100:00100000:3.0:1787857791.009485:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28729:x1874704171684480:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787857791.009606:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28729:x1874704171684480:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 121us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857791.009613:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1080 00000100:00080000:3.0:1787857791.009636:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857791.030674:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857791.030764:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857791.033323:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171684608 00000100:00100000:0.0:1787857791.033336:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171684608 00000100:00100000:0.0:1787857791.033401:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171684864 00000100:00100000:0.0:1787857791.033405:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171684864 00000100:00100000:0.0:1787857791.033430:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1081 00000100:00100000:0.0:1787857791.033439:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+92:2347:x1874704171684608:12345-192.168.204.36@tcp:41:mkdir.0 00000100:00100000:2.0:1787857791.033459:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1082 00000100:00100000:2.0:1787857791.033472:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:28730:x1874704171684864:12345-192.168.204.36@tcp:36:mkdir.0 00000004:00000024:0.0:1787857791.033484:0:19301:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 2259812352 avail 2257715200 00010000:00010000:2.0:1787857791.033516:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857791.033548:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c53a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a70 expref: 92 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857791.033563:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+92:2347:x1874704171684608:12345-192.168.204.36@tcp:41:mkdir.0 Request processed in 124us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857791.033576:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1081 00010000:00010000:2.0:1787857791.033601:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:2.0:1787857791.033606:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857791.033941:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.033971:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.033981:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.034026:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.034042:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 41 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857791.034067:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188249728:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857791.034139:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857791.036639:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188249728:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857791.036671:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857791.037633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.040167:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171684992 00000100:00100000:3.0:1787857791.040182:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171684992 00010000:00010000:3.0:1787857791.040230:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 42 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857791.040281:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 328 00000100:00100000:3.0:1787857791.040291:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:2350:x1874704171684992:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857791.040305:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857791.040312:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 42 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040326:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 42 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040350:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c579 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3a85 expref: 42 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040368:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857791.040383:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040394:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040402:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040430:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857791.040487:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:2350:x1874704171684992:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 198us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857791.040495:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 328 00010000:00010000:3.0:1787857791.040525:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040533:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040555:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040564:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.040571:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857791.041744:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 512 00010000:00010000:3.0:1787857791.041758:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.041767:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.041781:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.041787:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857791.041791:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.041800:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.041837:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d1291e00) 00010000:00010000:3.0:1787857791.041841:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857791.041845:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.041852:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c7d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857791.041870:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062053a60 reply state 00000000dcf18e33 transno 4294968004 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857791.041879:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857791.041955:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:28730:x1874704171684864:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 8485us (11188us total) trans 4294968004 rc 0/0 00000100:00100000:3.0:1787857791.041963:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1082 00010000:00010000:2.0:1787857791.045936:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.045954:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.046010:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.046047:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857791.046051:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.046059:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.046078:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff9998d5316d00) 00010000:00010000:2.0:1787857791.046081:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857791.046086:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.046093:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c7da lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857791.541645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.541723:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171685120 00000100:00100000:3.0:1787857791.541732:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171685120 00000100:00100000:3.0:1787857791.541793:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1083 00000100:00100000:3.0:1787857791.541803:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+91:28767:x1874704171685120:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:3.0:1787857791.541871:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857791.541896:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c7e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b57 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.541979:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c7e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.542003:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.542015:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857791.542084:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857791.542089:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857791.542114:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.542139:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c7e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b57 expref: 93 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.542171:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b57 expref: 92 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.542181:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:3.0:1787857791.542184:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857791.542188:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72200, rc 0) 00000100:00100000:3.0:1787857791.542257:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+92:28767:x1874704171685120:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 448us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857791.542265:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1083 00000100:00100000:1.0:1787857791.555334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857791.555422:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171685376 00000100:00100000:0.0:1787857791.555433:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171685376 00000100:00100000:0.0:1787857791.555492:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1084 00000100:00100000:0.0:1787857791.555501:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+92:28767:x1874704171685376:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:0.0:1787857791.555656:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857791.555684:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c7e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b57 expref: 92 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.555707:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316900) 00010000:00010000:0.0:1787857791.555717:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857791.555897:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+91:28767:x1874704171685376:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 397us (574us total) trans 0 rc -17/-17 00000100:00100000:0.0:1787857791.555905:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1084 00000100:00100000:1.0:1787857791.559925:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.561337:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171685504 00000100:00100000:3.0:1787857791.561350:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171685504 00000100:00100000:3.0:1787857791.561428:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1085 00000100:00100000:3.0:1787857791.561438:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+91:28767:x1874704171685504:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:3.0:1787857791.561459:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857791.561482:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c7ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b5e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.561656:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c7f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.561671:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.561682:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857791.561752:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857791.561756:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857791.561782:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.561805:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c7ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b5e expref: 93 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.561858:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b5e expref: 92 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.561868:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:3.0:1787857791.561871:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857791.561883:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857791.562077:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:28767:x1874704171685504:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 639us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857791.562085:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1085 00000100:00100000:0.0:1787857791.570436:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857791.570522:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171685632 00000100:00100000:1.0:1787857791.570532:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171685632 00000100:00100000:1.0:1787857791.570605:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1086 00000100:00100000:1.0:1787857791.570616:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+92:28767:x1874704171685632:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:1.0:1787857791.570637:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857791.570658:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c7fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b65 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.570770:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.570797:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.570810:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.570857:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.570865:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.570872:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571081:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571090:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571098:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857791.571138:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 512 00000004:00200000:1.0:1787857791.571141:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857791.571164:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571177:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571185:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571192:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571197:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857791.571202:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571209:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571220:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:1.0:1787857791.571229:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857791.571236:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571243:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571266:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571272:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571277:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571282:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857791.571285:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571291:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571299:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff9997c3cb1400) 00010000:00010000:1.0:1787857791.571302:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857791.571305:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571311:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7c80b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571343:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7c7fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b65 expref: 94 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571369:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b65 expref: 93 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857791.571378:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9997c3cb1f00) 00010000:00010000:1.0:1787857791.571380:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857791.571382:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053a00, rc 0) 00000100:00100000:1.0:1787857791.571446:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+93:28767:x1874704171685632:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 832us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857791.571453:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1086 00000100:00100000:2.0:1787857791.661126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857791.661312:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171685760 00000100:00100000:0.0:1787857791.661322:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171685760 00000100:00100000:0.0:1787857791.661424:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1087 00000100:00100000:0.0:1787857791.661436:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+41:28773:x1874704171685760:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857791.661457:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857791.661478:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b6c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.661544:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.661559:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.661571:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857791.661637:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787857791.661641:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857791.661666:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.661691:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7c819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.661707:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.661715:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:0.0:1787857791.661718:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857791.661722:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71c00, rc 0) 00000100:00100000:0.0:1787857791.661787:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28773:x1874704171685760:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 353us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857791.661795:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1087 00000100:00100000:0.0:1787857791.668002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.668121:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171686016 00000100:00100000:3.0:1787857791.668130:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171686016 00000100:00100000:3.0:1787857791.668190:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1088 00000100:00100000:3.0:1787857791.668199:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:28773:x1874704171686016:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857791.668218:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857791.668221:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787857791.668257:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c812 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b65 expref: 93 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.668277:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9997c3cb1f00) 00010000:00010000:3.0:1787857791.668287:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857791.668302:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c827 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b73 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.668437:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.668451:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.668460:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.668471:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.668489:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.668497:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.669780:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.669797:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.669806:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857791.669885:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00010000:00010000:3.0:1787857791.669912:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.669919:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.669926:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.669932:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857791.669936:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.669943:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.670035:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9998d5316900) 00010000:00010000:3.0:1787857791.670038:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857791.670043:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.670049:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c82e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857791.670063:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5188942 reply state 0000000050d8bf82 transno 4294968005 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857791.670071:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857791.670104:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c827 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 95 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.670121:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.670128:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316b00) 00010000:00010000:3.0:1787857791.670131:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857791.670133:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72800, rc 0) 00000100:00100000:3.0:1787857791.670266:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+95:28773:x1874704171686016:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2067us (2274us total) trans 4294968005 rc 0/0 00000100:00100000:3.0:1787857791.670275:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1088 00000100:00100000:2.0:1787857791.674686:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857791.674725:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171686272 00000100:00100000:2.0:1787857791.674735:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171686272 00000100:00100000:2.0:1787857791.674792:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1089 00000100:00100000:2.0:1787857791.674801:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:28773:x1874704171686272:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857791.674849:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857791.674871:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c84a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b7a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.674984:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.674999:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 96 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.675020:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.675053:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 96 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.675066:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 96 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857791.675079:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188249856:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857791.675158:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b7fe40 going to sleep for 11 seconds 00010000:00010000:3.0:1787857791.675573:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.675583:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.675598:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.675605:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857791.675609:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.675618:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.675635:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff9998d5316c00) 00010000:00010000:3.0:1787857791.675638:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857791.675643:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.675651:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c835 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857791.679598:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188249856:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857791.679629:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857791.679808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857791.680034:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171686400 00000100:00100000:0.0:1787857791.680041:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171686400 00010000:00010000:0.0:1787857791.680081:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 96 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857791.680121:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 329 00000100:00100000:0.0:1787857791.680131:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+96:2349:x1874704171686400:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857791.680144:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857791.680150:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 96 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.680161:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 96 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.680183:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7c83c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b73 expref: 96 pid: 5857 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.680198:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316b00) 00010000:00010000:0.0:1787857791.680203:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.680224:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.680232:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.680271:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857791.680320:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+95:2349:x1874704171686400:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 191us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857791.680328:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 329 00010000:00010000:2.0:1787857791.680528:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680536:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857791.680564:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00010000:00010000:2.0:1787857791.680857:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680866:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680873:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680879:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857791.680890:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680897:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680907:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316b00) 00010000:00010000:2.0:1787857791.680909:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857791.680913:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680919:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c851 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680983:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c84a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b7a expref: 95 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.680994:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9998e18d9500) 00010000:00010000:2.0:1787857791.680996:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857791.680999:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c84a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b7a expref: 95 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.681013:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857791.681047:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+94:28773:x1874704171686272:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6246us (6372us total) trans 4294968006 rc 301/301 00000100:00100000:2.0:1787857791.681053:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1089 00000100:00100000:0.0:1787857791.685330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.685404:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171686656 00000100:00100000:3.0:1787857791.685415:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171686656 00000100:00100000:3.0:1787857791.685476:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 216 00000100:00100000:3.0:1787857791.685487:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6121850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+94:28773:x1874704171686656:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857791.685882:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6121850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+95:28773:x1874704171686656:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 396us (562us total) trans 4294968007 rc 0/0 00000100:00100000:3.0:1787857791.685901:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 216 00000100:00100000:0.0:1787857791.692779:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857791.693094:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171686784 00000100:00100000:2.0:1787857791.693106:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171686784 00000100:00100000:2.0:1787857791.693168:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1090 00000100:00100000:2.0:1787857791.693179:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+95:28773:x1874704171686784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857791.693219:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857791.693243:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c85f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b81 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.693320:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c85f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b81 expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.693336:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c85f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b81 expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.693357:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998e18d9500) 00010000:00010000:2.0:1787857791.693360:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857791.693364:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857791.693434:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+96:28773:x1874704171686784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 258us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857791.693442:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1090 00000100:00100000:2.0:1787857791.705532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.705615:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171687040 00000100:00100000:3.0:1787857791.705624:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171687040 00000100:00100000:3.0:1787857791.705681:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1091 00000100:00100000:3.0:1787857791.705690:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+96:28773:x1874704171687040:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787857791.705756:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.705773:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.705785:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.706045:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.706053:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.706060:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.706066:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857791.706070:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.706077:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.706103:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998e18d9500) 00010000:00010000:3.0:1787857791.706106:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787857791.706111:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.706118:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c866 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857791.706183:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:28773:x1874704171687040:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 492us (662us total) trans 4294968008 rc 0/0 00000100:00100000:3.0:1787857791.706190:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1091 00010000:00010000:0.0:1787857791.726044:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857791.726309:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857791.726317:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857791.727006:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787857791.727019:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857791.729864:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.729953:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171687296 00000100:00100000:3.0:1787857791.729963:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171687296 00000100:00100000:3.0:1787857791.730028:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1092 00000100:00100000:3.0:1787857791.730039:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+97:28773:x1874704171687296:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857791.730358:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.730375:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.730388:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857791.730461:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968009 00000004:00010000:3.0:1787857791.730514:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000552a23cd reply state 0000000071ce0ab2 transno 4294968010 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857791.730524:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857791.733793:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:28773:x1874704171687296:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 3743us (3926us total) trans 4294968010 rc 0/0 00000100:00100000:3.0:1787857791.733807:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1092 00000020:00080000:3.0:1787857791.733830:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787857791.746124:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:0.0:1787857791.746776:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.746790:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.746799:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.746805:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857791.746810:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.746832:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.746849:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998e18d9500) 00010000:00010000:0.0:1787857791.746851:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787857791.746857:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857791.746864:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7c86d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857791.747929:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171687552 00000100:00100000:3.0:1787857791.747941:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171687552 00000100:00100000:3.0:1787857791.751346:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 217 00000100:00100000:3.0:1787857791.751368:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+99:28773:x1874704171687552:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857791.751626:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:28773:x1874704171687552:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 265us (5511us total) trans 4294968011 rc 0/0 00000100:00100000:3.0:1787857791.751635:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 217 00000100:00100000:0.0:1787857791.913928:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857791.917516:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171687680 00000100:00100000:2.0:1787857791.917535:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171687680 00000100:00100000:2.0:1787857791.917623:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1093 00000100:00100000:2.0:1787857791.917638:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+100:28779:x1874704171687680:12345-192.168.204.36@tcp:101:cmp.0 00010000:00010000:2.0:1787857791.917665:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857791.917688:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b88 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.917757:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.917792:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.917804:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.917854:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.917862:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.917869:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918008:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918016:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918023:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857791.918055:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 512 00000004:00200000:2.0:1787857791.918059:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857791.918086:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918099:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918116:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918124:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918130:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857791.918134:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918142:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918154:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:2.0:1787857791.918157:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857791.918162:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918167:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c87b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918181:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918187:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918194:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918198:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857791.918207:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918214:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918223:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff9998d8797f00) 00010000:00010000:2.0:1787857791.918225:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857791.918228:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918233:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c882 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918275:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b88 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918290:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74c00/0xd3f183cab4a7c889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b88 expref: 101 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.918298:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9998dab97500) 00010000:00010000:2.0:1787857791.918300:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857791.918303:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74c00, rc 0) 00000100:00100000:2.0:1787857791.918630:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+101:28779:x1874704171687680:12345-192.168.204.36@tcp:101:cmp.0 Request processed in 995us (4710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857791.918639:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1093 00000100:00100000:0.0:1787857791.940335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857791.940446:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171687936 00000100:00100000:2.0:1787857791.940456:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171687936 00000100:00100000:2.0:1787857791.940518:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1094 00000100:00100000:2.0:1787857791.940529:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+101:28779:x1874704171687936:12345-192.168.204.36@tcp:101:cmp.0 00010000:00010000:2.0:1787857791.940565:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857791.940587:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c890 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b8f expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940661:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940675:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940696:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940712:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940719:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940726:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940883:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940892:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.940899:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857791.940908:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:2.0:1787857791.941019:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941028:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941034:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941040:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857791.941043:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941050:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941062:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9998dab97500) 00010000:00010000:2.0:1787857791.941065:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857791.941069:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941075:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7c897 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941088:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941095:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941101:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941115:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857791.941119:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941125:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941133:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff9998dab97200) 00010000:00010000:2.0:1787857791.941136:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857791.941139:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941145:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c89e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941198:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7c890 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b8f expref: 104 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941211:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b8f expref: 103 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.941219:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998e18d9500) 00010000:00010000:2.0:1787857791.941221:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857791.941223:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75200, rc 0) 00000100:00100000:2.0:1787857791.941302:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+103:28779:x1874704171687936:12345-192.168.204.36@tcp:101:cmp.0 Request processed in 775us (977us total) trans 4294968012 rc 0/0 00000100:00100000:2.0:1787857791.941310:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1094 00000100:00100000:0.0:1787857791.962275:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.962418:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171688192 00000100:00100000:3.0:1787857791.962427:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171688192 00000100:00100000:3.0:1787857791.962495:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:3.0:1787857791.962505:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+103:28779:x1874704171688192:12345-192.168.204.36@tcp:103:cmp.0 00010000:00010000:3.0:1787857791.962521:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787857791.962559:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7c8a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b8f expref: 103 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.962582:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7c85f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b81 expref: 102 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.962594:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998e18d9500) 00010000:00010000:3.0:1787857791.962612:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857791.962666:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+101:28779:x1874704171688192:12345-192.168.204.36@tcp:103:cmp.0 Request processed in 162us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857791.962674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:0.0:1787857791.979907:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857791.985336:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171688320 00000100:00100000:3.0:1787857791.985356:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171688320 00000100:00100000:3.0:1787857791.985450:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1095 00000100:00100000:3.0:1787857791.985462:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+101:28779:x1874704171688320:12345-192.168.204.36@tcp:58:cmp.0 00010000:00010000:3.0:1787857791.985580:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.985598:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857791.985610:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857791.986049:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].30, 136 off12272 00000100:00100000:3.0:1787857791.986177:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+101:28779:x1874704171688320:12345-192.168.204.36@tcp:58:cmp.0 Request processed in 717us (6283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857791.986186:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1095 00000100:00100000:0.0:1787857791.990992:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857791.991140:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171688448 00000100:00100000:2.0:1787857791.991176:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171688448 00000100:00100000:2.0:1787857791.991254:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1096 00000100:00100000:2.0:1787857791.991264:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+101:28779:x1874704171688448:12345-192.168.204.36@tcp:101:cmp.0 00010000:00010000:2.0:1787857791.991284:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857791.991305:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b96 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.991374:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.991386:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 4/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.991407:0:19301:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.991421:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 3/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.991435:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:2.0:1787857791.991438:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857791.991443:0:19301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 3/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857791.991451:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74a00, rc 0) 00000100:00100000:2.0:1787857791.991505:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+102:28779:x1874704171688448:12345-192.168.204.36@tcp:101:cmp.0 Request processed in 243us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857791.991512:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1096 00010000:00010000:3.0:1787857792.750719:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857792.751136:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857792.751143:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857792.751268:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 31 count 4 00000040:00080000:1.0:1787857792.751277:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857792.751729:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188249984:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857792.752025:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b84900 going to sleep for 11 seconds 00000100:00100000:1.0:1787857792.758007:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188249984:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857792.761451:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857792.761883:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171688576 00000100:00100000:3.0:1787857792.761893:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171688576 00000100:00100000:3.0:1787857792.761967:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1097 00000100:00100000:3.0:1787857792.761979:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28780:x1874704171688576:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857792.762012:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x44:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857792.762128:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28780:x1874704171688576:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 152us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857792.762147:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1097 00000100:00100000:0.0:1787857792.767736:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857792.767848:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171688704 00000100:00100000:3.0:1787857792.767858:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171688704 00000100:00100000:3.0:1787857792.768106:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1098 00000100:00100000:3.0:1787857792.768119:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28780:x1874704171688704:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857792.768213:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768241:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768254:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768278:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768285:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768291:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768312:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768319:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768325:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857792.768375:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00000004:00200000:3.0:1787857792.768379:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857792.768391:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768402:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768408:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768414:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768419:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857792.768423:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768430:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768440:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857792.768443:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857792.768447:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768453:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7c8c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768465:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768481:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768487:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768491:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857792.768494:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768501:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768509:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8b3c9e9 (ffff9998d5316b00) 00010000:00010000:3.0:1787857792.768512:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857792.768514:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768525:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768539:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768545:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768551:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768556:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857792.768565:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768571:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768578:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:3.0:1787857792.768580:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857792.768583:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.768589:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857792.768674:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28780:x1874704171688704:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 557us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857792.768683:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1098 00000100:00100000:0.0:1787857792.777422:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857792.777714:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171688960 00000100:00100000:3.0:1787857792.777724:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171688960 00000100:00100000:3.0:1787857792.777790:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1099 00000100:00100000:3.0:1787857792.777801:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:28780:x1874704171688960:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857792.777852:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857792.777874:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3b9d expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.777983:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778001:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778027:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857792.778040:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:3.0:1787857792.778155:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778164:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778171:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778178:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857792.778183:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778192:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778206:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:3.0:1787857792.778210:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857792.778214:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778221:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7c8dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778462:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8d6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b9d expref: 44 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778485:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857792.778488:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857792.778493:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c8d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b9d expref: 44 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.778733:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:0.0:1787857792.780358:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28780:x1874704171688960:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2550us (2937us total) trans 4294968013 rc 301/301 00000100:00100000:0.0:1787857792.780371:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1099 00000100:00100000:0.0:1787857792.785332:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857792.786628:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171689088 00000100:00100000:3.0:1787857792.786641:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171689088 00000100:00100000:3.0:1787857792.786710:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1100 00000100:00100000:3.0:1787857792.786721:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28780:x1874704171689088:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857792.786758:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x44:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857792.786967:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28780:x1874704171689088:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 248us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857792.786976:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1100 00000100:00100000:0.0:1787857792.806611:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857792.806781:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171689216 00000100:00100000:2.0:1787857792.806790:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171689216 00000100:00100000:2.0:1787857792.806867:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1101 00000100:00100000:2.0:1787857792.806877:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28780:x1874704171689216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857792.806896:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857792.806917:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c8eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ba4 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807009:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807025:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807037:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807052:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807059:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807066:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807185:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807194:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807212:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857792.807520:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 512 00000004:00200000:2.0:1787857792.807524:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857792.807552:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807565:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807571:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807578:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807584:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857792.807587:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807594:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807605:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:2.0:1787857792.807608:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857792.807612:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807619:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7c8f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807643:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807650:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807655:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807659:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857792.807662:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807667:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807675:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff9998dab97e00) 00010000:00010000:2.0:1787857792.807677:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857792.807679:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807684:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c8f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807713:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c8eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ba4 expref: 45 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807726:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75a00/0xd3f183cab4a7c900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ba4 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.807745:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9998dab97500) 00010000:00010000:2.0:1787857792.807747:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857792.807749:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75a00, rc 0) 00000100:00100000:2.0:1787857792.809276:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28780:x1874704171689216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2391us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857792.809287:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1101 00000100:00100000:1.0:1787857792.821268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857792.821345:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171689472 00000100:00100000:2.0:1787857792.821355:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171689472 00000100:00100000:2.0:1787857792.821408:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1102 00000100:00100000:2.0:1787857792.821417:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:28780:x1874704171689472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857792.821437:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857792.821457:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c907 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bab expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857792.822252:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:2.0:1787857792.822520:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c90e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.822536:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.822548:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.822599:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c907 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bab expref: 47 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.822632:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c90e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bab expref: 46 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.822641:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97f00) 00010000:00010000:2.0:1787857792.822644:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857792.822647:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74e00, rc 0) 00000100:00100000:2.0:1787857792.822698:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28780:x1874704171689472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1283us (1441us total) trans 4294968014 rc 0/0 00000100:00100000:2.0:1787857792.822706:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1102 00000100:00100000:0.0:1787857792.837024:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857792.839097:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171689728 00000100:00100000:1.0:1787857792.839112:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171689728 00000100:00100000:1.0:1787857792.839183:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1103 00000100:00100000:1.0:1787857792.839195:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28780:x1874704171689728:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857792.839267:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857792.839389:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7c90e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bab expref: 46 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839421:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97f00) 00010000:00010000:1.0:1787857792.839432:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857792.839455:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839469:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839478:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839492:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839498:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839504:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839654:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839663:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839670:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839677:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857792.839682:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839697:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839707:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9998dab97500) 00010000:00010000:1.0:1787857792.839710:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857792.839714:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839720:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c91c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839731:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839737:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839743:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839749:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857792.839752:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839758:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839766:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0xe7b15650 (ffff9997c3cb1a00) 00010000:00010000:1.0:1787857792.839768:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857792.839771:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.839782:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c923 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0xe7b15650 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857792.840000:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28780:x1874704171689728:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 805us (2983us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857792.840008:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1103 00000100:00100000:0.0:1787857792.845385:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857792.845454:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171689856 00000100:00100000:2.0:1787857792.845465:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171689856 00000100:00100000:2.0:1787857792.845550:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1104 00000100:00100000:2.0:1787857792.845559:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28780:x1874704171689856:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857792.845579:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857792.845600:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c92a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bb2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.845636:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.845649:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.845660:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.845744:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7c92a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.845767:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.845776:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:2.0:1787857792.845779:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857792.845782:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75600, rc 0) 00000100:00100000:2.0:1787857792.845874:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28780:x1874704171689856:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 316us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857792.845881:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1104 00000100:00100000:0.0:1787857792.849385:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857792.849456:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171690112 00000100:00100000:2.0:1787857792.849466:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171690112 00000100:00100000:2.0:1787857792.849520:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1105 00000100:00100000:2.0:1787857792.849529:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28780:x1874704171690112:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857792.849624:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.849643:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857792.849655:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857792.850741:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 88 off9248 00000004:00080000:2.0:1787857792.850758:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 616900940352ns, next at 617900937147ns, rc = 0 00000004:00010000:2.0:1787857792.852056:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082f0f86c reply state 00000000d25593ae transno 4294968015 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857792.852090:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857792.853403:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28780:x1874704171690112:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 3866us (4021us total) trans 4294968015 rc 0/0 00000100:00100000:2.0:1787857792.853417:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1105 00010000:00010000:3.0:1787857792.857640:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.857661:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.857669:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.857675:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857792.857680:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.857699:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.857722:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:3.0:1787857792.857727:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857792.857732:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.857739:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7c938 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857792.859430:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857792.859501:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171690240 00000100:00100000:3.0:1787857792.859511:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171690240 00000100:00100000:3.0:1787857792.859566:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1106 00000100:00100000:3.0:1787857792.859576:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28780:x1874704171690240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857792.859602:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857792.859627:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bb9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.859693:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.859709:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.859730:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:3.0:1787857792.859733:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857792.859736:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:3.0:1787857792.859857:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28780:x1874704171690240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 282us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857792.859865:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1106 00000100:00100000:1.0:1787857792.862561:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857792.862937:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171690368 00000100:00100000:3.0:1787857792.862948:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171690368 00000100:00100000:3.0:1787857792.863026:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 289 00000100:00100000:3.0:1787857792.863037:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171690368:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787857792.863290:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857792.863436:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171690368:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 401us (884us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1787857792.863445:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 289 00000100:00100000:2.0:1787857792.876564:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857792.876669:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171690624 00000100:00100000:1.0:1787857792.876679:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171690624 00000100:00100000:1.0:1787857792.876742:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:1.0:1787857792.876754:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:28780:x1874704171690624:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857792.877168:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28780:x1874704171690624:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 415us (612us total) trans 4294968016 rc 0/0 00000100:00100000:1.0:1787857792.877176:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:1.0:1787857792.884215:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857792.884332:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171690880 00000100:00100000:2.0:1787857792.884343:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171690880 00000100:00100000:2.0:1787857792.884442:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1107 00000100:00100000:2.0:1787857792.884454:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28780:x1874704171690880:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857792.884642:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28780:x1874704171690880:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 190us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857792.884649:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1107 00000100:00100000:0.0:1787857792.887909:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857792.888089:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171691008 00000100:00100000:1.0:1787857792.888100:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171691008 00000100:00100000:1.0:1787857792.888164:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1108 00000100:00100000:1.0:1787857792.888420:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28780:x1874704171691008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857792.888443:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857792.888466:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c946 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bc0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.888553:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c94d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.888580:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c94d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.888594:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c94d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857792.888633:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857792.888653:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c94d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.888681:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c946 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc0 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.888697:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c94d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc0 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857792.888705:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:1.0:1787857792.888708:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787857792.888712:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053200, rc 0) 00000100:00100000:1.0:1787857792.888774:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:28780:x1874704171691008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 601us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857792.888781:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1108 00000100:00100000:3.0:1787857792.895088:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857792.895217:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171691136 00000100:00100000:0.0:1787857792.895236:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171691136 00000100:00100000:0.0:1787857792.895292:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 290 00000100:00100000:0.0:1787857792.895302:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171691136:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857792.895320:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857792.895342:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bc7 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857792.895371:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908b80, blocks: 0x1 00010000:00010000:0.0:1787857792.895394:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=616s v=(0 0) 00010000:00010000:0.0:1787857792.895400:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857792.895411:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857792.895436:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 12 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857792.895450:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:0.0:1787857792.895574:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171691136:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 273us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857792.895582:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 290 00000100:00100000:1.0:1787857792.900675:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857792.901382:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171691392 00000100:00100000:0.0:1787857792.901394:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171691392 00000100:00100000:0.0:1787857792.901465:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1109 00000100:00100000:0.0:1787857792.901477:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:28780:x1874704171691392:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857792.901697:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:28780:x1874704171691392:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 222us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857792.901705:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1109 00000100:00100000:2.0:1787857792.908132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857792.908429:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171691520 00000100:00100000:0.0:1787857792.908438:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171691520 00000100:00100000:0.0:1787857792.908495:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 291 00000100:00100000:0.0:1787857792.908505:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:28780:x1874704171691520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857792.908589:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857792.908610:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bce expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857792.908642:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857792.908658:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857792.908663:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857792.908669:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 13 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857792.908701:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857792.908714:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 13 pid: 6711 timeout: 716 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857792.908741:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188250112:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857792.908861:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f73cfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857792.915252:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857792.915293:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171691648 00000100:00100000:3.0:1787857792.915299:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171691648 00010000:00010000:3.0:1787857792.915339:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 14 pid: 6711 timeout: 716 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857792.915346:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188250112:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857792.915377:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 330 00010000:00010000:0.0:1787857792.915380:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 14 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857792.915386:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171691648:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857792.915399:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71e00, rc 0) 00010000:00010000:3.0:1787857792.915400:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857792.915421:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 14 pid: 6711 timeout: 716 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.915433:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 14 pid: 6711 timeout: 716 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857792.915454:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:28780:x1874704171691520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6951us (7333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857792.915461:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 291 00010000:00010000:3.0:1787857792.915470:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f49a050d/0xd3f183cab4a7c954 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc7 expref: 14 pid: 6711 timeout: 716 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.915484:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857792.915488:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857792.915496:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.915506:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857792.915539:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857792.915554:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8468:1874704188250240:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857792.915622:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857792.919395:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8468:1874704188250240:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857792.919426:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857792.920253:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171691648:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 4862us (4999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857792.920267:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 330 00000100:00100000:0.0:1787857792.927677:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857792.928018:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171691776 00000100:00100000:3.0:1787857792.928028:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171691776 00002000:00100000:3.0:1787857792.928087:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x18:0x0] (0->157) req@ffff999901453480 x1874704171691776/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:438/0 lens 648/0 e 0 to 0 dl 1787857803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857792.928098:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901453480 with x1874704171691776 ext(0->157) 00002000:00010000:3.0:1787857792.928104:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999901453480 00000100:00100000:3.0:1787857792.928671:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 99 00000100:00100000:3.0:1787857792.928684:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171691776:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787857792.931910:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171691776:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 3215us (4232us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1787857792.931930:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 99 00002000:00100000:3.0:1787857792.935210:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x18:0x0] (0->157) req@ffff999901453480 x1874704171691776/t4294967361(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:438/0 lens 648/448 e 0 to 0 dl 1787857803 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857792.938650:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901453480 with x1874704171691776 ext(0->157) 00002000:00010000:3.0:1787857792.938661:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999901453480 00000100:00100000:2.0:1787857792.940261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857792.940429:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171691904 00000100:00100000:0.0:1787857792.940440:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171691904 00000100:00100000:0.0:1787857792.940505:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1110 00000100:00100000:0.0:1787857792.940516:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:28780:x1874704171691904:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787857793.031909:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968016 is committed 00000004:00080000:2.0:1787857793.031936:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000001:00080000:2.0:1787857793.031960:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968012 is committed 00000020:00080000:2.0:1787857793.031970:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 20 batchid updated 00000020:00080000:2.0:1787857793.032080:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00000020:00080000:2.0:1787857793.032092:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00000100:00100000:2.0:1787857793.032162:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188250368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787857793.032372:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857793.032614:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188250368 00000100:00100000:0.0:1787857793.032624:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188250368 00000100:00100000:1.0:1787857793.032679:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28780:x1874704171691904:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 92161us (92423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857793.032689:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1110 00000100:00100000:0.0:1787857793.032694:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787857793.032703:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188250368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787857793.032911:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787857793.032916:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1787857792 00002000:00010000:0.0:1787857793.032931:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787857793.032933:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 1787857792 -> 1787857792 00002000:00010000:0.0:1787857793.033011:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787857793.033063:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188250368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 361us (691us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787857793.033070:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000004:00080000:0.0:1787857793.033123:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999901450b40/2, rc 0, transno 4294967362 00000100:00100000:0.0:1787857793.033129:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188250368:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1787857793.033263:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857793.038089:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857793.038228:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171692032 00000100:00100000:0.0:1787857793.038239:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171692032 00000100:00100000:0.0:1787857793.038391:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 293 00000100:00100000:0.0:1787857793.038402:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171692032:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787857793.071796:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171692032:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 33384us (33706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857793.071810:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 293 00000001:00080000:3.0:1787857793.071977:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000001:00080000:3.0:1787857793.071989:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967361 is committed 00000100:00100000:1.0:1787857793.076096:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857793.076462:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171692288 00000100:00100000:3.0:1787857793.076472:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171692288 00000100:00100000:0.0:1787857793.076592:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1111 00000100:00100000:0.0:1787857793.076605:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28780:x1874704171692288:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857793.076669:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857793.076701:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7c94d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bc0 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.076721:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00000100:00080000:2.0:1787857793.076784:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857793.076898:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857793.077052:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.077069:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.077079:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857793.077442:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f8353de reply state 000000008a41ffba transno 4294968017 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857793.077452:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857793.077563:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:28780:x1874704171692288:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 960us (1477us total) trans 4294968017 rc 0/0 00000100:00100000:0.0:1787857793.077571:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1111 00010000:00010000:0.0:1787857793.086268:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.086287:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.086296:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.086305:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857793.086310:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.086318:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.086336:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:0.0:1787857793.086340:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857793.086346:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.086352:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7c962 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.087116:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857793.087389:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171692416 00000100:00100000:0.0:1787857793.087399:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171692416 00000100:00100000:0.0:1787857793.087493:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 294 00000100:00100000:0.0:1787857793.087504:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171692416:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787857793.087804:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:0.0:1787857793.087808:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 1787857792 -> 1536580263 00002000:00010000:0.0:1787857793.087811:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb atime from disk: 0 -> 1787857200 00002000:00010000:0.0:1787857793.087813:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 1787857792 -> 1787857791 00002000:00010000:0.0:1787857793.087844:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787857793.087908:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171692416:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 405us (797us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787857793.087917:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 294 00000100:00100000:3.0:1787857793.093413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857793.094486:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171692672 00000100:00100000:1.0:1787857793.094498:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171692672 00000100:00100000:1.0:1787857793.094693:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1112 00000100:00100000:1.0:1787857793.094704:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:28780:x1874704171692672:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787857793.094780:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.094802:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.094812:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.094894:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.094909:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 46 pid: 5857 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.094939:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188250496:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857793.095056:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c12ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857793.102795:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188250496:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857793.102840:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857793.107417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857793.107480:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171692800 00000100:00100000:1.0:1787857793.107491:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171692800 00010000:00010000:1.0:1787857793.107534:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 47 pid: 5857 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.107572:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 331 00000100:00100000:1.0:1787857793.107583:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171692800:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857793.107625:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857793.107633:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 47 pid: 5857 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.107648:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 47 pid: 5857 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.107673:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7c931 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb2 expref: 47 pid: 5857 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.107690:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:1.0:1787857793.107695:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.107704:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.107713:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.107752:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857793.107839:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2350:x1874704171692800:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 257us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857793.107847:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 331 00010000:00010000:2.0:1787857793.107988:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.107998:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.108028:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.108035:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.108041:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.108047:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857793.108052:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.108059:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.108082:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:2.0:1787857793.108085:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787857793.108089:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.108095:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7c969 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857793.108136:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28780:x1874704171692672:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 13434us (14733us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787857793.108145:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1112 00000100:00100000:2.0:1787857793.121380:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857793.121481:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171692928 00000100:00100000:3.0:1787857793.121492:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171692928 00000100:00100000:3.0:1787857793.121593:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 295 00000100:00100000:3.0:1787857793.121604:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171692928:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857793.121670:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.121695:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.121704:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x18:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857793.121708:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857793.121713:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.121776:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.125796:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 12 pid: 8490 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857793.126749:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188250624:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857793.126953:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857793.132738:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857793.132894:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188250624:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857793.132923:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857793.133013:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171693056 00000100:00100000:2.0:1787857793.133020:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171693056 00010000:00010000:2.0:1787857793.140101:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 13 pid: 8490 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857793.140187:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 332 00000100:00100000:2.0:1787857793.140206:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171693056:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857793.140232:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857793.140258:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 13 pid: 8490 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.140274:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 13 pid: 8490 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.140377:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7c95b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bce expref: 13 pid: 8490 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.140393:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857793.140398:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857793.140403:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.140414:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.140445:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857793.140510:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171693056:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 313us (7792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857793.140519:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 332 00010000:00010000:0.0:1787857793.140645:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.140657:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.140750:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.140760:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.140768:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.140776:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857793.140780:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.140790:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.140803:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.140810:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b3fcbca/0xd3f183cab4a7c970 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857793.140881:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171692928:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 19279us (19516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857793.140890:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 295 00000100:00100000:3.0:1787857793.148341:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857793.148499:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171693312 00000100:00100000:1.0:1787857793.148508:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171693312 00000100:00100000:1.0:1787857793.148631:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1113 00000100:00100000:1.0:1787857793.148643:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:28780:x1874704171693312:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787857793.148865:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.148883:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.148897:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.152561:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.152590:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.152599:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.152657:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.152685:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 46 pid: 5856 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857793.152700:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188250752:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857793.152840:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ced80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857793.159130:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188250752:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857793.159163:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857793.159960:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857793.161936:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171693440 00000100:00100000:2.0:1787857793.161953:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171693440 00010000:00010000:2.0:1787857793.162006:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 47 pid: 5856 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857793.162060:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 333 00000100:00100000:2.0:1787857793.162072:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171693440:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857793.162088:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857793.162096:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 47 pid: 5856 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.162112:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 47 pid: 5856 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.162136:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7c93f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bb9 expref: 47 pid: 5856 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.162184:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:2.0:1787857793.162190:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.162200:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.162380:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.162417:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857793.162489:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2350:x1874704171693440:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 419us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857793.162498:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 333 00010000:00010000:3.0:1787857793.162857:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.162868:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857793.163118:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968018 00000001:00080000:2.0:1787857793.163431:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968019 00000001:00080000:2.0:1787857793.163477:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968020 00000100:00100000:2.0:1787857793.163719:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874704188250880:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787857793.163901:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857793.163944:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857793.164215:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188250880 00000100:00100000:1.0:1787857793.164232:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188250880 00000100:00100000:1.0:1787857793.164277:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787857793.164286:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1874704188250880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787857793.164372:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1874704188250880:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857793.164379:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787857793.164622:0:5857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967362 gen 2 00000004:00080000:2.0:1787857793.164629:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999901450b40, transno 4294967362 00000100:00100000:2.0:1787857793.164650:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874704188250880:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787857793.166508:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968021 00000100:00100000:2.0:1787857793.166664:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6f840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874704188251008:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787857793.167158:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857793.167320:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188251008 00000100:00100000:1.0:1787857793.167328:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188251008 00000100:00100000:1.0:1787857793.167376:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787857793.167385:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1874704188251008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787857793.167614:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5857:x1874704188251008:12345-0@lo:1000:mdt00_001.0 Request processed in 229us (455us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787857793.167622:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787857793.167905:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14cef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857793.167971:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6f840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5857:1874704188251008:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787857793.168416:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168426:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168434:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168439:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857793.168443:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168450:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168465:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9998dab97d00) 00010000:00010000:2.0:1787857793.168468:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857793.168473:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168479:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7c97e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168524:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168532:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168538:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168553:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857793.168557:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168562:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168571:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:2.0:1787857793.168573:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857793.168580:0:5857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168592:0:5857:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168602:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.168643:0:5857:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857793.168657:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa85680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188251136:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857793.170091:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14cef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857793.176197:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa85680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188251136:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857793.176240:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176252:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7c8b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176287:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176311:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176322:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176332:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176338:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176345:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176351:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857793.176356:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176363:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176374:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857793.176377:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857793.176381:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176387:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c985 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176399:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176405:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176411:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176416:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857793.176419:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176425:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176433:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857793.176435:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857793.176439:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.176445:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c977 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857793.176939:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28780:x1874704171693312:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 28294us (28603us total) trans 4294968022 rc 0/0 00000100:00100000:0.0:1787857793.176955:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1113 00000020:00080000:0.0:1787857793.176964:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787857793.177739:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857793.177747:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857793.178045:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 31 count 3 00000040:00080000:1.0:1787857793.178053:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857793.180310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857793.181091:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171693696 00000100:00100000:0.0:1787857793.181105:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171693696 00000100:00100000:0.0:1787857793.181172:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 219 00000100:00100000:0.0:1787857793.181182:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:28780:x1874704171693696:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787857793.181936:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x1f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787857793.182071:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968023 00010000:00010000:0.0:1787857793.182122:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182140:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182153:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182161:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182168:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182175:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182198:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787857793.182322:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:28780:x1874704171693696:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1138us (2027us total) trans 4294968024 rc 0/0 00000100:00100000:0.0:1787857793.182331:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 219 00000020:00080000:0.0:1787857793.182336:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857793.182367:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857793.182373:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182380:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857793.182384:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182392:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182405:0:17404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:0.0:1787857793.182408:0:17404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857793.182412:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182417:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7c98c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.182434:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857793.182436:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857793.182437:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857793.189741:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857793.189844:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171693824 00000100:00100000:0.0:1787857793.189855:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171693824 00000100:00100000:0.0:1787857793.189930:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00100000:0.0:1787857793.189943:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+93:28779:x1874704171693824:12345-192.168.204.36@tcp:49:cmp.0 00000100:00100000:0.0:1787857793.190103:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+93:28779:x1874704171693824:12345-192.168.204.36@tcp:49:cmp.0 Request processed in 161us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857793.190111:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00080000:2.0:1787857793.190542:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857793.196046:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857793.196125:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171693952 00000100:00100000:2.0:1787857793.196134:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171693952 00000100:00100000:2.0:1787857793.196206:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 296 00000100:00100000:2.0:1787857793.196242:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+12:28779:x1874704171693952:12345-192.168.204.36@tcp:101:cmp.0 00010000:00010000:2.0:1787857793.196263:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857793.196287:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bd5 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857793.196324:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a908930, ctime: 0x6a908b7f, blocks: 0xb 00010000:00010000:2.0:1787857793.196346:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=617s v=(0 0) 00010000:00010000:2.0:1787857793.196351:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857793.196361:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.196377:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857793.196390:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74600, rc 0) 00000100:00100000:2.0:1787857793.196447:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+13:28779:x1874704171693952:12345-192.168.204.36@tcp:101:cmp.0 Request processed in 207us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857793.196455:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 296 00000100:00080000:0.0:1787857793.196880:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857793.211278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857793.211353:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171694080 00000100:00100000:2.0:1787857793.211363:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171694080 00002000:00100000:2.0:1787857793.211410:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff9999014512c0 x1874704171694080/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:439/0 lens 488/0 e 0 to 0 dl 1787857804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857793.211422:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9999014512c0 with x1874704171694080 ext(0->4095) 00002000:00010000:2.0:1787857793.211428:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9999014512c0 00000100:00100000:2.0:1787857793.211459:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 100 00000100:00100000:2.0:1787857793.211469:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171694080:12345-192.168.204.36@tcp:3:cmp.0 00000100:00100000:2.0:1787857793.211862:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171694080:12345-192.168.204.36@tcp:3:cmp.0 Request processed in 393us (592us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857793.211871:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 100 00002000:00100000:2.0:1787857793.211878:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff9999014512c0 x1874704171694080/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:439/0 lens 488/4536 e 0 to 0 dl 1787857804 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857793.211886:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9999014512c0 with x1874704171694080 ext(0->4095) 00002000:00010000:2.0:1787857793.211890:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9999014512c0 00000100:00100000:2.0:1787857793.233353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857793.234890:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171694336 00000100:00100000:3.0:1787857793.234905:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171694336 00000100:00100000:2.0:1787857793.237779:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 221 00000100:00100000:2.0:1787857793.237794:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+93:28779:x1874704171694336:12345-192.168.204.36@tcp:35:cmp.0 00000001:00080000:2.0:1787857793.238312:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968025 00000100:00100000:2.0:1787857793.238512:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:28779:x1874704171694336:12345-192.168.204.36@tcp:35:cmp.0 Request processed in 719us (5166us total) trans 4294968026 rc 0/0 00000100:00100000:2.0:1787857793.238521:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 221 00000020:00080000:2.0:1787857793.238526:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787857793.265521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857793.265607:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171694464 00000100:00100000:1.0:1787857793.265618:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171694464 00000100:00100000:1.0:1787857793.265678:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1114 00000100:00100000:1.0:1787857793.265689:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+95:28781:x1874704171694464:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857793.265714:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857793.265738:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c99a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bdc expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.265809:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.265846:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.265858:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.265874:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.265881:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.265887:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266419:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266430:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266449:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857793.266482:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00000004:00200000:1.0:1787857793.266487:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857793.266506:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266519:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266527:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266534:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266541:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266546:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857793.266550:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266558:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266569:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9998dab97500) 00010000:00010000:1.0:1787857793.266572:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857793.266577:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266593:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7c9a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266606:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266612:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266619:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266624:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857793.266627:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266633:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266641:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff9997c3cb1c00) 00010000:00010000:1.0:1787857793.266643:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857793.266646:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266651:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266685:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c99a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 97 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266710:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.266717:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:1.0:1787857793.266720:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857793.266722:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053c00, rc 0) 00000100:00100000:1.0:1787857793.266806:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:28781:x1874704171694464:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1118us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857793.266842:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1114 00000100:00100000:0.0:1787857793.274248:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857793.274359:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171694592 00000100:00100000:1.0:1787857793.274372:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171694592 00000100:00100000:1.0:1787857793.274434:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1115 00000100:00100000:1.0:1787857793.274446:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+96:28781:x1874704171694592:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857793.274473:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857793.274498:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c9b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3be3 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.274567:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c9bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.274582:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.274595:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857793.274860:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 7680 00000004:00200000:1.0:1787857793.274871:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857793.274967:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.275111:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c9b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3be3 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.275131:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052c00/0xd3f183cab4a7c9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3be3 expref: 97 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.275141:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9998dab97500) 00010000:00010000:1.0:1787857793.275144:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857793.275148:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052c00, rc 0) 00000100:00100000:1.0:1787857793.275212:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+97:28781:x1874704171694592:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 769us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857793.275239:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1115 00000100:00100000:2.0:1787857793.288357:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857793.288437:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171694848 00000100:00100000:3.0:1787857793.288447:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171694848 00000100:00100000:1.0:1787857793.288601:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1116 00000100:00100000:1.0:1787857793.288613:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+97:28781:x1874704171694848:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857793.288638:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857793.288660:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c9c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bea expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.288763:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c9cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.288778:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.288790:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857793.288833:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:1.0:1787857793.289110:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7c9c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bea expref: 100 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.289131:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c9cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bea expref: 99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.289140:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:1.0:1787857793.289143:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857793.289146:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:1.0:1787857793.289229:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+99:28781:x1874704171694848:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 607us (870us total) trans 4294968027 rc 0/0 00000100:00100000:1.0:1787857793.289237:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1116 00000100:00100000:2.0:1787857793.292392:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857793.292481:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171694976 00000100:00100000:1.0:1787857793.292491:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171694976 00000100:00100000:1.0:1787857793.292556:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00100000:1.0:1787857793.292565:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171694976:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:1.0:1787857793.292611:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.292636:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.292646:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857793.292650:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857793.292655:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.292708:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.292723:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 13 pid: 6711 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.292739:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188251264:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857793.292857:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b84e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857793.295113:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188251264:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857793.295147:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857793.307534:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857793.308093:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171695104 00000100:00100000:3.0:1787857793.308106:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171695104 00010000:00010000:3.0:1787857793.308155:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 14 pid: 6711 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857793.309103:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 334 00000100:00100000:3.0:1787857793.309118:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+14:2350:x1874704171695104:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857793.309135:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857793.309159:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 14 pid: 6711 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.309175:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 14 pid: 6711 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.309200:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7c993 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bd5 expref: 14 pid: 6711 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.309229:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857793.309234:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857793.309240:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.309251:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857793.309371:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857793.309445:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171695104:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 332us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857793.309454:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 334 00010000:00010000:1.0:1787857793.313076:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.313099:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.313139:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.313147:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.313156:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.313164:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857793.313181:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.313192:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.313212:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.313230:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7c9d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.313380:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171694976:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 20811us (20996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857793.313392:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00100000:2.0:1787857793.324653:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857793.324792:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171695360 00000100:00100000:1.0:1787857793.324802:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171695360 00000100:00100000:1.0:1787857793.324888:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 222 00000100:00100000:1.0:1787857793.324899:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6122050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+99:28781:x1874704171695360:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:1.0:1787857793.325087:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x44:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c9cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bea expref: 99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857793.325435:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968028 00000001:00080000:1.0:1787857793.328241:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968029 00010000:00010000:1.0:1787857793.328412:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.328441:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.328463:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 102 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.328472:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.328523:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 102 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.328541:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 102 pid: 7656 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.328558:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188251392:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857793.328857:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.328869:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.328879:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188251520:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857793.328901:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b7fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857793.339166:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188251392:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857793.339662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857793.339860:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171695488 00000100:00100000:1.0:1787857793.339867:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171695488 00010000:00010000:1.0:1787857793.339906:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 103 pid: 7656 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.339982:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 335 00000100:00100000:1.0:1787857793.339992:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+103:2350:x1874704171695488:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857793.340006:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857793.340013:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 103 pid: 7656 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.340027:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 103 pid: 7656 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.340054:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7c9af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bdc expref: 103 pid: 7656 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.340073:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:1.0:1787857793.340078:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.340087:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.340095:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857793.343387:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188251520:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857793.343425:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857793.343582:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+102:2350:x1874704171695488:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3587us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857793.343596:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 335 00000100:00100000:2.0:1787857793.350661:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857793.355188:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171695616 00000100:00100000:0.0:1787857793.355203:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171695616 00010000:00010000:0.0:1787857793.355261:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857793.355309:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 336 00000100:00100000:0.0:1787857793.355319:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+102:2350:x1874704171695616:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857793.355333:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857793.355340:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.355355:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.355383:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7c8ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b96 expref: 102 pid: 19301 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.355402:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857793.355407:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.355417:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.355424:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.355499:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857793.355572:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+101:2350:x1874704171695616:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 254us (4923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857793.355580:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 336 00010000:00010000:1.0:1787857793.357115:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857793.357132:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857793.357313:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968030 00000001:00080000:1.0:1787857793.357716:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968031 00000100:00100000:1.0:1787857793.357949:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188251648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857793.358155:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857793.358197:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9c5f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857793.358297:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188251648 00000100:00100000:3.0:1787857793.358304:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188251648 00000100:00100000:3.0:1787857793.358359:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787857793.358369:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1874704188251648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787857793.358456:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1874704188251648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857793.358463:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787857793.358505:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188251648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787857793.359201:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968032 00000100:00100000:3.0:1787857793.359279:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3043480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188251776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787857793.359453:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857793.359517:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4df9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857793.364406:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188251776 00000100:00100000:1.0:1787857793.364421:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188251776 00000100:00100000:1.0:1787857793.364528:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787857793.364539:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1874704188251776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857793.364866:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5860:x1874704188251776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 328us (5412us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787857793.364875:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787857793.364986:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3043480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188251776:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787857793.365073:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968033 00010000:00010000:0.0:1787857793.365109:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.365120:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.365127:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.365134:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857793.365139:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.365147:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.365163:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857793.365166:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787857793.365170:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857793.365175:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7c9e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857793.365395:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x45:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787857793.365490:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 64 off9312 00000001:00080000:0.0:1787857793.365503:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968034 00010000:00010000:0.0:1787857793.365537:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9998d5316300) 00010000:00010000:0.0:1787857793.365540:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787857793.365547:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7c9cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bea expref: 105 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857793.365656:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6122050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+104:28781:x1874704171695360:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 40759us (41013us total) trans 4294968035 rc 0/0 00000100:00100000:0.0:1787857793.365666:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 222 00000020:00080000:0.0:1787857793.365670:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00010000:00010000:3.0:1787857793.774106:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857793.903124:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857793.903148:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188251904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857793.904564:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857793.904770:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188251904 00000100:00100000:0.0:1787857793.904779:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188251904 00000100:00100000:0.0:1787857793.904894:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787857793.905369:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188251904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857793.905409:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857793.905472:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188251904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 570us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857793.905479:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1787857793.905523:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857793.909768:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188251904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857794.798178:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857795.158510:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857795.158549:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171695872 00000100:00100000:1.0:1787857795.158553:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857795.158558:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171695872 00000100:00100000:1.0:1787857795.158573:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857795.158606:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857795.158624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857795.158627:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 417 00000100:00100000:3.0:1787857795.158638:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+104:2347:x1874704171695872:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857795.158641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857795.158663:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857795.158684:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171696128 00000100:00100000:1.0:1787857795.158687:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171696128 00000100:00100000:1.0:1787857795.158725:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171696384 00000100:00100000:1.0:1787857795.158729:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171696384 00000100:00100000:1.0:1787857795.158743:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171696000 00000100:00100000:1.0:1787857795.158746:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171696000 00000100:00100000:3.0:1787857795.158759:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+104:2347:x1874704171695872:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 123us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857795.158759:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171696512 00000100:00100000:1.0:1787857795.158761:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171696512 00000100:00100000:3.0:1787857795.158767:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 417 00000100:00100000:3.0:1787857795.158781:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171696256 00000100:00100000:3.0:1787857795.158783:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171696256 00000100:00100000:1.0:1787857795.158783:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 414 00000100:00100000:1.0:1787857795.158789:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171696128:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857795.158812:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 418 00000100:00100000:3.0:1787857795.158838:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2347:x1874704171696256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857795.158845:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171696128:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 56us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857795.158851:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 414 00000100:00100000:1.0:1787857795.158864:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 415 00000100:00100000:3.0:1787857795.158865:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2347:x1874704171696256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857795.158870:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171696384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857795.158871:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 418 00000100:00080000:3.0:1787857795.158887:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857795.158891:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857795.158893:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857795.158903:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171695744 00000100:00100000:3.0:1787857795.158906:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171695744 00000100:00100000:1.0:1787857795.158908:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171696384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857795.158914:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 415 00000100:00100000:1.0:1787857795.158924:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 416 00000100:00100000:3.0:1787857795.158928:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 571 00000100:00100000:1.0:1787857795.158930:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171696000:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857795.158934:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171695744:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857795.158952:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171695744:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 19us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857795.158952:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171696000:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857795.158959:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 571 00000100:00100000:1.0:1787857795.158959:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 416 00000100:00100000:1.0:1787857795.158970:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 417 00000100:00100000:1.0:1787857795.158975:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171696512:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857795.159408:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171696512:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 429us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857795.159417:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 417 00000100:00100000:3.0:1787857795.445058:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188252032:0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.445133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857795.445208:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188252032 00000100:00100000:3.0:1787857795.445214:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188252032 00000100:00100000:3.0:1787857795.445255:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1787857795.445263:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188252032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.445308:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188252032:12345-0@lo:400:kworker.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857795.445315:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1787857795.445359:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188252032:0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.448682:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188252416:0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.448758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857795.449995:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188252288:0@lo:400:kworker.0 00000100:00100000:0.0:1787857795.450049:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857795.451647:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188252416 00000100:00100000:3.0:1787857795.451659:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188252416 00000100:00100000:3.0:1787857795.451723:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1787857795.451733:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188252416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.451839:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188252416:12345-0@lo:400:kworker.0 Request processed in 108us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857795.451848:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00080000:3.0:1787857795.451869:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857795.452110:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188252544:0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.452166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857795.452207:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787857795.452214:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188252160:0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.452236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857795.452251:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188252672:0@lo:400:kworker.0 00000100:00100000:0.0:1787857795.455333:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188252288 00000100:00100000:0.0:1787857795.455347:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188252288 00000100:00100000:0.0:1787857795.455413:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188252544 00000100:00100000:0.0:1787857795.455416:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188252544 00000100:00100000:0.0:1787857795.455433:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188252160 00000100:00100000:0.0:1787857795.455436:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188252160 00000100:00100000:0.0:1787857795.455452:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1787857795.455461:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188252288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857795.455556:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188252288:12345-0@lo:400:kworker.0 Request processed in 95us (5505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857795.455563:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1787857795.455584:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1787857795.455589:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188252544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857795.455618:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188252544:12345-0@lo:400:kworker.0 Request processed in 29us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857795.455624:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1787857795.455634:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787857795.455639:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188252160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857795.455667:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188252160:12345-0@lo:400:kworker.0 Request processed in 28us (3430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857795.455673:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00080000:0.0:1787857795.455693:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857795.455731:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188252288:0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.457401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857795.457480:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188252544:0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.457510:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188252160:0@lo:400:kworker.0 00000100:00100000:3.0:1787857795.457567:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188252416:0@lo:400:kworker.0 00000100:00100000:1.0:1787857795.457990:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188252672 00000100:00100000:1.0:1787857795.457998:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188252672 00000100:00100000:1.0:1787857795.461497:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1787857795.461521:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188252672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857795.461645:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188252672:12345-0@lo:400:kworker.0 Request processed in 135us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857795.461654:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1787857795.461784:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188252672:0@lo:400:kworker.0 00000100:00080000:0.0:1787857795.464269:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857795.822033:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857795.953603:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5bd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188252800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857795.953683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787857795.953784:0:7958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 620003966159ns, next at 621003963273ns, rc = 0 00000100:00100000:1.0:1787857795.954046:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188252800 00000100:00100000:1.0:1787857795.954055:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188252800 00000100:00100000:1.0:1787857795.954156:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787857795.954180:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874704188252800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857795.954216:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857795.954265:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874704188252800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857795.954274:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787857795.954572:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5bd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188252800:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857796.848039:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857797.871564:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857798.052410:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968035 is committed 00000001:00080000:1.0:1787857798.052432:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968024 is committed 00000020:00080000:1.0:1787857798.052473:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998d14ce3c0 refcount 2 committed 0 result 0 batchid 21 00000020:00080000:1.0:1787857798.052489:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c1e50800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998d14cecc0 00000020:00080000:1.0:1787857798.052492:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c1e50200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c51ef400 00000004:00080000:1.0:1787857798.052526:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000020:00080000:1.0:1787857798.052542:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998f70f86c0 refcount 2 committed 0 result 0 batchid 22 00000020:00080000:1.0:1787857798.052546:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f0ec4a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998f70f8a80 00000020:00080000:1.0:1787857798.052562:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f0ec4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c3439000 00000100:00100000:1.0:1787857798.052682:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857798.052703:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188252928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787857798.052774:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857798.052995:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188252928 00000100:00100000:1.0:1787857798.053003:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188252928 00000100:00100000:1.0:1787857798.053055:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787857798.053064:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1874704188252928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787857798.053142:0:6714:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00002000:00010000:1.0:1787857798.053174:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a908930, ctime: 0x6a908b7f, blocks: 0xb 00010000:00010000:1.0:1787857798.053183:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857798.053199:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1787857798.053203:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857798.053210:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857798.053225:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857798.053234:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857798.053241:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857798.053268:0:6714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1787857798.053577:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 22 committed batchid 20 00000020:00080000:3.0:1787857798.053727:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00010000:00010000:3.0:1787857798.053749:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857798.053756:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857798.053776:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857798.053781:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857798.053791:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857798.053811:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857798.053847:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7c9e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857798.053866:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857798.053868:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857798.053869:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857798.054279:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3302:x1874704188252928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1214us (1503us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787857798.054288:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:0.0:1787857798.054417:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787857798.054762:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c5c6c000/2, rc 0, transno 4294967366 00000100:00100000:3.0:1787857798.054771:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188252928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787857798.344653:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857798.344766:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171696640 00000100:00100000:0.0:1787857798.344776:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171696640 00000100:00100000:0.0:1787857798.344888:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1117 00000100:00100000:0.0:1787857798.344900:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28729:x1874704171696640:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787857798.345016:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:28729:x1874704171696640:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 118us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857798.345023:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1117 00000100:00080000:2.0:1787857798.345402:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787857798.565588:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00000001:00080000:1.0:1787857798.565608:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967366 is committed 00010000:00010000:0.0:1787857798.895338:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857799.022409:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857799.022434:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188253056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857799.022513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857799.022648:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188253056 00000100:00100000:3.0:1787857799.022656:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188253056 00000100:00100000:3.0:1787857799.022722:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787857799.022733:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188253056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857799.022781:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857799.022855:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188253056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857799.022879:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:2.0:1787857799.023475:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857799.023523:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188253056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857799.918726:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857800.080025:0:20448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 15:09:58 (1787857798) 00000100:00100000:2.0:1787857800.273467:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.273532:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171696768 00000100:00100000:0.0:1787857800.273551:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171696768 00000100:00100000:0.0:1787857800.273658:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1118 00000100:00100000:0.0:1787857800.273670:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:29395:x1874704171696768:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857800.273871:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:29395:x1874704171696768:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 202us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857800.273881:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1118 00000100:00080000:2.0:1787857800.274156:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857800.275488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.275698:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171696896 00000100:00100000:0.0:1787857800.275709:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171696896 00000100:00100000:0.0:1787857800.275778:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 573 00000100:00100000:0.0:1787857800.275788:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171696896:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857800.275923:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171696896:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 136us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857800.275932:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 573 00000100:00100000:3.0:1787857800.276094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.276332:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.276367:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.276396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.276475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.276503:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171697152 00000100:00100000:3.0:1787857800.276508:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171697152 00000100:00100000:3.0:1787857800.276575:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171697280 00000100:00100000:3.0:1787857800.276579:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171697280 00000100:00100000:3.0:1787857800.276595:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171697408 00000100:00100000:3.0:1787857800.276676:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171697408 00000100:00100000:3.0:1787857800.276700:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171697536 00000100:00100000:3.0:1787857800.276704:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171697536 00000100:00100000:3.0:1787857800.276722:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 420 00000100:00100000:3.0:1787857800.276731:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171697152:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857800.276786:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171697152:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 57us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.276794:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 420 00000100:00100000:3.0:1787857800.276811:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 421 00000100:00100000:3.0:1787857800.276840:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171697280:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857800.276867:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171697280:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 51us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.276874:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 421 00000100:00100000:3.0:1787857800.276896:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 422 00000100:00100000:3.0:1787857800.276903:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171697408:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857800.276935:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171697408:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.276942:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 422 00000100:00100000:3.0:1787857800.276954:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 423 00000100:00100000:3.0:1787857800.276960:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171697536:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857800.276985:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171697536:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.276991:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 423 00000100:00080000:2.0:1787857800.277069:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857800.277075:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857800.283761:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171697024 00000100:00100000:0.0:1787857800.283784:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171697024 00000100:00080000:3.0:1787857800.288932:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857800.289112:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 422 00000100:00100000:1.0:1787857800.289128:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+93:2348:x1874704171697024:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857800.289246:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+93:2348:x1874704171697024:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 122us (13162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857800.289256:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 422 00000100:00100000:3.0:1787857800.293003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.293068:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171697664 00000100:00100000:0.0:1787857800.293095:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171697664 00000100:00100000:0.0:1787857800.293180:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1119 00000100:00100000:0.0:1787857800.293194:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:29396:x1874704171697664:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857800.293225:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857800.293375:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c9ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bf1 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293463:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293479:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293493:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293538:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293557:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293569:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293969:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293977:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293984:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.293990:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857800.293994:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294001:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294015:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:0.0:1787857800.294018:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857800.294023:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294029:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7c9f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294046:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294053:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294059:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294063:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857800.294066:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294072:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294079:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff9997c3d03400) 00010000:00010000:0.0:1787857800.294091:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857800.294095:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294100:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7c9fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294152:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c9ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bf1 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294162:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:0.0:1787857800.294165:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857800.294168:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7c9ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bf1 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.294177:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857800.294248:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+93:29396:x1874704171697664:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1058us (1256us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857800.294260:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1119 00000100:00100000:1.0:1787857800.312376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.312617:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171697920 00000100:00100000:0.0:1787857800.312640:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171697920 00000100:00100000:0.0:1787857800.312722:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1120 00000100:00100000:0.0:1787857800.312735:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+93:29396:x1874704171697920:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1787857800.312855:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857800.312895:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7c7f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b5e expref: 93 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.312919:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:0.0:1787857800.312924:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857800.315374:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.315410:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.315420:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.316315:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.316342:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 42 pid: 5858 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857800.316362:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188253184:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857800.317274:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857800.323297:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188253184:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857800.323336:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857800.328120:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857800.328300:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171698048 00000100:00100000:2.0:1787857800.328315:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171698048 00010000:00010000:2.0:1787857800.328380:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 43 pid: 5858 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857800.328431:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 337 00000100:00100000:2.0:1787857800.328443:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2350:x1874704171698048:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857800.328473:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857800.328482:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 43 pid: 5858 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.328500:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 43 pid: 5858 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.328532:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7c820 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3b6c expref: 43 pid: 5858 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.328553:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:2.0:1787857800.328570:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.328582:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.328591:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.328630:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857800.328679:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.328690:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857800.328723:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:2350:x1874704171698048:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 281us (619us total) trans 0 rc 0/0 00010000:00010000:3.0:1787857800.328732:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857800.328738:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 337 00010000:00010000:3.0:1787857800.328752:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.328771:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857800.330447:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00010000:00010000:3.0:1787857800.330469:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.330481:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.330490:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.330497:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857800.330503:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.330513:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.330536:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d5316d00) 00010000:00010000:3.0:1787857800.330540:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857800.330547:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.330554:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ca03 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857800.330577:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007df90ebd reply state 00000000e4c8664d transno 4294968036 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857800.330601:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857800.330751:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+94:29396:x1874704171697920:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 18012us (18382us total) trans 4294968036 rc 0/0 00000100:00100000:3.0:1787857800.330762:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1120 00010000:00010000:3.0:1787857800.345748:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.345767:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.345781:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.345788:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857800.345793:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.345802:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.346121:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff9998d12efd00) 00010000:00010000:3.0:1787857800.346126:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857800.346133:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.346142:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca0a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857800.349736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857800.350270:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171698176 00000100:00100000:1.0:1787857800.350288:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171698176 00000100:00100000:1.0:1787857800.350374:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1121 00000100:00100000:1.0:1787857800.350388:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+93:29397:x1874704171698176:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857800.350425:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857800.350456:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ca11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bf8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.350550:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ca18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.350568:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.350591:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857800.350674:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857800.350679:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857800.350709:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.350740:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ca11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bf8 expref: 95 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.350760:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ca18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bf8 expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.350770:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:1.0:1787857800.350773:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857800.350778:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:1.0:1787857800.350922:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+94:29397:x1874704171698176:12345-192.168.204.36@tcp:101:bash.0 Request processed in 536us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857800.350931:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1121 00000100:00100000:3.0:1787857800.358138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857800.358320:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171698304 00000100:00100000:1.0:1787857800.358339:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171698304 00000100:00100000:1.0:1787857800.358446:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1122 00000100:00100000:1.0:1787857800.358462:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+94:29397:x1874704171698304:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857800.358501:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857800.358534:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ca1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3bff expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.358748:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.358772:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.358787:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.358807:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.358931:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.358940:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359281:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7ca34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359302:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7ca34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359315:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7ca34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857800.359624:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:1.0:1787857800.359629:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857800.359732:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7ca34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359763:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359770:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359777:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359783:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857800.359787:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359794:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359807:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:1.0:1787857800.359810:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.359847:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.359855:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ca26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360240:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360251:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360257:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360271:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857800.360275:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360281:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360291:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff9998e1a0c200) 00010000:00010000:1.0:1787857800.360293:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.360297:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360303:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ca2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360366:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ca1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bff expref: 96 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360778:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052600/0xd3f183cab4a7ca34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bff expref: 95 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.360787:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857800.360791:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857800.360795:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052600, rc 0) 00000100:00100000:1.0:1787857800.361373:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+95:29397:x1874704171698304:12345-192.168.204.36@tcp:101:bash.0 Request processed in 2911us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857800.361384:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1122 00000040:00080000:2.0:1787857800.369338:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857800.369355:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857800.371602:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857800.371623:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857800.373059:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857800.373131:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171698432 00000100:00100000:1.0:1787857800.373141:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171698432 00000100:00100000:1.0:1787857800.373972:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1123 00000100:00100000:1.0:1787857800.373984:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+95:29397:x1874704171698432:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857800.374009:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857800.374031:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7ca3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c06 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374116:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374131:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374142:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374192:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374201:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374209:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374289:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374296:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374328:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374335:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857800.374340:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374349:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374364:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857800.374367:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.374373:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374380:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374405:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374413:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374419:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374424:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857800.374426:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374443:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374689:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9998e1a0cf00) 00010000:00010000:1.0:1787857800.374693:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.374699:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374706:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374752:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7ca3b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c06 expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374764:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857800.374767:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.374772:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7ca3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c06 expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.374782:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857800.374955:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+95:29397:x1874704171698432:12345-192.168.204.36@tcp:101:bash.0 Request processed in 972us (1906us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857800.374963:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1123 00000100:00100000:3.0:1787857800.393618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.394877:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171698560 00000100:00100000:3.0:1787857800.394895:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171698560 00000100:00100000:3.0:1787857800.394980:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1124 00000100:00100000:3.0:1787857800.394994:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+42:29398:x1874704171698560:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857800.395025:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857800.395056:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c0d expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.395178:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.395196:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.395210:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857800.395296:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857800.395300:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857800.395330:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.395363:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ca50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 44 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.395383:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.395391:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:3.0:1787857800.395402:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857800.395407:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72200, rc 0) 00000100:00100000:3.0:1787857800.395492:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:29398:x1874704171698560:12345-192.168.204.36@tcp:101:rm.0 Request processed in 501us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.395500:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1124 00000100:00100000:3.0:1787857800.398105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.398161:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171698688 00000100:00100000:3.0:1787857800.398173:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171698688 00000100:00100000:3.0:1787857800.398252:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1125 00000100:00100000:3.0:1787857800.398267:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:29398:x1874704171698688:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857800.398297:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857800.398328:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7ca5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c14 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.398440:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.398457:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.398472:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.398489:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.398496:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.398503:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400624:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7ca73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400648:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7ca73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400662:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7ca73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857800.400711:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:3.0:1787857800.400716:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857800.400747:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7ca73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400762:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400769:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400777:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400784:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857800.400789:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400797:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400812:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:3.0:1787857800.400842:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857800.400850:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400857:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7ca65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400875:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400882:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400889:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400894:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857800.400897:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400904:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400913:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff9998d12efd00) 00010000:00010000:3.0:1787857800.400916:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857800.400920:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400925:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7ca6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.400977:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7ca5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c14 expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.401008:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73600/0xd3f183cab4a7ca73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c14 expref: 44 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.401016:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:3.0:1787857800.401019:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787857800.401022:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73600, rc 0) 00000100:00100000:3.0:1787857800.401125:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29398:x1874704171698688:12345-192.168.204.36@tcp:101:rm.0 Request processed in 2860us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.401137:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1125 00000100:00100000:3.0:1787857800.406227:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857800.406733:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171698816 00000100:00100000:1.0:1787857800.406746:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171698816 00000100:00100000:1.0:1787857800.406861:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1126 00000100:00100000:1.0:1787857800.406876:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29398:x1874704171698816:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857800.406928:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857800.406958:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7ca7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c1b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.407711:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.407732:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.407747:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.407764:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.407771:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.407779:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.408561:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.408575:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.408583:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.408591:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857800.408609:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.408618:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409071:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857800.409087:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.409094:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409102:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ca81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409117:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409123:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409130:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409135:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857800.409139:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409146:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409155:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9998e1a0cf00) 00010000:00010000:1.0:1787857800.409157:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.409170:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409176:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ca88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409241:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7ca7a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c1b expref: 45 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409254:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857800.409257:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.409261:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7ca7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c1b expref: 45 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.409270:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857800.409371:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29398:x1874704171698816:12345-192.168.204.36@tcp:101:rm.0 Request processed in 2498us (3162us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857800.409383:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1126 00000100:00100000:3.0:1787857800.419949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.420063:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171698944 00000100:00100000:0.0:1787857800.420075:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171698944 00000100:00100000:0.0:1787857800.420149:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1127 00000100:00100000:0.0:1787857800.420160:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29398:x1874704171698944:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857800.420184:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857800.420207:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7ca8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c22 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420280:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420294:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420306:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420320:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420327:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420334:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420577:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420586:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420594:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420600:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857800.420604:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420612:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420624:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:0.0:1787857800.420627:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857800.420632:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420639:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7ca96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420653:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420659:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420665:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420669:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857800.420672:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420682:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420689:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9997c3d03400) 00010000:00010000:0.0:1787857800.420691:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857800.420694:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420699:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7ca9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420737:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7ca8f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c22 expref: 45 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420747:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:0.0:1787857800.420749:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857800.420753:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7ca8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c22 expref: 45 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.420762:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70600, rc 0) 00000100:00100000:0.0:1787857800.420926:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29398:x1874704171698944:12345-192.168.204.36@tcp:101:rm.0 Request processed in 766us (991us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857800.420935:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1127 00000100:00100000:3.0:1787857800.451208:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857800.451634:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171699072 00000100:00100000:1.0:1787857800.451650:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171699072 00000100:00100000:1.0:1787857800.451734:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1128 00000100:00100000:1.0:1787857800.451746:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5bd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29399:x1874704171699072:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857800.451775:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857800.451803:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7caa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c29 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452272:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452310:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452325:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452345:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452353:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452360:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452461:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452469:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452477:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452484:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857800.452491:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452506:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452522:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857800.452531:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.452538:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452545:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7caab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452564:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452571:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452577:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452582:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857800.452585:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452592:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452600:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9998e1a0cf00) 00010000:00010000:1.0:1787857800.452603:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.452606:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452611:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cab2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.452652:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7caa4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c29 expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.453548:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857800.453556:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857800.454346:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7caa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c29 expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.454373:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053200, rc 0) 00000100:00100000:1.0:1787857800.454552:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5bd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29399:x1874704171699072:12345-192.168.204.36@tcp:101:cp.0 Request processed in 2806us (3368us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857800.454564:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1128 00000100:00100000:1.0:1787857800.471471:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857800.471600:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171699200 00000100:00100000:2.0:1787857800.471613:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171699200 00000100:00100000:2.0:1787857800.471708:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1129 00000100:00100000:2.0:1787857800.471719:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29399:x1874704171699200:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857800.471747:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857800.471774:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cab9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c30 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.471914:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.471933:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.471970:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.471987:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.471994:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472000:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472098:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472105:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472112:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472118:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857800.472124:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472132:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472293:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:2.0:1787857800.472297:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857800.472304:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472319:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472338:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472344:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472350:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472354:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857800.472357:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472362:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472369:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9998c3379300) 00010000:00010000:2.0:1787857800.472372:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857800.472376:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472382:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472424:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cab9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c30 expref: 45 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472449:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:2.0:1787857800.472451:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857800.472455:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cab9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c30 expref: 45 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.472465:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74600, rc 0) 00000100:00100000:2.0:1787857800.472552:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29399:x1874704171699200:12345-192.168.204.36@tcp:101:cp.0 Request processed in 835us (1099us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857800.472562:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1129 00000100:00100000:3.0:1787857800.475951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.476571:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171699456 00000100:00100000:0.0:1787857800.476586:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171699456 00000100:00100000:0.0:1787857800.476671:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1130 00000100:00100000:0.0:1787857800.476682:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29399:x1874704171699456:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857800.476714:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857800.476741:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cace lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c37 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.477047:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.477069:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.477096:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.477116:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.477122:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.477129:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857800.480199:0:19301:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:0.0:1787857800.481653:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481687:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481705:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481764:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481772:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481791:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481798:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857800.481804:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481812:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481846:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:0.0:1787857800.481851:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857800.481857:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481864:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cad5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857800.481883:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016025e4b reply state 00000000b47d64a0 transno 4294968037 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857800.481894:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857800.481945:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cace lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481967:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.481976:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857800.481979:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857800.481982:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:0.0:1787857800.482088:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29399:x1874704171699456:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5396us (6145us total) trans 4294968037 rc 0/0 00000100:00100000:0.0:1787857800.482099:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1130 00010000:00010000:2.0:1787857800.486110:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.486135:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.486154:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.486162:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857800.486169:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.486178:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.486205:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9997c3d03400) 00010000:00010000:2.0:1787857800.486210:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857800.486218:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.486246:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7cadc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857800.486736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.486857:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171699584 00000100:00100000:3.0:1787857800.486913:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171699584 00000100:00100000:3.0:1787857800.486981:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 299 00000100:00100000:3.0:1787857800.486995:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171699584:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857800.487020:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857800.487104:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c3e expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857800.487149:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857800.487177:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=624s v=(0 0) 00010000:00010000:3.0:1787857800.487183:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857800.487196:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 9 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.487232:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 9 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.487247:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857800.487345:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171699584:12345-192.168.204.36@tcp:101:cp.0 Request processed in 352us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.487354:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 299 00000100:00100000:0.0:1787857800.495196:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857800.495377:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171699712 00000100:00100000:1.0:1787857800.495391:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171699712 00000100:00100000:1.0:1787857800.495474:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 300 00000100:00100000:1.0:1787857800.495488:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:29399:x1874704171699712:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857800.495513:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857800.495536:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c45 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.495578:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.495589:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857800.495594:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857800.495602:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.495683:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857800.495699:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 10 pid: 14028 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857800.495716:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188253312:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857800.495879:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fd0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857800.503114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.503325:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171699840 00000100:00100000:0.0:1787857800.503337:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171699840 00010000:00010000:0.0:1787857800.503399:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 11 pid: 14028 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857800.503464:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00100000:0.0:1787857800.503477:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171699840:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857800.503498:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857800.503531:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 11 pid: 14028 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.503547:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 11 pid: 14028 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.503588:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857800.503594:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857800.503605:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.503618:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.503805:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 11 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857800.503869:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188253440:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857800.504012:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753900 going to sleep for 11 seconds 00010000:00010000:2.0:1787857800.506292:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7caf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c3e expref: 11 pid: 14028 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857800.506328:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188253312:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857800.506371:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.506392:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053400, rc 0) 00000100:00100000:2.0:1787857800.506957:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:29399:x1874704171699712:12345-192.168.204.36@tcp:101:cp.0 Request processed in 11468us (11771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857800.506970:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 300 00000100:00100000:2.0:1787857800.511934:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188253440:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857800.511983:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857800.512070:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171699840:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 8594us (8971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857800.512094:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00100000:2.0:1787857800.515964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.519024:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171700096 00000100:00100000:0.0:1787857800.519051:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171700096 00000100:00100000:0.0:1787857800.519180:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 223 00000100:00100000:0.0:1787857800.519194:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29399:x1874704171700096:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:0.0:1787857800.519934:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29399:x1874704171700096:12345-192.168.204.36@tcp:35:cp.0 Request processed in 738us (4126us total) trans 4294968038 rc 0/0 00000100:00100000:0.0:1787857800.519944:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 223 00000100:00100000:3.0:1787857800.559361:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857800.559396:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188253696:0@lo:400:kworker.0 00000100:00100000:3.0:1787857800.559513:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857800.559612:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188253824:0@lo:400:kworker.0 00000100:00100000:1.0:1787857800.559738:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857800.559752:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188253568:0@lo:400:kworker.0 00000100:00100000:1.0:1787857800.559805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857800.559916:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188253696 00000100:00100000:0.0:1787857800.559928:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188253696 00000100:00100000:0.0:1787857800.560017:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1787857800.560031:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188253696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857800.560118:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188253696:12345-0@lo:400:kworker.0 Request processed in 90us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857800.560126:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787857800.560243:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857800.560255:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188253952:0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.560293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857800.560329:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188253952 00000100:00100000:2.0:1787857800.560333:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188253952 00000100:00100000:2.0:1787857800.560378:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1787857800.560386:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188253952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.560974:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188253952:12345-0@lo:400:kworker.0 Request processed in 587us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857800.560982:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1787857800.561035:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188253952:0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.561219:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188254080:0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.561254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857800.561288:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188254080 00000100:00100000:2.0:1787857800.561293:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188254080 00000100:00100000:2.0:1787857800.561338:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1787857800.561345:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188254080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.561387:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188254080:12345-0@lo:400:kworker.0 Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857800.561393:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1787857800.561768:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188254080:0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.561843:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188254208:0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.561873:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857800.561904:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188254208 00000100:00100000:2.0:1787857800.561908:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188254208 00000100:00100000:2.0:1787857800.561940:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1787857800.561946:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188254208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.561978:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188254208:12345-0@lo:400:kworker.0 Request processed in 32us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857800.561983:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1787857800.562021:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967366 gen 2 00000004:00080000:2.0:1787857800.562027:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967364 committed transno 4294967366 00000004:00080000:2.0:1787857800.562048:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967365 committed transno 4294967366 00000004:00080000:2.0:1787857800.562064:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c5c6c000, transno 4294967366 00000100:00100000:3.0:1787857800.562533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857800.562571:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188253696:0@lo:400:kworker.0 00000100:00100000:3.0:1787857800.562605:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188253568 00000100:00100000:3.0:1787857800.562617:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188253568 00000100:00100000:3.0:1787857800.562724:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1787857800.562732:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188253568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857800.562768:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188253568:12345-0@lo:400:kworker.0 Request processed in 38us (2962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.562775:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00080000:3.0:1787857800.562807:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857800.562813:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857800.562848:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188253824 00000100:00100000:3.0:1787857800.562851:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188253824 00000100:00100000:3.0:1787857800.562892:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1787857800.562898:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188253824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857800.562937:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188253824:12345-0@lo:400:kworker.0 Request processed in 39us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.562943:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00080000:3.0:1787857800.562957:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857800.562975:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188253824:0@lo:400:kworker.0 00000100:00100000:0.0:1787857800.565533:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188253568:0@lo:400:kworker.0 00000100:00100000:2.0:1787857800.567784:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188254208:0@lo:400:kworker.0 00000100:00100000:1.0:1787857800.591314:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857800.591785:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171700224 00000100:00100000:2.0:1787857800.591799:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171700224 00000100:00100000:2.0:1787857800.591998:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1131 00000100:00100000:2.0:1787857800.592011:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29402:x1874704171700224:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857800.592042:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857800.592073:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7caff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c4c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592178:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592198:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592212:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592232:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592240:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592247:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592400:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592409:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.592417:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857800.593297:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:2.0:1787857800.593304:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857800.593330:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.593346:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.593357:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.593365:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.593373:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.593379:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857800.593384:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.593393:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.593437:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:2.0:1787857800.593441:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857800.593447:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.593454:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cb06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595113:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595125:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595133:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595140:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857800.595146:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595154:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595173:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9998c3379300) 00010000:00010000:2.0:1787857800.595176:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857800.595181:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595188:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cb0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595288:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7caff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 97 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595305:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 96 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.595313:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857800.595315:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857800.595318:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75000, rc 0) 00000100:00100000:2.0:1787857800.595529:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+96:29402:x1874704171700224:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3518us (4229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857800.595541:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1131 00000100:00100000:3.0:1787857800.609724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857800.609894:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171700352 00000100:00100000:2.0:1787857800.609908:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171700352 00000100:00100000:2.0:1787857800.609994:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 301 00000100:00100000:2.0:1787857800.610008:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171700352:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857800.610065:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857800.610104:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cb1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c53 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857800.610190:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188254336:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857800.610331:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c72270c0 going to sleep for 11 seconds 00002000:00010000:2.0:1787857800.613173:0:6713:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857800.613191:0:6713:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb mtime: 0 -> 1787857800 00002000:00010000:2.0:1787857800.613194:0:6713:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb atime: 0 -> 1787857800 00002000:00010000:2.0:1787857800.613196:0:6713:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb ctime: 0 -> 1787857800 00000100:00100000:2.0:1787857800.613269:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188254336:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857800.613324:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cb1b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c53 expref: 16 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.613363:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cb1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c53 expref: 16 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857800.613383:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75c00, rc 0) 00000100:00100000:2.0:1787857800.614741:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171700352:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4717us (5016us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857800.614758:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 301 00000100:00100000:0.0:1787857800.626685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857800.627369:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171700480 00000100:00100000:3.0:1787857800.627386:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171700480 00000100:00100000:3.0:1787857800.627552:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1132 00000100:00100000:3.0:1787857800.627566:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:29402:x1874704171700480:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857800.627598:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857800.627639:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7cb22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c5a expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.627767:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.627788:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.627806:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857800.627994:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:3.0:1787857800.627999:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857800.628035:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.628115:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7cb22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 98 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.628143:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 97 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857800.628153:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:3.0:1787857800.628156:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857800.628161:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72e00, rc 0) 00000100:00100000:3.0:1787857800.628279:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+97:29402:x1874704171700480:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 714us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857800.628288:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1132 00000100:00100000:3.0:1787857800.633957:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857800.634628:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171700608 00000100:00100000:2.0:1787857800.634643:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171700608 00000100:00100000:2.0:1787857800.634730:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 302 00000100:00100000:2.0:1787857800.634743:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171700608:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857800.634768:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857800.634794:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099f780c5/0xd3f183cab4a7cb30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c61 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857800.634909:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188254464:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857800.635361:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c72270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857800.638644:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188254464:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857800.638701:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099f780c5/0xd3f183cab4a7cb30 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c61 expref: 16 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.638736:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099f780c5/0xd3f183cab4a7cb30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c61 expref: 16 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857800.638754:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74600, rc 0) 00000100:00100000:0.0:1787857800.639657:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171700608:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4907us (5706us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857800.639672:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 302 00000100:00100000:1.0:1787857800.649939:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857800.650036:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171700864 00000100:00100000:0.0:1787857800.650048:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171700864 00000100:00100000:0.0:1787857800.650136:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1133 00000100:00100000:0.0:1787857800.650149:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+97:29402:x1874704171700864:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857800.650887:0:19301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 136 off12408 00000100:00100000:0.0:1787857800.651031:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+97:29402:x1874704171700864:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 883us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857800.651040:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1133 00010000:00010000:1.0:1787857800.943155:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857801.070347:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188254592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857801.070457:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857801.070666:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188254592 00000100:00100000:3.0:1787857801.070676:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188254592 00000100:00100000:3.0:1787857801.070739:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787857801.070750:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188254592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857801.070802:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857801.070892:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188254592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857801.070900:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787857801.070962:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188254592:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787857801.393128:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857801.393139:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857801.393181:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 32 count 4 00000040:00080000:2.0:1787857801.393187:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857801.394026:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b40f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188254720:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857801.394154:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7227b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857801.403442:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857801.403488:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171700992 00000100:00100000:1.0:1787857801.403498:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171700992 00000100:00100000:1.0:1787857801.403557:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1134 00000100:00100000:1.0:1787857801.403567:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29412:x1874704171700992:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857801.403608:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857801.403727:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29412:x1874704171700992:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 160us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857801.403736:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1134 00000100:00100000:0.0:1787857801.404620:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b40f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188254720:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857801.411449:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857801.413128:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171701248 00000100:00100000:2.0:1787857801.413145:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171701248 00000100:00100000:3.0:1787857801.416380:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1135 00000100:00100000:3.0:1787857801.416407:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29412:x1874704171701248:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857801.416433:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857801.416464:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cb37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c68 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.416602:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7cb3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.416618:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7cb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.416634:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7cb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857801.416648:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1787857801.416787:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cb37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c68 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.416808:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7cb3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c68 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.416837:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857801.416840:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857801.416844:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72000, rc 0) 00000100:00100000:3.0:1787857801.416927:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29412:x1874704171701248:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 530us (5498us total) trans 4294968039 rc 0/0 00000100:00100000:3.0:1787857801.416936:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1135 00000100:00100000:1.0:1787857801.428171:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857801.428231:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857801.428324:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171701504 00000100:00100000:3.0:1787857801.428343:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171701504 00000100:00100000:3.0:1787857801.428405:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 303 00000100:00100000:3.0:1787857801.428416:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171701504:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857801.428485:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.428509:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.428520:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857801.428525:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857801.428530:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.428581:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.428596:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 9 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857801.428611:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c303c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188254848:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857801.428720:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857801.430548:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171701376 00000100:00100000:2.0:1787857801.430563:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171701376 00000100:00100000:2.0:1787857801.430693:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:2.0:1787857801.430705:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2347:x1874704171701376:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857801.430722:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857801.430753:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7cb3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c68 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.430787:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857801.430792:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857801.430874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2347:x1874704171701376:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 172us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857801.430882:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:3.0:1787857801.435538:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c303c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188254848:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857801.435578:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857801.436742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857801.436969:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171701632 00000100:00100000:1.0:1787857801.436978:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171701632 00002000:00100000:1.0:1787857801.437109:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x16:0x0] (0->157) req@ffff9998ffa84780 x1874704171701632/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:447/0 lens 648/0 e 0 to 0 dl 1787857812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857801.437123:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa84780 with x1874704171701632 ext(0->157) 00010000:00010000:1.0:1787857801.437134:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 10 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.437219:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 10 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857801.437229:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998ffa84780 00000100:00100000:0.0:1787857801.437308:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:0.0:1787857801.437323:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171701632:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:0.0:1787857801.438308:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171701632:12345-192.168.204.36@tcp:4:cp.0 Request processed in 984us (1564us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787857801.438319:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00002000:00100000:0.0:1787857801.438329:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x16:0x0] (0->157) req@ffff9998ffa84780 x1874704171701632/t4294967354(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:447/0 lens 648/448 e 0 to 0 dl 1787857812 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857801.438338:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa84780 with x1874704171701632 ext(0->157) 00010000:00010000:0.0:1787857801.438348:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 12 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.438363:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 12 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857801.438370:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998ffa84780 00000100:00100000:1.0:1787857801.450419:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857801.450558:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171701760 00000100:00100000:2.0:1787857801.450568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171701760 00010000:00010000:2.0:1787857801.450616:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 12 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857801.450664:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 339 00000100:00100000:2.0:1787857801.450675:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171701760:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857801.450692:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857801.450721:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 12 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.450943:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 12 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.450977:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7caf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c45 expref: 12 pid: 6713 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.450995:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857801.450999:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857801.451005:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.451015:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.451047:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857801.451131:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.451153:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.451178:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.451186:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.451193:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.451200:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857801.451278:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.451288:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.451300:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.451308:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7cb4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857801.451401:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171701760:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 726us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857801.451411:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 339 00000100:00100000:3.0:1787857801.451472:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171701504:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 23058us (23310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857801.451482:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 303 00000100:00100000:0.0:1787857801.460470:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857801.460610:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171702016 00000100:00100000:2.0:1787857801.460619:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171702016 00000100:00100000:2.0:1787857801.460746:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1136 00000100:00100000:2.0:1787857801.460770:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29412:x1874704171702016:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857801.460945:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29412:x1874704171702016:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 188us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857801.460953:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1136 00000100:00100000:0.0:1787857801.464862:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857801.465017:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171702144 00000100:00100000:1.0:1787857801.465028:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171702144 00000100:00100000:1.0:1787857801.465096:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 304 00000100:00100000:1.0:1787857801.465107:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171702144:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857801.465125:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857801.465148:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c6f expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857801.465176:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a908b88, atime: 0x0, ctime: 0x6a908b88, blocks: 0x1 00010000:00010000:1.0:1787857801.465197:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=625s v=(0 0) 00010000:00010000:1.0:1787857801.465202:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857801.465212:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.465246:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.465262:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052a00, rc 0) 00000100:00100000:1.0:1787857801.465323:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171702144:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 218us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857801.465331:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 304 00000100:00100000:3.0:1787857801.475812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857801.476148:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171702400 00000100:00100000:0.0:1787857801.476160:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171702400 00000100:00100000:0.0:1787857801.476227:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1137 00000100:00100000:0.0:1787857801.476239:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29412:x1874704171702400:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857801.476369:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29412:x1874704171702400:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 132us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857801.476378:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1137 00000100:00100000:0.0:1787857801.483117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857801.483211:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171702528 00000100:00100000:2.0:1787857801.483221:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171702528 00002000:00100000:2.0:1787857801.483274:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x16:0x0] (0->4095) req@ffff9998efab5680 x1874704171702528/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:447/0 lens 488/0 e 0 to 0 dl 1787857812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857801.483286:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab5680 with x1874704171702528 ext(0->4095) 00002000:00010000:2.0:1787857801.483291:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efab5680 00000100:00100000:2.0:1787857801.483327:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 101 00000100:00100000:2.0:1787857801.483338:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171702528:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787857801.483606:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171702528:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 269us (499us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857801.483614:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 101 00002000:00100000:2.0:1787857801.483622:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x16:0x0] (0->4095) req@ffff9998efab5680 x1874704171702528/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:447/0 lens 488/4536 e 0 to 0 dl 1787857812 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857801.483631:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab5680 with x1874704171702528 ext(0->4095) 00002000:00010000:2.0:1787857801.483635:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efab5680 00000100:00100000:3.0:1787857801.492339:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857801.492484:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171702656 00000100:00100000:1.0:1787857801.492495:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171702656 00000100:00100000:1.0:1787857801.492595:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1138 00000100:00100000:1.0:1787857801.492607:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29412:x1874704171702656:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857801.492632:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857801.492658:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cb5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c76 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.492719:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.492735:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.492746:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.495197:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cb5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.495224:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.495234:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857801.495238:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857801.495241:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71c00, rc 0) 00000100:00100000:0.0:1787857801.495394:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29412:x1874704171702656:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2787us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857801.495405:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1138 00000100:00100000:0.0:1787857801.507214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857801.507259:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171702784 00000100:00100000:0.0:1787857801.507280:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171702784 00000100:00100000:0.0:1787857801.507347:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1139 00000100:00100000:0.0:1787857801.507361:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29412:x1874704171702784:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857801.507407:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857801.507723:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29412:x1874704171702784:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 354us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857801.507733:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1139 00000100:00100000:0.0:1787857801.517725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857801.517884:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171702912 00000100:00100000:1.0:1787857801.517894:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171702912 00000100:00100000:1.0:1787857801.517954:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 305 00000100:00100000:1.0:1787857801.517966:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171702912:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857801.518012:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518029:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857801.518033:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857801.518046:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518071:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518104:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518112:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518120:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518127:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857801.518131:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518140:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518156:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.518164:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000146f230d/0xd3f183cab4a7cb68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857801.518256:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171702912:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 292us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857801.518265:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 305 00000100:00100000:1.0:1787857801.523448:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857801.523876:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171703168 00000100:00100000:2.0:1787857801.523887:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171703168 00000100:00100000:2.0:1787857801.523963:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1140 00000100:00100000:2.0:1787857801.523976:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29412:x1874704171703168:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857801.524072:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.524093:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.524104:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.524151:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.524166:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 49 pid: 5857 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857801.524184:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b421c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188254976:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857801.524292:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857801.527717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857801.527754:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171703296 00000100:00100000:0.0:1787857801.527763:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171703296 00010000:00010000:0.0:1787857801.527806:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 50 pid: 5857 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857801.527845:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b421c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188254976:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857801.527871:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 340 00010000:00010000:1.0:1787857801.527875:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857801.527884:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2350:x1874704171703296:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857801.527901:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857801.527909:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 50 pid: 5857 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.527922:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 50 pid: 5857 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.527946:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cb61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c76 expref: 50 pid: 5857 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.527961:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857801.527967:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.527977:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.527984:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.528013:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857801.528078:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2350:x1874704171703296:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 197us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857801.528087:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 340 00010000:00010000:1.0:1787857801.528602:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.528612:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.528971:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.528981:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.528989:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.528995:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857801.529000:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.529008:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.529029:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857801.529033:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857801.529038:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.529045:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cb6f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857801.529210:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29412:x1874704171703168:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 5235us (5775us total) trans 4294968040 rc 0/0 00000100:00100000:1.0:1787857801.529221:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1140 00000040:00080000:0.0:1787857801.529781:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857801.529787:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857801.530593:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787857801.530604:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857801.532658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857801.533386:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171703552 00000100:00100000:2.0:1787857801.533396:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171703552 00000100:00100000:2.0:1787857801.533467:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 224 00000100:00100000:2.0:1787857801.533477:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29412:x1874704171703552:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857801.533759:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29412:x1874704171703552:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 283us (1109us total) trans 4294968041 rc 0/0 00000100:00100000:2.0:1787857801.533767:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 224 00000040:00080000:2.0:1787857801.651773:0:20497:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857801.651783:0:20497:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857801.651881:0:20497:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 32 count 4 00000040:00080000:2.0:1787857801.651887:0:20497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857801.730292:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857801.730427:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171703680 00000100:00100000:3.0:1787857801.730436:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171703680 00000100:00100000:3.0:1787857801.730497:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:3.0:1787857801.730507:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171703680:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857801.730529:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857801.730548:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c7d expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.730574:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857801.730579:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857801.730588:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 16 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.730606:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 16 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.730621:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857801.730728:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171703680:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 222us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857801.730747:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:1.0:1787857801.754356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857801.756028:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171703936 00000100:00100000:3.0:1787857801.756044:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171703936 00000100:00100000:3.0:1787857801.756177:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1141 00000100:00100000:3.0:1787857801.756188:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:29413:x1874704171703936:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857801.756212:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857801.756234:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c84 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.756337:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7cb84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.757717:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7cb84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.757740:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7cb84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857801.757761:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1787857801.758049:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c84 expref: 100 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.758079:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7cb84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c84 expref: 99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.758088:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857801.758091:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857801.758095:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73e00, rc 0) 00000100:00100000:3.0:1787857801.758228:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+99:29413:x1874704171703936:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2040us (3892us total) trans 4294968042 rc 0/0 00000100:00100000:3.0:1787857801.758237:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1141 00000100:00100000:3.0:1787857801.763593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857801.763669:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171704064 00000100:00100000:0.0:1787857801.763679:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171704064 00000100:00100000:0.0:1787857801.763737:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 307 00000100:00100000:0.0:1787857801.763747:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171704064:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:0.0:1787857801.763810:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.763853:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.763862:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 16 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.763875:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857801.763879:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857801.763884:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.763918:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 16 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.763933:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 16 pid: 14028 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857801.763947:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188255104:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857801.764042:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.764064:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 10 pid: 6713 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857801.764074:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188255232:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857801.764100:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900e19f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857801.767567:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188255104:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857801.767585:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188255232:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857801.767610:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857801.781029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857801.781121:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857801.787335:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171704192 00000100:00100000:2.0:1787857801.787360:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171704192 00010000:00010000:2.0:1787857801.787410:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 17 pid: 14028 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857801.787549:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171704320 00000100:00100000:3.0:1787857801.787555:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171704320 00010000:00010000:3.0:1787857801.787578:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 11 pid: 6713 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857801.787621:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 341 00000100:00100000:2.0:1787857801.787647:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171704192:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857801.787665:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857801.787691:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 17 pid: 14028 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.787706:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 17 pid: 14028 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.787732:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7cb76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c7d expref: 17 pid: 14028 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.787749:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857801.787841:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171704192:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 195us (6821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857801.787849:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 341 00000100:00100000:2.0:1787857801.787903:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:2.0:1787857801.787910:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171704320:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857801.787919:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857801.787929:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 11 pid: 6713 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.787939:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 11 pid: 6713 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.787955:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cb53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c6f expref: 11 pid: 6713 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.787973:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857801.787978:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857801.787984:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.787996:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857801.788041:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857801.788075:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171704320:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 165us (6954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857801.788082:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 342 00010000:00010000:0.0:1787857801.792011:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.792030:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.792083:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.792093:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.792101:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.792109:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857801.792113:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.792121:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.792141:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857801.792150:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8a53d40/0xd3f183cab4a7cb92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857801.792257:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171704064:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 28505us (28668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857801.792268:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 307 00000100:00100000:3.0:1787857801.805420:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857801.805466:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171704576 00000100:00100000:3.0:1787857801.805476:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171704576 00000100:00100000:3.0:1787857801.805627:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 225 00000100:00100000:3.0:1787857801.805640:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+99:29413:x1874704171704576:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:3.0:1787857801.805716:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x20:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7cb84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c84 expref: 99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857801.807365:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968043 00000001:00080000:3.0:1787857801.807931:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968044 00010000:00010000:3.0:1787857801.807995:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.808028:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 49 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.808038:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 102 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.808064:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.808104:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 102 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.808122:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 102 pid: 5856 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857801.808139:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c31680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188255360:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857801.808244:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 49 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.808255:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 49 pid: 19301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857801.808265:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c32940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188255488:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857801.808289:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c700fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857801.812008:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c31680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188255360:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857801.819617:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c32940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188255488:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857801.819667:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857801.824108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857801.826360:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857801.826407:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171704832 00000100:00100000:3.0:1787857801.826417:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171704832 00010000:00010000:3.0:1787857801.826460:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 50 pid: 19301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857801.826492:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171704704 00000100:00100000:3.0:1787857801.826496:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171704704 00010000:00010000:3.0:1787857801.826514:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 103 pid: 5856 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857801.826542:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00100000:3.0:1787857801.826554:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2350:x1874704171704832:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857801.826635:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857801.826644:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 50 pid: 19301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.826658:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 50 pid: 19301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.826683:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7cae3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c37 expref: 50 pid: 19301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.826701:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857801.826720:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.826730:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857801.826738:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857801.826793:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2350:x1874704171704832:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 241us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857801.826797:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 344 00000100:00100000:3.0:1787857801.826808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00100000:1.0:1787857801.826814:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+103:2350:x1874704171704704:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857801.826843:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857801.826850:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 103 pid: 5856 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.826863:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 103 pid: 5856 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.826878:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cb14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c4c expref: 103 pid: 5856 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.826890:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857801.826894:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.826909:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.826917:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.826943:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857801.826966:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+102:2350:x1874704171704704:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 157us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857801.826973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 344 00010000:00010000:1.0:1787857801.826999:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.827007:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857801.827141:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968045 00000001:00080000:1.0:1787857801.827352:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968046 00000001:00080000:1.0:1787857801.827421:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968047 00000100:00100000:1.0:1787857801.827516:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188255616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857801.827569:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857801.827608:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf840 going to sleep for 11 seconds 00000100:00100000:3.0:1787857801.827753:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188255616 00000100:00100000:3.0:1787857801.827759:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188255616 00000100:00100000:3.0:1787857801.827840:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787857801.827849:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188255616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1787857801.827852:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857801.827951:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188255616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857801.827959:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787857801.828106:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188255616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787857801.828449:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968048 00000100:00100000:1.0:1787857801.828507:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188255744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857801.828539:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857801.828570:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857801.829736:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188255744 00000100:00100000:3.0:1787857801.829749:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188255744 00000100:00100000:3.0:1787857801.829799:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787857801.829807:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1874704188255744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787857801.830072:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188255744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 265us (1531us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787857801.830082:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787857801.830110:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188255744:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:1.0:1787857801.830136:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.830147:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.830154:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.830160:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857801.830165:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.830172:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.830186:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857801.830189:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787857801.830194:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857801.830200:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7cb99 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857801.830394:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x47:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787857801.830619:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8792 00000004:00080000:1.0:1787857801.830630:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625880812518ns, next at 626880810702ns, rc = 0 00000001:00080000:1.0:1787857801.830638:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968049 00010000:00010000:1.0:1787857801.830678:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857801.830681:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857801.830701:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7cb84 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c84 expref: 106 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857801.830961:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+105:29413:x1874704171704576:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 25324us (25551us total) trans 4294968050 rc 0/0 00000100:00100000:1.0:1787857801.830970:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 225 00000020:00080000:1.0:1787857801.830974:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00010000:00010000:3.0:1787857801.966071:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857802.990471:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787857803.148642:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968038 is committed 00000001:00080000:3.0:1787857803.148659:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968050 is committed 00000004:00080000:3.0:1787857803.148664:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:3.0:1787857803.148710:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998d09bf840 refcount 2 committed 0 result 0 batchid 23 00000020:00080000:3.0:1787857803.148716:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998ffaecc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998d09bf240 00000020:00080000:3.0:1787857803.148719:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998ffaec600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c515c800 00000001:00080000:3.0:1787857803.148752:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968040 is committed 00000001:00080000:3.0:1787857803.148760:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968041 is committed 00000020:00080000:3.0:1787857803.148781:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 22 batchid updated 00000020:00080000:1.0:1787857803.148834:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 23 committed batchid 22 00000020:00080000:1.0:1787857803.149049:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 22 00000100:00100000:1.0:1787857803.149455:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188255872:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787857803.149535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857803.149940:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188255872 00000100:00100000:2.0:1787857803.149950:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188255872 00000100:00100000:2.0:1787857803.150208:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787857803.150221:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188255872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787857803.150256:0:6714:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00002000:00010000:2.0:1787857803.150291:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a908b88, atime: 0x0, ctime: 0x6a908b88, blocks: 0x1 00010000:00010000:2.0:1787857803.150300:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.150317:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=627s v=(0 0) 00010000:00010000:2.0:1787857803.150322:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857803.150328:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.150357:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.150367:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.150376:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.150400:0:6714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857803.150880:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857803.150888:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857803.150896:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857803.150900:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857803.150909:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857803.150927:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857803.150936:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cba0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857803.150959:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857803.150961:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857803.150962:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857803.151438:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188255872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1217us (1899us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787857803.151449:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:1.0:1787857803.151530:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787857803.151589:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c5b403c0/2, rc 0, transno 4294967356 00000100:00100000:0.0:1787857803.151598:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188255872:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1787857803.570348:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857803.570359:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857803.570665:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 32 count 3 00000040:00080000:2.0:1787857803.570673:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857803.683172:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857803.683256:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171704960 00000100:00100000:2.0:1787857803.683266:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171704960 00000100:00100000:2.0:1787857803.683356:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1142 00000100:00100000:2.0:1787857803.683368:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6138c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+95:29432:x1874704171704960:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:2.0:1787857803.683395:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857803.683417:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cba7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c8b expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.683488:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.683519:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.683532:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.683549:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.683556:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.683563:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.683998:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7cbbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684009:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7cbbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684027:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7cbbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857803.684068:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:2.0:1787857803.684074:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857803.684097:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7cbbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684111:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7cbbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684130:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684136:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684143:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684150:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857803.684155:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684163:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684178:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:2.0:1787857803.684181:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857803.684185:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684192:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684205:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684211:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684217:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684228:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857803.684232:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684237:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684245:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9998c3379100) 00010000:00010000:2.0:1787857803.684248:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857803.684250:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684257:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684901:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cba7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c8b expref: 97 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684927:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7cbbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c8b expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.684935:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:2.0:1787857803.684938:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857803.684941:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75200, rc 0) 00000100:00080000:3.0:1787857803.685069:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857803.685136:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6138c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:29432:x1874704171704960:12345-192.168.204.36@tcp:101:diff.0 Request processed in 1769us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857803.685146:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1142 00000100:00100000:3.0:1787857803.688875:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857803.688916:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171705216 00000100:00100000:3.0:1787857803.688925:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171705216 00000100:00100000:3.0:1787857803.688982:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1143 00000100:00100000:3.0:1787857803.688993:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+96:29432:x1874704171705216:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:3.0:1787857803.689027:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857803.689050:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c92 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.689157:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cbca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.689172:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cbca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.689182:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cbca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857803.689193:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1787857803.689436:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c92 expref: 99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.689478:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cbca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c92 expref: 98 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.689487:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:3.0:1787857803.689490:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857803.689494:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:3.0:1787857803.689868:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+98:29432:x1874704171705216:12345-192.168.204.36@tcp:101:diff.0 Request processed in 875us (1053us total) trans 4294968051 rc 0/0 00000100:00100000:3.0:1787857803.689876:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1143 00000100:00100000:3.0:1787857803.696850:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857803.697046:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171705472 00000100:00100000:2.0:1787857803.697068:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171705472 00000100:00100000:2.0:1787857803.697136:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:2.0:1787857803.697147:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c32580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+98:2350:x1874704171705472:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857803.697163:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857803.697194:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cbca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c92 expref: 98 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857803.697213:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:2.0:1787857803.697219:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857803.697294:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c32580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+97:2350:x1874704171705472:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 149us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857803.697302:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:1.0:1787857803.702802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857803.702914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171705600 00000100:00100000:3.0:1787857803.702924:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171705600 00000100:00100000:3.0:1787857803.702989:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:3.0:1787857803.703001:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:29432:x1874704171705600:12345-192.168.204.36@tcp:103:diff.0 00010000:00010000:3.0:1787857803.703026:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857803.703052:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7cbbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c8b expref: 97 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.703068:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:3.0:1787857803.703077:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857803.703130:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+96:29432:x1874704171705600:12345-192.168.204.36@tcp:103:diff.0 Request processed in 131us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857803.703138:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:2.0:1787857803.708875:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857803.708952:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171705728 00000100:00100000:1.0:1787857803.708961:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171705728 00000100:00100000:1.0:1787857803.709038:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1144 00000100:00100000:1.0:1787857803.709048:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+96:29432:x1874704171705728:12345-192.168.204.36@tcp:58:diff.0 00010000:00010000:1.0:1787857803.709150:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857803.709168:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857803.709180:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857803.709517:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 136 off12544 00000100:00100000:1.0:1787857803.709607:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+96:29432:x1874704171705728:12345-192.168.204.36@tcp:58:diff.0 Request processed in 559us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857803.709626:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1144 00000100:00100000:3.0:1787857803.711691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857803.711732:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171705856 00000100:00100000:3.0:1787857803.711750:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171705856 00000100:00100000:3.0:1787857803.711800:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1145 00000100:00100000:3.0:1787857803.711809:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+96:29432:x1874704171705856:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:3.0:1787857803.711848:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857803.711871:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3c99 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.711927:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.711937:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 4/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c99 expref: 97 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.711955:0:5858:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.711968:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c99 expref: 97 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.711981:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:3.0:1787857803.711983:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857803.711988:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c99 expref: 97 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857803.711995:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72c00, rc 0) 00000100:00100000:3.0:1787857803.712058:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+97:29432:x1874704171705856:12345-192.168.204.36@tcp:101:diff.0 Request processed in 249us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857803.712064:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1145 00010000:00010000:1.0:1787857804.014410:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857804.143490:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188256000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857804.143578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857804.143672:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188256000 00000100:00100000:3.0:1787857804.143681:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188256000 00000100:00100000:3.0:1787857804.143737:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787857804.143747:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874704188256000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857804.143781:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857804.143867:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874704188256000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857804.143876:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787857804.144220:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188256000:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787857804.218744:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00000001:00080000:3.0:1787857804.218770:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00000040:00080000:2.0:1787857804.590112:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857804.590126:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857804.590174:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 4 00000040:00080000:2.0:1787857804.590186:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857804.590362:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b430c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188256128:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857804.590498:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857804.593325:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b430c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188256128:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857804.600021:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.600248:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171705984 00000100:00100000:2.0:1787857804.600259:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171705984 00000100:00100000:2.0:1787857804.600344:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1146 00000100:00100000:2.0:1787857804.600356:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29433:x1874704171705984:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857804.600398:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857804.600519:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29433:x1874704171705984:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 165us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.600547:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1146 00000100:00080000:3.0:1787857804.600764:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857804.614735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.614935:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171706112 00000100:00100000:2.0:1787857804.614946:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171706112 00000100:00100000:2.0:1787857804.615017:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1147 00000100:00100000:2.0:1787857804.615028:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29433:x1874704171706112:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787857804.615110:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615130:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615143:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615160:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615167:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615173:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615200:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615208:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615215:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857804.615258:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:2.0:1787857804.615263:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857804.615278:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615297:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615304:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615310:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615316:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857804.615321:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615327:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615338:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857804.615341:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857804.615346:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615352:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cbe6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615367:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615377:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615383:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615388:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857804.615391:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615397:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615404:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x329c2aeb (ffff9998c3379100) 00010000:00010000:2.0:1787857804.615407:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857804.615410:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615416:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cbed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615431:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615436:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615441:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615445:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857804.615449:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615453:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615460:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:2.0:1787857804.615462:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857804.615465:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.615470:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7cbf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857804.616015:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29433:x1874704171706112:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 984us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.616025:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1147 00000100:00100000:1.0:1787857804.621604:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.621738:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171706368 00000100:00100000:3.0:1787857804.621748:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171706368 00000100:00100000:1.0:1787857804.622006:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1148 00000100:00100000:1.0:1787857804.622022:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29433:x1874704171706368:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857804.622046:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857804.622069:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cbfb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ca0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622198:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622215:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622229:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857804.622242:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:1.0:1787857804.622371:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622379:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622385:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622392:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857804.622411:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622418:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622432:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:1.0:1787857804.622434:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857804.622438:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622445:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622490:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cbfb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ca0 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622500:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857804.622503:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857804.622506:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cbfb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ca0 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.622516:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052000, rc 0) 00000100:00100000:1.0:1787857804.622602:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:29433:x1874704171706368:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 585us (1011us total) trans 4294968052 rc 301/301 00000100:00100000:1.0:1787857804.622609:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1148 00000100:00100000:0.0:1787857804.627317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.627416:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171706496 00000100:00100000:2.0:1787857804.627426:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171706496 00000100:00100000:2.0:1787857804.627523:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1149 00000100:00100000:2.0:1787857804.627535:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:29433:x1874704171706496:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857804.627581:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857804.627794:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:29433:x1874704171706496:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 260us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.627802:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1149 00000100:00100000:2.0:1787857804.632130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.632807:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171706752 00000100:00100000:3.0:1787857804.633036:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171706752 00000100:00100000:3.0:1787857804.633239:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1150 00000100:00100000:3.0:1787857804.633261:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:29433:x1874704171706752:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857804.633286:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857804.633313:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ca7 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.634405:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cc17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.634435:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cc17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.634449:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cc17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857804.634462:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00010000:00010000:3.0:1787857804.634520:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ca7 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.634540:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cc17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ca7 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.634548:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998d12efd00) 00010000:00010000:3.0:1787857804.634551:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857804.634554:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72a00, rc 0) 00000100:00100000:3.0:1787857804.634634:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29433:x1874704171706752:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1384us (2515us total) trans 4294968053 rc 0/0 00000100:00100000:3.0:1787857804.634643:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1150 00000100:00100000:1.0:1787857804.638990:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.639263:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171707008 00000100:00100000:3.0:1787857804.639274:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171707008 00000100:00100000:3.0:1787857804.639352:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1151 00000100:00100000:3.0:1787857804.639362:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29433:x1874704171707008:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857804.639426:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857804.639452:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cc17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ca7 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.639491:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998d12efd00) 00010000:00010000:3.0:1787857804.639503:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857804.639526:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.639540:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.639548:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.639585:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.639599:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 96 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857804.639613:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c330c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188256256:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857804.639703:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c1254a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857804.643624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.644147:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c330c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188256256:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857804.644179:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857804.644569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171707136 00000100:00100000:2.0:1787857804.644578:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171707136 00010000:00010000:2.0:1787857804.644620:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 97 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857804.644652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 345 00000100:00100000:2.0:1787857804.644663:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+97:2349:x1874704171707136:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857804.644679:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857804.644686:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 97 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.644712:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 97 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.644737:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cb29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c5a expref: 97 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.644757:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:2.0:1787857804.644763:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.644774:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.644782:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.644813:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857804.644913:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+96:2349:x1874704171707136:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 251us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.644921:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 345 00010000:00010000:3.0:1787857804.645608:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.645617:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.645738:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.645749:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.645758:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646095:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646104:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646110:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646117:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857804.646121:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646130:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646143:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:3.0:1787857804.646147:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857804.646152:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646158:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646179:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646185:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646191:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646196:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857804.646199:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646205:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646213:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0xdc194118 (ffff9998d12efb00) 00010000:00010000:3.0:1787857804.646216:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857804.646219:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.646225:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0xdc194118 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857804.646313:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29433:x1874704171707008:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 6951us (7331us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857804.646322:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1151 00000100:00100000:0.0:1787857804.651531:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.651658:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171707264 00000100:00100000:2.0:1787857804.651670:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171707264 00000100:00100000:2.0:1787857804.652386:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1152 00000100:00100000:2.0:1787857804.652400:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29433:x1874704171707264:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857804.652425:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857804.652453:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cc33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cae expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.652495:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.652509:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.652521:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.652626:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cc33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 48 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.652646:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 47 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.652655:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:2.0:1787857804.652659:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857804.652662:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75600, rc 0) 00000100:00100000:2.0:1787857804.653093:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29433:x1874704171707264:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 694us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.653102:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1152 00000100:00100000:3.0:1787857804.656389:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857804.657472:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171707520 00000100:00100000:1.0:1787857804.657486:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171707520 00000100:00100000:1.0:1787857804.657561:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1153 00000100:00100000:1.0:1787857804.657589:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29433:x1874704171707520:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857804.657688:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.657773:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.657788:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857804.658057:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d19e544 reply state 00000000f00721b9 transno 4294968054 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857804.658067:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857804.658176:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29433:x1874704171707520:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 589us (1795us total) trans 4294968054 rc 0/0 00000100:00100000:1.0:1787857804.658183:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1153 00010000:00010000:3.0:1787857804.661993:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.662037:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.662045:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.662051:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857804.662056:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.662065:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.662086:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:3.0:1787857804.662089:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857804.662095:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.662101:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cc41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857804.662195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857804.662443:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171707648 00000100:00100000:0.0:1787857804.662455:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171707648 00000100:00100000:0.0:1787857804.662518:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1154 00000100:00100000:0.0:1787857804.662529:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29433:x1874704171707648:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857804.662553:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857804.662572:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cb5 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.662635:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.662650:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.662659:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:0.0:1787857804.662661:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857804.662664:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70c00, rc 0) 00000100:00100000:0.0:1787857804.663188:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29433:x1874704171707648:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 658us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857804.663197:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1154 00000100:00100000:1.0:1787857804.666675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.666990:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171707776 00000100:00100000:3.0:1787857804.667122:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171707776 00000100:00100000:2.0:1787857804.667283:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 226 00000100:00100000:2.0:1787857804.667305:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29433:x1874704171707776:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787857804.667456:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29433:x1874704171707776:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 162us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.667464:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 226 00000100:00100000:3.0:1787857804.670794:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857804.671293:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171708032 00000100:00100000:1.0:1787857804.671372:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171708032 00000100:00100000:1.0:1787857804.671437:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 227 00000100:00100000:1.0:1787857804.671449:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6121450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29433:x1874704171708032:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857804.671923:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6121450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29433:x1874704171708032:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 473us (1138us total) trans 4294968055 rc 0/0 00000100:00100000:1.0:1787857804.671933:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 227 00000100:00100000:3.0:1787857804.678102:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857804.678308:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171708288 00000100:00100000:0.0:1787857804.678319:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171708288 00000100:00100000:0.0:1787857804.678387:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1155 00000100:00100000:0.0:1787857804.678399:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29433:x1874704171708288:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857804.678524:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29433:x1874704171708288:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 127us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857804.678531:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1155 00000100:00100000:0.0:1787857804.682964:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857804.683079:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171708544 00000100:00100000:1.0:1787857804.683092:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171708544 00000100:00100000:1.0:1787857804.683186:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1156 00000100:00100000:1.0:1787857804.683198:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29433:x1874704171708544:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857804.683224:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857804.683251:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cc4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cbc expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.683364:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.683380:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.683389:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.683428:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.683442:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 51 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857804.683456:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188256384:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857804.683548:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7227900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857804.687436:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857804.687535:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171708672 00000100:00100000:0.0:1787857804.687545:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171708672 00010000:00010000:0.0:1787857804.687591:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 52 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857804.687633:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 346 00000100:00100000:0.0:1787857804.687644:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e72850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171708672:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857804.687663:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857804.687670:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 52 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.687685:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 52 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.687719:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:0.0:1787857804.687724:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.687734:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.687742:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.687764:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857804.687856:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e72850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171708672:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 214us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857804.687864:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 346 00010000:00010000:1.0:1787857804.688720:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cc48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cb5 expref: 51 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857804.688742:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188256384:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857804.688769:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.688794:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.688799:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857804.688869:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00000004:00080000:1.0:1787857804.689238:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:0.0:1787857804.690680:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691055:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691065:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691072:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857804.691077:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691085:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691103:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:0.0:1787857804.691106:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857804.691112:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691119:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7cc56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691188:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cc4f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cbc expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691206:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:0.0:1787857804.691209:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857804.691213:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cc4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cbc expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.691222:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:0.0:1787857804.695611:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29433:x1874704171708544:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 12387us (12631us total) trans 4294968056 rc 301/301 00000100:00100000:0.0:1787857804.695628:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1156 00000100:00100000:3.0:1787857804.699567:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857804.699634:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171708928 00000100:00100000:1.0:1787857804.699646:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171708928 00000100:00100000:1.0:1787857804.700082:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 228 00000100:00100000:1.0:1787857804.700096:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29433:x1874704171708928:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857804.701071:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:29433:x1874704171708928:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 974us (1510us total) trans 4294968057 rc 0/0 00000100:00100000:1.0:1787857804.701084:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 228 00000100:00100000:3.0:1787857804.704513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.707738:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171709056 00000100:00100000:2.0:1787857804.707756:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171709056 00000100:00100000:2.0:1787857804.707886:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1157 00000100:00100000:2.0:1787857804.707900:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:29433:x1874704171709056:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857804.707932:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857804.707956:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cc64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cc3 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.708058:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cc6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.708072:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.708086:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857804.708128:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00000004:00200000:2.0:1787857804.708133:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857804.708154:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.708180:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7cc64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cc3 expref: 53 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.708205:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cc6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cc3 expref: 52 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.708214:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:2.0:1787857804.708217:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787857804.708221:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75e00, rc 0) 00000100:00100000:2.0:1787857804.708305:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:29433:x1874704171709056:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 409us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.708312:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1157 00000100:00100000:3.0:1787857804.712139:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857804.712666:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171709184 00000100:00100000:1.0:1787857804.712678:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171709184 00000100:00100000:1.0:1787857804.712764:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 309 00000100:00100000:1.0:1787857804.712778:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171709184:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857804.712798:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857804.712839:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cca expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857804.712866:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857804.712900:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1787857804.712905:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857804.712927:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.712947:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.712960:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857804.713035:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171709184:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 262us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857804.713042:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 309 00000100:00080000:3.0:1787857804.715377:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857804.720054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.720219:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171709440 00000100:00100000:2.0:1787857804.720231:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171709440 00000100:00100000:2.0:1787857804.720296:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1158 00000100:00100000:2.0:1787857804.720307:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:29433:x1874704171709440:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857804.720429:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:29433:x1874704171709440:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 125us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.720437:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1158 00000100:00100000:1.0:1787857804.727340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857804.727421:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171709568 00000100:00100000:0.0:1787857804.727431:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171709568 00000100:00100000:0.0:1787857804.727501:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 310 00000100:00100000:0.0:1787857804.727515:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:29433:x1874704171709568:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857804.727539:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857804.727559:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cd1 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.727598:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.727608:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857804.727612:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857804.727619:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.727660:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.727674:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 12 pid: 6713 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857804.727690:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b00f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188256512:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857804.727794:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59480 going to sleep for 11 seconds 00000100:00100000:0.0:1787857804.733655:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b00f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188256512:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857804.733712:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.733737:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:0.0:1787857804.733804:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:29433:x1874704171709568:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6292us (6476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857804.733856:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 310 00000100:00100000:2.0:1787857804.736243:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857804.736400:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171709696 00000100:00100000:1.0:1787857804.736411:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171709696 00010000:00010000:1.0:1787857804.736460:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 12 pid: 6713 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857804.736502:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00100000:1.0:1787857804.736513:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171709696:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857804.736530:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857804.736555:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 12 pid: 6713 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.736568:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 12 pid: 6713 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.736593:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061222e9c/0xd3f183cab4a7cc72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cca expref: 12 pid: 6713 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.736629:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857804.736633:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857804.736642:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.736653:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.736704:0:17347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857804.736720:0:17347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17347:1874704188256640:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857804.736804:0:17347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085240 going to sleep for 11 seconds 00000100:00100000:1.0:1787857804.745202:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.745325:0:17347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17347:1874704188256640:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857804.745357:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857804.745427:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171709696:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 8914us (9195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857804.745439:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00100000:2.0:1787857804.746102:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171709824 00000100:00100000:2.0:1787857804.746111:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171709824 00002000:00100000:2.0:1787857804.746162:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x19:0x0] (0->157) req@ffff9997c5c6cf00 x1874704171709824/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:450/0 lens 648/0 e 0 to 0 dl 1787857815 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857804.746174:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5c6cf00 with x1874704171709824 ext(0->157) 00002000:00010000:2.0:1787857804.746178:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c5c6cf00 00000100:00100000:2.0:1787857804.746208:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 102 00000100:00100000:2.0:1787857804.746218:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171709824:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787857804.746870:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171709824:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 601us (1625us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787857804.746878:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 102 00002000:00100000:2.0:1787857804.746886:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x19:0x0] (0->157) req@ffff9997c5c6cf00 x1874704171709824/t4294967367(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:450/0 lens 648/448 e 0 to 0 dl 1787857815 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857804.746895:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5c6cf00 with x1874704171709824 ext(0->157) 00002000:00010000:2.0:1787857804.746899:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c5c6cf00 00000100:00100000:1.0:1787857804.752523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857804.752613:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171709952 00000100:00100000:0.0:1787857804.752623:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171709952 00000100:00100000:0.0:1787857804.752688:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1159 00000100:00100000:0.0:1787857804.752707:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:29433:x1874704171709952:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787857804.781484:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968057 is committed 00000020:00080000:0.0:1787857804.781510:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 23 batchid updated 00000020:00080000:1.0:1787857804.781647:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00000020:00080000:1.0:1787857804.781659:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00000100:00100000:1.0:1787857804.782641:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29433:x1874704171709952:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 29935us (30118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857804.782654:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1159 00000001:00080000:3.0:1787857804.782760:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968051 is committed 00000100:00100000:3.0:1787857804.786897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.787249:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171710080 00000100:00100000:2.0:1787857804.787259:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171710080 00000100:00100000:2.0:1787857804.787425:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 311 00000100:00100000:2.0:1787857804.787437:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171710080:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787857804.841034:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171710080:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 53589us (54136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857804.841049:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 311 00000001:00080000:1.0:1787857804.842722:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967367 is committed 00000100:00100000:0.0:1787857804.848034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.848237:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171710336 00000100:00100000:2.0:1787857804.848249:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171710336 00000100:00100000:2.0:1787857804.848339:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1160 00000100:00100000:2.0:1787857804.848353:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29433:x1874704171710336:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857804.848412:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857804.848440:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cc6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cc3 expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.848464:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:2.0:1787857804.848469:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857804.848500:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.848518:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.848528:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857804.848725:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007928cd60 reply state 000000009d0e76c1 transno 4294968058 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857804.848734:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857804.848893:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29433:x1874704171710336:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 542us (868us total) trans 4294968058 rc 0/0 00000100:00100000:2.0:1787857804.848901:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1160 00010000:00010000:2.0:1787857804.852495:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.852513:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.852522:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.852529:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857804.852533:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.852542:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.852560:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:2.0:1787857804.852563:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857804.852568:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.852574:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cc80 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857804.853654:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.853740:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171710464 00000100:00100000:3.0:1787857804.853751:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171710464 00000100:00100000:3.0:1787857804.853810:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1161 00000100:00100000:3.0:1787857804.853839:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29433:x1874704171710464:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857804.853869:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857804.853890:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cd8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.853949:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.853964:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.853983:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:3.0:1787857804.853987:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857804.853990:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73200, rc 0) 00000100:00100000:3.0:1787857804.854061:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29433:x1874704171710464:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 242us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857804.854069:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1161 00000100:00100000:3.0:1787857804.868242:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.868528:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171710592 00000100:00100000:2.0:1787857804.868540:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171710592 00000100:00100000:2.0:1787857804.868604:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 312 00000100:00100000:2.0:1787857804.868615:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171710592:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787857804.871222:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787857804.871233:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb mtime from disk: 0 -> 1787857800 00002000:00010000:2.0:1787857804.871235:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb atime from disk: 0 -> 1787857800 00002000:00010000:2.0:1787857804.871237:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb ctime from disk: 0 -> 1787857800 00002000:00010000:2.0:1787857804.871239:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787857804.871632:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171710592:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 3013us (3399us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1787857804.871643:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 312 00000100:00100000:1.0:1787857804.875493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.875560:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171710848 00000100:00100000:3.0:1787857804.875570:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171710848 00000100:00100000:3.0:1787857804.875682:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1162 00000100:00100000:3.0:1787857804.875704:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29433:x1874704171710848:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787857804.875780:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.875798:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 47 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.875984:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.876037:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 47 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.876054:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 47 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857804.876069:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c32580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188256768:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857804.876188:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857804.884758:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c32580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188256768:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857804.884791:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857804.886102:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857804.886525:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171710976 00000100:00100000:0.0:1787857804.886536:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171710976 00010000:00010000:0.0:1787857804.886593:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 48 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857804.886641:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 348 00000100:00100000:0.0:1787857804.886653:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171710976:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857804.886673:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857804.886681:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 48 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.887231:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 48 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.887261:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cc3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cae expref: 48 pid: 7656 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.887282:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:0.0:1787857804.888003:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.888017:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.888030:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.888071:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857804.888145:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2349:x1874704171710976:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1493us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857804.888156:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 348 00010000:00010000:3.0:1787857804.888905:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.888934:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.888965:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.888972:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.888979:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.888985:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857804.888990:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.889008:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.889024:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:3.0:1787857804.889027:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787857804.889031:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.889037:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cc8e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857804.889100:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29433:x1874704171710848:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 13408us (13617us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787857804.889109:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1162 00000100:00100000:1.0:1787857804.901549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857804.901645:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171711104 00000100:00100000:0.0:1787857804.901655:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171711104 00000100:00100000:0.0:1787857804.901728:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 313 00000100:00100000:0.0:1787857804.901739:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171711104:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857804.901795:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.901853:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.901864:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857804.901868:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857804.901873:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.901910:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.901924:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 12 pid: 6711 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857804.901953:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b00780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188256896:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857804.902230:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857804.907477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857804.907658:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171711232 00000100:00100000:1.0:1787857804.907699:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171711232 00010000:00010000:1.0:1787857804.907847:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 13 pid: 6711 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857804.907891:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 349 00000100:00100000:1.0:1787857804.907901:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171711232:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857804.907917:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857804.907948:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 13 pid: 6711 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.907964:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 13 pid: 6711 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.908001:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857804.908006:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857804.908012:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.908022:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.908045:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857804.908333:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7cc79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd1 expref: 13 pid: 6711 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857804.908354:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b00780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188256896:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857804.908376:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908387:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908394:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908419:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908428:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908435:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908442:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857804.908446:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908469:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908482:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.908492:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ca54ad/0xd3f183cab4a7cc95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857804.914395:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171711232:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 6482us (6915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.914411:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 349 00000100:00100000:2.0:1787857804.915075:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171711104:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 13335us (13534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857804.915085:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 313 00000100:00100000:0.0:1787857804.917665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.920196:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171711488 00000100:00100000:2.0:1787857804.920213:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171711488 00000100:00100000:2.0:1787857804.920299:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1163 00000100:00100000:2.0:1787857804.920314:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29433:x1874704171711488:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857804.920419:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.920440:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.920456:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.920736:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.920748:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.920758:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.920800:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.920975:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 47 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857804.921004:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b42580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188257024:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857804.921106:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857804.925193:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b42580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188257024:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857804.925230:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857804.928409:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857804.928950:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171711616 00000100:00100000:3.0:1787857804.928961:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171711616 00010000:00010000:3.0:1787857804.929015:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 48 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857804.929058:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 350 00000100:00100000:3.0:1787857804.929069:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171711616:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857804.929084:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857804.929090:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 48 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.929104:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 48 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.929128:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cc87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cd8 expref: 48 pid: 5856 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.929161:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:3.0:1787857804.929167:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.929176:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.929186:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.929221:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857804.929477:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2349:x1874704171711616:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 409us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857804.929485:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 350 00010000:00010000:2.0:1787857804.929572:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.929581:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857804.930074:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968059 00000004:02000000:2.0:1787857804.930221:0:19301:0:(mdd_object.c:3045:mdd_swap_layouts()) *** cfs_fail_loc=152, val=0*** 00000001:00080000:2.0:1787857804.939646:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968060 00010000:00010000:2.0:1787857804.941116:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941133:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941143:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941150:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857804.941155:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941163:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941181:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998c3379100) 00010000:00010000:2.0:1787857804.941184:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857804.941190:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941197:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cca3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941236:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941243:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941249:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941254:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857804.941257:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941263:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941271:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:2.0:1787857804.941273:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857804.941284:0:19301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c99 expref: 94 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941296:0:19301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c99 expref: 94 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941317:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c99 expref: 94 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.941367:0:19301:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c99 expref: 94 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857804.941387:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b42580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188257152:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857804.941498:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857804.946127:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.946214:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b42580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188257152:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857804.946247:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946258:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cbd8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946312:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946326:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946338:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946350:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946356:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946364:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946370:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857804.946374:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946381:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946393:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:2.0:1787857804.946395:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857804.946399:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946404:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ccaa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946415:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946421:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946426:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946431:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857804.946433:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946438:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946446:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:2.0:1787857804.946448:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857804.946451:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857804.946460:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cc9c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857804.947035:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29433:x1874704171711488:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 26720us (29379us total) trans 0 rc -95/-95 00000100:00100000:2.0:1787857804.947048:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1163 00000020:00080000:2.0:1787857804.947055:0:19301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787857804.947365:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857804.947370:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857804.948236:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787857804.948253:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857804.948410:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171711744 00000100:00100000:3.0:1787857804.948418:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171711744 00000100:00100000:3.0:1787857804.948469:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 229 00000100:00100000:3.0:1787857804.948478:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+95:29432:x1874704171711744:12345-192.168.204.36@tcp:49:diff.0 00000100:00100000:3.0:1787857804.948590:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+95:29432:x1874704171711744:12345-192.168.204.36@tcp:49:diff.0 Request processed in 113us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857804.948597:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 229 00000100:00100000:0.0:1787857804.958173:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857804.958221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857804.958315:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171712000 00000100:00100000:2.0:1787857804.958330:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171712000 00000100:00100000:2.0:1787857804.958392:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171712256 00000100:00100000:2.0:1787857804.958395:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171712256 00000100:00100000:2.0:1787857804.958417:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 230 00000100:00100000:2.0:1787857804.958428:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29433:x1874704171712000:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787857804.961130:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x21:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787857804.961556:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 64 off9376 00000004:00080000:3.0:1787857804.961621:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629011803624ns, next at 630011800232ns, rc = 0 00000001:00080000:3.0:1787857804.961632:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968061 00010000:00010000:3.0:1787857804.961939:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.961970:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.961985:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.962006:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.962013:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.962019:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857804.962081:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857804.962216:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29433:x1874704171712000:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 3784us (4048us total) trans 4294968062 rc 0/0 00000100:00100000:3.0:1787857804.962227:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 230 00000020:00080000:3.0:1787857804.962233:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787857804.962265:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 231 00000100:00100000:3.0:1787857804.962277:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29432:x1874704171712256:12345-192.168.204.36@tcp:35:diff.0 00000100:00100000:3.0:1787857804.962425:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+96:29432:x1874704171712256:12345-192.168.204.36@tcp:35:diff.0 Request processed in 152us (4203us total) trans 4294968063 rc 0/0 00000100:00100000:3.0:1787857804.962433:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 231 00010000:00010000:0.0:1787857804.971618:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857804.971636:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.971648:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857804.971653:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.971663:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.971684:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff9998d12ef200) 00010000:00010000:0.0:1787857804.971807:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857804.971999:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857804.972012:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7ccb1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857804.974152:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857804.974159:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857804.974161:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857805.038030:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857805.392375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857805.392417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857805.392448:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857805.392500:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857805.392531:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171712640 00000100:00100000:3.0:1787857805.392540:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171712640 00000100:00100000:3.0:1787857805.392597:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171712512 00000100:00100000:3.0:1787857805.392600:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171712512 00000100:00100000:3.0:1787857805.392619:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171712768 00000100:00100000:3.0:1787857805.392622:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171712768 00000100:00100000:3.0:1787857805.392639:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 426 00000100:00100000:3.0:1787857805.392650:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171712640:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857805.392723:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171712640:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 75us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.392731:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 426 00000100:00100000:3.0:1787857805.392751:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 427 00000100:00100000:3.0:1787857805.392758:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+15:2348:x1874704171712512:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857805.392783:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+15:2348:x1874704171712512:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.392790:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 427 00000100:00100000:3.0:1787857805.392803:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 428 00000100:00100000:3.0:1787857805.392809:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171712768:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857805.392862:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171712768:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 53us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.392869:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 428 00000100:00080000:3.0:1787857805.392887:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857805.392891:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857805.393196:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171712384 00000100:00100000:2.0:1787857805.393202:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171712384 00000100:00100000:2.0:1787857805.393244:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 575 00000100:00100000:2.0:1787857805.393252:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171712384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857805.393307:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171712384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 56us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857805.393314:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 575 00000100:00100000:3.0:1787857805.682529:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188257280:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.682594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857805.682639:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188257792:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.682663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857805.683372:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787857805.683382:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188257408:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.683416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857805.683441:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188257920:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.683465:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857805.683509:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c31680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188257536:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.683534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857805.683552:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857805.683557:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188257664:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.683578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857805.683609:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188257280 00000100:00100000:3.0:1787857805.683616:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188257280 00000100:00100000:3.0:1787857805.683662:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1787857805.683671:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188257280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.684172:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188257280:12345-0@lo:400:kworker.0 Request processed in 500us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.684180:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1787857805.684215:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188257792 00000100:00100000:3.0:1787857805.684219:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188257792 00000100:00100000:3.0:1787857805.684252:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188257408 00000100:00100000:3.0:1787857805.684255:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188257408 00000100:00100000:3.0:1787857805.684269:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188257536 00000100:00100000:3.0:1787857805.684282:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188257536 00000100:00100000:3.0:1787857805.684299:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1787857805.684305:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188257792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.684344:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188257792:12345-0@lo:400:kworker.0 Request processed in 39us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.684350:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1787857805.684361:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1787857805.684366:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188257408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.684389:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188257408:12345-0@lo:400:kworker.0 Request processed in 23us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.684394:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1787857805.684404:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1787857805.684409:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188257536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.684439:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188257536:12345-0@lo:400:kworker.0 Request processed in 29us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.684444:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1787857805.684465:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188257920 00000100:00100000:3.0:1787857805.684469:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188257920 00000100:00100000:3.0:1787857805.685374:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1787857805.685387:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188257920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.685436:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188257920:12345-0@lo:400:kworker.0 Request processed in 54us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.685442:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1787857805.685456:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188257664 00000100:00100000:3.0:1787857805.685460:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188257664 00000100:00100000:3.0:1787857805.685580:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1787857805.685587:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188257664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.685620:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188257664:12345-0@lo:400:kworker.0 Request processed in 34us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857805.685635:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00080000:3.0:1787857805.685666:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857805.685669:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857805.685672:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857805.685790:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967356 gen 2 00000004:00080000:3.0:1787857805.685796:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967355 committed transno 4294967356 00000004:00080000:3.0:1787857805.685831:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c5b403c0, transno 4294967356 00000100:00100000:3.0:1787857805.685845:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188257664:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.685861:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c31680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188257536:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.687248:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188257408:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.687267:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188257920:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.688089:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188257280:0@lo:400:kworker.0 00000100:00100000:3.0:1787857805.688106:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188257792:0@lo:400:kworker.0 00000040:00080000:3.0:1787857805.802342:0:20650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857805.802353:0:20650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857805.802439:0:20650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 4 00000040:00080000:3.0:1787857805.802445:0:20650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857806.063371:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787857806.190001:0:7958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630240181081ns, next at 631240178394ns, rc = 0 00000100:00100000:0.0:1787857806.190077:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188258048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857806.190161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857806.190442:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188258048 00000100:00100000:2.0:1787857806.190452:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188258048 00000100:00100000:2.0:1787857806.190506:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787857806.190516:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188258048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857806.190553:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857806.190611:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188258048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857806.190619:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787857806.190810:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188258048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857806.815807:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857806.815887:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171713024 00000100:00100000:1.0:1787857806.815904:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171713024 00000100:00100000:1.0:1787857806.815995:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1164 00000100:00100000:1.0:1787857806.816008:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+96:29454:x1874704171713024:12345-192.168.204.36@tcp:101:lfs.0 00000100:00080000:3.0:1787857806.816029:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857806.816033:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857806.816057:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ccb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cdf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816151:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816166:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816178:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816206:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816213:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816219:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816535:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cccd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816544:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816551:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857806.816567:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:1.0:1787857806.816665:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816673:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816680:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816686:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857806.816690:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816697:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816709:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857806.816712:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857806.816716:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816723:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ccbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816735:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816742:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816760:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816765:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857806.816768:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816774:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816784:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff9998e1a0c200) 00010000:00010000:1.0:1787857806.816786:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857806.816789:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816795:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7ccc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816882:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ccb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cdf expref: 99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816896:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cccd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cdf expref: 98 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857806.816904:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:1.0:1787857806.816906:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857806.816909:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857806.816991:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+98:29454:x1874704171713024:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 987us (1727us total) trans 4294968064 rc 0/0 00000100:00100000:1.0:1787857806.817021:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1164 00000100:00100000:3.0:1787857806.823222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857806.823372:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171713152 00000100:00100000:0.0:1787857806.823382:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171713152 00000100:00100000:0.0:1787857806.823444:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1165 00000100:00100000:0.0:1787857806.823454:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+98:29454:x1874704171713152:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:0.0:1787857806.823672:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.823692:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.823707:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.824006:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.824013:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.824019:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.824026:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857806.824030:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.824039:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.824053:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:0.0:1787857806.824128:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857806.824135:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857806.824142:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ccdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857806.825978:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+98:29454:x1874704171713152:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 2249us (2491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857806.825996:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1165 00000100:00100000:3.0:1787857806.837289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857806.838885:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171713408 00000100:00100000:2.0:1787857806.838900:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171713408 00000100:00100000:2.0:1787857806.838980:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00100000:2.0:1787857806.838991:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+98:29454:x1874704171713408:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1787857806.839243:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+99:29454:x1874704171713408:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 253us (1964us total) trans 4294968065 rc 0/0 00000100:00100000:2.0:1787857806.839251:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 232 00010000:00010000:1.0:1787857807.085989:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857808.110044:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857809.070290:0:20796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857809.070300:0:20796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857809.070329:0:20796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 4 00000040:00080000:1.0:1787857809.070336:0:20796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857809.134359:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857809.262769:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188258176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857809.262867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857809.262954:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188258176 00000100:00100000:0.0:1787857809.262961:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188258176 00000100:00100000:0.0:1787857809.263010:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787857809.263019:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188258176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857809.263051:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857809.263091:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188258176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857809.263097:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1787857809.263121:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857809.263156:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188258176:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787857809.841193:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968064 is committed 00000001:00080000:3.0:1787857809.841215:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968065 is committed 00000001:00080000:3.0:1787857809.841236:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968061 is committed 00000004:00080000:3.0:1787857809.841260:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 20 committed 00000001:00080000:3.0:1787857809.841284:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968062 is committed 00000004:00080000:3.0:1787857809.841287:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00000100:00100000:3.0:1787857809.841537:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188258304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787857809.841612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857809.843257:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188258304 00000100:00100000:1.0:1787857809.843270:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188258304 00000100:00100000:1.0:1787857809.843378:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787857809.843389:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188258304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787857809.843421:0:6714:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:25 count 1 00002000:00010000:1.0:1787857809.843457:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 158, mtime: 0x6a908b88, atime: 0x6a908b88, ctime: 0x6a908b88, blocks: 0xb 00010000:00010000:1.0:1787857809.843466:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857809.843484:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=633s v=(0 0) 00010000:00010000:1.0:1787857809.843489:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857809.843497:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857809.843512:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857809.843523:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857809.843550:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857809.843572:0:6714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857809.843771:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857809.843780:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857809.843790:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857809.843795:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857809.843805:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857809.843929:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857809.843945:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7cce2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857809.843967:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857809.843969:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857809.843971:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787857809.845125:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857809.846297:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188258304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2906us (4682us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787857809.846309:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000004:00080000:0.0:1787857809.847708:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c5c6e580/2, rc 0, transno 4294967369 00000100:00100000:0.0:1787857809.847721:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188258304:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787857810.161632:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857810.336244:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967369 is committed 00000001:00080000:1.0:1787857810.336264:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967368 is committed 00000100:00100000:3.0:1787857810.513463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857810.513517:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857810.513544:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171713536 00000100:00100000:0.0:1787857810.513556:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171713536 00000100:00100000:3.0:1787857810.513561:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857810.513601:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857810.513619:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 577 00000100:00100000:3.0:1787857810.513633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857810.513633:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171713536:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857810.513662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857810.513694:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171713792 00000100:00100000:1.0:1787857810.513700:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171713792 00000100:00100000:0.0:1787857810.513723:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171713536:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 94us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857810.513733:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 577 00000100:00100000:1.0:1787857810.513751:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171714304 00000100:00100000:1.0:1787857810.513755:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171714304 00000100:00100000:0.0:1787857810.513781:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171714048 00000100:00100000:1.0:1787857810.513785:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171713920 00000100:00100000:0.0:1787857810.513786:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171714048 00000100:00100000:1.0:1787857810.513790:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171713920 00000100:00100000:1.0:1787857810.513848:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 431 00000100:00100000:1.0:1787857810.513858:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2348:x1874704171713792:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857810.513858:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171713664 00000100:00100000:0.0:1787857810.513864:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171713664 00000100:00100000:0.0:1787857810.513913:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 429 00000100:00100000:0.0:1787857810.513921:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2348:x1874704171714048:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857810.513966:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2348:x1874704171714048:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 42us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857810.513969:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857810.513978:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 429 00000100:00100000:0.0:1787857810.513993:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 430 00000100:00100000:0.0:1787857810.513999:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:2348:x1874704171713664:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857810.514025:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:2348:x1874704171713664:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857810.514032:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 430 00000100:00100000:0.0:1787857810.514081:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171714176 00000100:00100000:0.0:1787857810.514085:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171714176 00000100:00100000:0.0:1787857810.514112:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 432 00000100:00100000:0.0:1787857810.514120:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171714304:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857810.514151:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171714304:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857810.514158:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 432 00000100:00100000:0.0:1787857810.514171:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 433 00000100:00100000:0.0:1787857810.514178:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171713920:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857810.514197:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171713920:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857810.514202:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 433 00000100:00100000:0.0:1787857810.514212:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 434 00000100:00100000:0.0:1787857810.514217:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171714176:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857810.514233:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171714176:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 17us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857810.514239:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 434 00000100:00080000:3.0:1787857810.514768:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857810.514775:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857810.514779:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857810.517199:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2348:x1874704171713792:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 3331us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857810.517214:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 431 00000100:00100000:2.0:1787857810.802508:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188258560:0@lo:400:kworker.0 00000100:00100000:2.0:1787857810.802585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857810.802645:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188259072:0@lo:400:kworker.0 00000100:00100000:2.0:1787857810.802673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857810.802701:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857810.802707:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188258688:0@lo:400:kworker.0 00000100:00100000:2.0:1787857810.802729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857810.802801:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188258816:0@lo:400:kworker.0 00000100:00100000:3.0:1787857810.802854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857810.802890:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787857810.802896:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188258432:0@lo:400:kworker.0 00000100:00100000:3.0:1787857810.802924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857810.802946:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188258944:0@lo:400:kworker.0 00000100:00100000:3.0:1787857810.802967:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857810.802994:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188258432 00000100:00100000:3.0:1787857810.803014:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188258432 00000100:00100000:3.0:1787857810.803057:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1787857810.803067:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188258432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857810.803122:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188258432:12345-0@lo:400:kworker.0 Request processed in 56us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857810.803130:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1787857810.803188:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188258432:0@lo:400:kworker.0 00000100:00100000:2.0:1787857810.803288:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188259072 00000100:00100000:2.0:1787857810.803293:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188259072 00000100:00100000:2.0:1787857810.803328:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188258816 00000100:00100000:2.0:1787857810.803331:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188258816 00000100:00100000:2.0:1787857810.803352:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1787857810.803358:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188259072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857810.803396:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188259072:12345-0@lo:400:kworker.0 Request processed in 38us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857810.803403:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1787857810.803418:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1787857810.803424:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188258816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857810.803456:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188258816:12345-0@lo:400:kworker.0 Request processed in 32us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857810.803463:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1787857810.803494:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188258816:0@lo:400:kworker.0 00000100:00100000:2.0:1787857810.803515:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:2.0:1787857810.803520:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c5c6e580, transno 4294967369 00000100:00100000:2.0:1787857810.803529:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188259072:0@lo:400:kworker.0 00000100:00100000:1.0:1787857810.803605:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188258560 00000100:00100000:1.0:1787857810.803610:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188258560 00000100:00100000:1.0:1787857810.803639:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188258688 00000100:00100000:1.0:1787857810.803642:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188258688 00000100:00100000:1.0:1787857810.803667:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188258944 00000100:00100000:1.0:1787857810.803670:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188258944 00000100:00100000:1.0:1787857810.803684:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1787857810.803691:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188258560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857810.803731:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188258560:12345-0@lo:400:kworker.0 Request processed in 40us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857810.803744:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1787857810.803758:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1787857810.803764:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188258688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857810.803792:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188258688:12345-0@lo:400:kworker.0 Request processed in 30us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857810.803798:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1787857810.803808:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1787857810.803813:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188258944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857810.803871:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188258944:12345-0@lo:400:kworker.0 Request processed in 58us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857810.803876:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00080000:1.0:1787857810.804262:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857810.804292:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188258944:0@lo:400:kworker.0 00000100:00100000:1.0:1787857810.804317:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188258688:0@lo:400:kworker.0 00000100:00100000:1.0:1787857810.804328:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188258560:0@lo:400:kworker.0 00010000:00010000:1.0:1787857811.181950:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857811.310100:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188259200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857811.310191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857811.310962:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188259200 00000100:00100000:2.0:1787857811.310972:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188259200 00000100:00100000:2.0:1787857811.311042:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787857811.311052:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188259200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857811.311089:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00080000:1.0:1787857811.311165:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857811.314472:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188259200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3412us (4272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857811.314481:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188259200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857811.314489:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00010000:2.0:1787857812.206172:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857813.166118:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857813.166130:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857813.166592:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 2 00000040:00080000:0.0:1787857813.166601:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857813.230314:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857814.253999:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857814.382840:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857814.382863:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188259328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857814.382931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857814.383625:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188259328 00000100:00100000:1.0:1787857814.383635:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188259328 00000100:00100000:1.0:1787857814.383703:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787857814.383713:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188259328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857814.383749:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857814.383849:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188259328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857814.383872:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1787857814.383899:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857814.389934:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188259328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857815.278035:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857815.634715:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857815.634761:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857815.634811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857815.634877:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857815.634899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857815.634918:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857815.634948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857815.634980:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171714688 00000100:00100000:0.0:1787857815.635000:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171714688 00000100:00100000:0.0:1787857815.635056:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171715200 00000100:00100000:0.0:1787857815.635059:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171715200 00000100:00100000:0.0:1787857815.635072:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171714816 00000100:00100000:0.0:1787857815.635075:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171714816 00000100:00100000:0.0:1787857815.635088:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171715072 00000100:00100000:0.0:1787857815.635090:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171715072 00000100:00100000:0.0:1787857815.635107:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 437 00000100:00100000:0.0:1787857815.635117:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171714688:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857815.635195:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171714688:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 79us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857815.635202:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 437 00000100:00100000:0.0:1787857815.635221:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 438 00000100:00100000:0.0:1787857815.635228:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171715200:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857815.635253:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171715200:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857815.635259:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 438 00000100:00100000:0.0:1787857815.635273:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 439 00000100:00100000:0.0:1787857815.635279:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171714816:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857815.635303:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2347:x1874704171714816:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857815.635308:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 439 00000100:00100000:0.0:1787857815.635319:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 440 00000100:00100000:0.0:1787857815.635325:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171715072:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857815.635348:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171715072:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857815.635354:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 440 00000100:00100000:0.0:1787857815.635372:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171714944 00000100:00100000:0.0:1787857815.635376:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171714944 00000100:00100000:0.0:1787857815.635407:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171714560 00000100:00100000:0.0:1787857815.635410:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171714560 00000100:00100000:0.0:1787857815.635429:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 434 00000100:00100000:0.0:1787857815.635435:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2347:x1874704171714944:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857815.635457:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171714432 00000100:00100000:3.0:1787857815.635463:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171714432 00000100:00100000:0.0:1787857815.635468:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2347:x1874704171714944:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857815.635475:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 434 00000100:00100000:3.0:1787857815.635510:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 579 00000100:00100000:3.0:1787857815.635518:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171714432:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857815.635546:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171714432:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857815.635553:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 579 00000100:00100000:2.0:1787857815.635891:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 435 00000100:00100000:2.0:1787857815.635901:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+96:2347:x1874704171714560:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857815.635933:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+96:2347:x1874704171714560:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 34us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857815.635960:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 435 00000100:00080000:2.0:1787857815.636094:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857815.636099:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857815.636101:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857815.918208:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188259712:0@lo:400:kworker.0 00000100:00100000:0.0:1787857815.918282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857815.918358:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787857815.918365:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188259584:0@lo:400:kworker.0 00000100:00100000:0.0:1787857815.918389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857815.918409:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188260096:0@lo:400:kworker.0 00000100:00100000:0.0:1787857815.918436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857815.918469:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188259712 00000100:00100000:0.0:1787857815.918476:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188259712 00000100:00100000:0.0:1787857815.918660:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188259584 00000100:00100000:0.0:1787857815.918665:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188259584 00000100:00100000:0.0:1787857815.918681:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1787857815.918688:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188259712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857815.918737:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188259712:12345-0@lo:400:kworker.0 Request processed in 48us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857815.918743:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1787857815.918761:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1787857815.918767:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188259584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857815.918803:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188259584:12345-0@lo:400:kworker.0 Request processed in 36us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857815.918808:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1787857815.919194:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188260096 00000100:00100000:1.0:1787857815.919199:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188260096 00000100:00100000:1.0:1787857815.919233:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1787857815.919242:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188260096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857815.919277:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188260096:12345-0@lo:400:kworker.0 Request processed in 37us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857815.919284:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1787857815.919338:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188259584:0@lo:400:kworker.0 00000100:00100000:1.0:1787857815.919350:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188260096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857815.919359:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188259712:0@lo:400:kworker.0 00000100:00100000:2.0:1787857815.920603:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188259456:0@lo:400:kworker.0 00000100:00100000:2.0:1787857815.920664:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857815.920702:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188259968:0@lo:400:kworker.0 00000100:00100000:2.0:1787857815.920729:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857815.920754:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857815.920761:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188259840:0@lo:400:kworker.0 00000100:00100000:2.0:1787857815.920805:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857815.921127:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188259840 00000100:00100000:3.0:1787857815.921134:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188259840 00000100:00100000:3.0:1787857815.921177:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1787857815.921187:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188259840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857815.921452:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188259968 00000100:00100000:0.0:1787857815.921458:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188259968 00000100:00100000:1.0:1787857815.921866:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188259456 00000100:00100000:1.0:1787857815.921872:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188259456 00000100:00100000:1.0:1787857815.921906:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1787857815.921913:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188259456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857815.922033:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1787857815.922042:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188259968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857815.925060:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188259840:12345-0@lo:400:kworker.0 Request processed in 3866us (4245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857815.925074:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00080000:3.0:1787857815.925143:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857815.925149:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857815.925309:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188259456:12345-0@lo:400:kworker.0 Request processed in 3395us (4643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857815.925329:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1787857815.925554:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188259840:0@lo:400:kworker.0 00000100:00100000:2.0:1787857815.925568:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188259456:0@lo:400:kworker.0 00000100:00100000:0.0:1787857815.925699:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188259968:12345-0@lo:400:kworker.0 Request processed in 3658us (4968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857815.925707:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1787857815.926182:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188259968:0@lo:400:kworker.0 00010000:00010000:2.0:1787857816.302637:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857816.431070:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857816.436456:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188260224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857816.436546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857816.437035:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188260224 00000100:00100000:1.0:1787857816.437044:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188260224 00000100:00100000:1.0:1787857816.437235:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787857816.437247:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188260224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857816.437383:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857816.437464:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188260224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 219us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857816.437472:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787857816.437544:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188260224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857817.326059:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857818.350033:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857819.374060:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857819.502272:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857819.502298:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188260352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857819.502384:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857819.502526:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188260352 00000100:00100000:3.0:1787857819.502534:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188260352 00000100:00100000:3.0:1787857819.502608:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787857819.502619:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188260352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857819.502669:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00080000:1.0:1787857819.502687:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857819.502735:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188260352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857819.502745:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787857819.502786:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188260352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857820.398269:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857820.758092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857820.758148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857820.758180:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857820.758210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857820.758236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857820.758901:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171715328 00000100:00100000:2.0:1787857820.758913:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171715328 00000100:00100000:2.0:1787857820.758983:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 581 00000100:00100000:2.0:1787857820.758995:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171715328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857820.759174:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171715584 00000100:00100000:1.0:1787857820.759201:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171715584 00000100:00100000:1.0:1787857820.759245:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171716096 00000100:00100000:1.0:1787857820.759248:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171716096 00000100:00100000:1.0:1787857820.759269:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 443 00000100:00100000:1.0:1787857820.759277:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171715584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857820.759345:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171715584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 69us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857820.759353:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 443 00000100:00100000:1.0:1787857820.759370:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 444 00000100:00100000:1.0:1787857820.759377:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171716096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857820.759402:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171716096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857820.759409:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 444 00000100:00080000:1.0:1787857820.759429:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857820.759432:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857820.760141:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171715328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1146us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857820.760151:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 581 00000100:00100000:3.0:1787857820.760296:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171715456 00000100:00100000:3.0:1787857820.760302:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171715456 00000100:00100000:3.0:1787857820.760360:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171715840 00000100:00100000:3.0:1787857820.760364:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171715840 00000100:00100000:3.0:1787857820.760385:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 439 00000100:00100000:3.0:1787857820.760391:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:2350:x1874704171715456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857820.760425:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:2350:x1874704171715456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 34us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857820.760432:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 439 00000100:00100000:3.0:1787857820.760445:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 440 00000100:00100000:3.0:1787857820.760450:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171715840:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857820.760473:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171715840:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857820.760480:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 440 00000100:00080000:1.0:1787857820.760556:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857820.776950:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857820.776996:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857820.780541:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171715712 00000100:00100000:1.0:1787857820.780559:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171715712 00000100:00100000:1.0:1787857820.780955:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 445 00000100:00100000:1.0:1787857820.780993:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171715712:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857820.781884:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171715712:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 902us (4941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857820.781894:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 445 00000100:00100000:1.0:1787857820.781920:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171715968 00000100:00100000:1.0:1787857820.781925:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171715968 00000100:00100000:1.0:1787857820.781960:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 446 00000100:00100000:1.0:1787857820.781967:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171715968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857820.782008:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171715968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (5012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857820.782014:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 446 00000100:00080000:2.0:1787857820.782641:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857820.782655:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857821.038105:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901223c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188260736:0@lo:400:kworker.0 00000100:00100000:0.0:1787857821.038192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857821.038258:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787857821.038265:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901221a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188260608:0@lo:400:kworker.0 00000100:00100000:0.0:1787857821.038291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857821.038306:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188261120:0@lo:400:kworker.0 00000100:00100000:2.0:1787857821.038307:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188260736 00000100:00100000:2.0:1787857821.038315:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188260736 00000100:00100000:0.0:1787857821.038328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787857821.038357:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857821.038367:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188260608 00000100:00100000:2.0:1787857821.038370:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188260608 00000100:00100000:2.0:1787857821.038403:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1787857821.038413:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188260736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857821.038421:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188260864:0@lo:400:kworker.0 00000100:00100000:3.0:1787857821.038450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857821.038462:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188260736:12345-0@lo:400:kworker.0 Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.038481:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857821.038482:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1787857821.038487:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188260480:0@lo:400:kworker.0 00000100:00100000:2.0:1787857821.038501:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1787857821.038507:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188260608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857821.038514:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857821.038535:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188260608:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.038537:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188260992:0@lo:400:kworker.0 00000100:00100000:2.0:1787857821.038541:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1787857821.038558:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857821.038567:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188261120 00000100:00100000:2.0:1787857821.038570:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188261120 00000100:00100000:2.0:1787857821.038598:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188260864 00000100:00100000:2.0:1787857821.038601:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188260864 00000100:00100000:3.0:1787857821.038605:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188260480 00000100:00100000:3.0:1787857821.038609:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188260480 00000100:00100000:2.0:1787857821.038619:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1787857821.038624:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188261120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857821.038632:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1787857821.038638:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188260480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857821.038655:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188261120:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.038662:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1787857821.038665:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188260480:12345-0@lo:400:kworker.0 Request processed in 28us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.038671:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1787857821.038673:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1787857821.038677:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188260864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857821.038709:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188260992 00000100:00100000:3.0:1787857821.038713:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188260992 00000100:00100000:2.0:1787857821.038716:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188260864:12345-0@lo:400:kworker.0 Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.038722:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00080000:2.0:1787857821.038734:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857821.038735:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00080000:2.0:1787857821.038737:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857821.038739:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857821.038741:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188260992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857821.038769:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188260992:12345-0@lo:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.038775:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1787857821.038791:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188260480:0@lo:400:kworker.0 00000100:00100000:2.0:1787857821.038804:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188260992:0@lo:400:kworker.0 00000100:00100000:2.0:1787857821.038813:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188260864:0@lo:400:kworker.0 00000100:00100000:0.0:1787857821.039000:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901221a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188260608:0@lo:400:kworker.0 00000100:00100000:0.0:1787857821.039009:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188261120:0@lo:400:kworker.0 00000100:00100000:0.0:1787857821.039018:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901223c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188260736:0@lo:400:kworker.0 00000100:00100000:0.0:1787857821.146756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.146920:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171716352 00000100:00100000:2.0:1787857821.146935:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171716352 00000100:00100000:2.0:1787857821.147101:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1166 00000100:00100000:2.0:1787857821.147114:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:29499:x1874704171716352:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:2.0:1787857821.147149:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857821.147181:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ce6 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.147674:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7ccf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.147711:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7ccf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.147733:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7ccf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857821.147747:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:2.0:1787857821.148460:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ce6 expref: 99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.148566:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7ccf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ce6 expref: 98 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.148577:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:2.0:1787857821.148580:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857821.148586:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75000, rc 0) 00000100:00100000:2.0:1787857821.150110:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+98:29499:x1874704171716352:12345-192.168.204.36@tcp:101:diff.0 Request processed in 2983us (3356us total) trans 4294968066 rc 0/0 00000100:00100000:2.0:1787857821.150128:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1166 00000100:00100000:1.0:1787857821.156124:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.156252:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171716608 00000100:00100000:2.0:1787857821.156300:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171716608 00000100:00100000:2.0:1787857821.156401:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:2.0:1787857821.156419:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+98:29499:x1874704171716608:12345-192.168.204.36@tcp:103:diff.0 00010000:00010000:2.0:1787857821.156442:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787857821.156497:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7ccf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ce6 expref: 98 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.156528:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cccd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cdf expref: 97 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.156560:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cbdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c99 expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.156573:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998e1a0c500) 00010000:00010000:2.0:1787857821.156588:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857821.156671:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29499:x1874704171716608:12345-192.168.204.36@tcp:103:diff.0 Request processed in 259us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.156692:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:0.0:1787857821.163298:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.163765:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171716736 00000100:00100000:2.0:1787857821.163780:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171716736 00000100:00100000:2.0:1787857821.164089:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1167 00000100:00100000:2.0:1787857821.164104:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29499:x1874704171716736:12345-192.168.204.36@tcp:58:diff.0 00010000:00010000:2.0:1787857821.164314:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.164339:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.164354:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857821.164880:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 136 off12680 00000100:00100000:2.0:1787857821.165023:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29499:x1874704171716736:12345-192.168.204.36@tcp:58:diff.0 Request processed in 919us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.165033:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1167 00000100:00100000:0.0:1787857821.168782:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.169281:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171716864 00000100:00100000:2.0:1787857821.169298:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171716864 00000100:00100000:2.0:1787857821.169434:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1168 00000100:00100000:2.0:1787857821.169447:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29499:x1874704171716864:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:2.0:1787857821.169486:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857821.169518:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cd05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ced expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.169612:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.169625:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cd05 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ced expref: 96 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.169650:0:5856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.169666:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cd05 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ced expref: 96 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.169693:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379500) 00010000:00010000:2.0:1787857821.169696:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857821.169701:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cd05 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ced expref: 96 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.169709:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74800, rc 0) 00000100:00100000:2.0:1787857821.169799:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+96:29499:x1874704171716864:12345-192.168.204.36@tcp:101:diff.0 Request processed in 355us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.169807:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1168 00000040:00080000:0.0:1787857821.358149:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857821.358163:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857821.358233:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 3 00000040:00080000:0.0:1787857821.358244:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857821.358432:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa2d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188261248:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857821.358586:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857821.366995:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.367199:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa2d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188261248:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857821.367607:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171716992 00000100:00100000:3.0:1787857821.367616:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171716992 00000100:00100000:3.0:1787857821.367703:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1169 00000100:00100000:3.0:1787857821.367715:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29500:x1874704171716992:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857821.367761:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857821.368058:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29500:x1874704171716992:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 344us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.368068:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1169 00000100:00100000:3.0:1787857821.376116:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857821.376247:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171717120 00000100:00100000:0.0:1787857821.376261:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171717120 00000100:00100000:0.0:1787857821.376356:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1170 00000100:00100000:0.0:1787857821.376369:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29500:x1874704171717120:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787857821.376475:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376500:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376516:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376536:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376543:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376549:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376596:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376604:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376610:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857821.376662:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:0.0:1787857821.376667:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857821.376695:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376710:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.376717:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377190:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377198:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857821.377202:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377211:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377230:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:0.0:1787857821.377234:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857821.377240:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377247:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cd0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377266:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377272:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377278:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377282:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857821.377284:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377294:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377301:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x329c2aeb (ffff9997c3d03800) 00010000:00010000:0.0:1787857821.377303:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857821.377411:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377419:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cd13 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377443:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377449:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377456:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377462:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857821.377465:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377471:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377479:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379500) 00010000:00010000:0.0:1787857821.377481:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857821.377485:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.377494:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7cd1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857821.377739:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29500:x1874704171717120:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 1358us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857821.377750:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1170 00000100:00100000:3.0:1787857821.386356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857821.389197:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171717376 00000100:00100000:0.0:1787857821.389216:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171717376 00000100:00100000:0.0:1787857821.389326:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1171 00000100:00100000:0.0:1787857821.389339:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29500:x1874704171717376:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857821.389369:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857821.389409:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cf4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.389546:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.389740:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.389755:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857821.389777:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:0.0:1787857821.389925:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.389934:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.389946:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.389952:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857821.389957:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.389966:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.390091:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379500) 00010000:00010000:0.0:1787857821.390094:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857821.390100:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.390107:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.390158:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd21 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cf4 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.390168:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:0.0:1787857821.390171:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857821.390175:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cf4 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.390185:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857821.390268:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:29500:x1874704171717376:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 933us (3929us total) trans 4294968067 rc 301/301 00000100:00100000:0.0:1787857821.390281:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1171 00000100:00100000:3.0:1787857821.399737:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.399975:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171717504 00000100:00100000:3.0:1787857821.399989:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171717504 00000100:00100000:3.0:1787857821.400101:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1172 00000100:00100000:3.0:1787857821.400115:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:29500:x1874704171717504:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857821.400177:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857821.400327:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:29500:x1874704171717504:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 215us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.400337:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1172 00000100:00100000:1.0:1787857821.411727:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.412897:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171717760 00000100:00100000:1.0:1787857821.412913:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171717760 00000100:00100000:1.0:1787857821.412988:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1173 00000100:00100000:1.0:1787857821.412998:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:29500:x1874704171717760:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857821.413023:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857821.413049:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3cfb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.415545:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cd3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.417103:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cd3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.417142:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cd3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857821.417164:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00010000:00010000:1.0:1787857821.418122:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cfb expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.418158:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cd3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cfb expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.418169:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:1.0:1787857821.418173:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857821.418243:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052000, rc 0) 00000100:00100000:1.0:1787857821.418357:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29500:x1874704171717760:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 5359us (6640us total) trans 4294968068 rc 0/0 00000100:00100000:1.0:1787857821.418370:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1173 00000100:00100000:3.0:1787857821.423386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.423501:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171718016 00000100:00100000:1.0:1787857821.423516:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171718016 00000100:00100000:1.0:1787857821.423614:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1174 00000100:00100000:1.0:1787857821.423628:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29500:x1874704171718016:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857821.423724:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857821.423780:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cd3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3cfb expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.423802:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:1.0:1787857821.423844:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857821.423895:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.423912:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.423924:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.423940:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.423947:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.423954:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424297:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424307:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424313:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424319:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857821.424325:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424333:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424353:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857821.424356:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857821.424361:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424368:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424379:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424385:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424391:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424396:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857821.424399:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424405:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424412:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x6ece2955 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857821.424414:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857821.424417:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.424422:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x6ece2955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857821.424547:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29500:x1874704171718016:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 922us (1176us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857821.424555:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1174 00010000:00010000:0.0:1787857821.431464:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857821.438473:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.438713:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171718144 00000100:00100000:1.0:1787857821.438728:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171718144 00000100:00100000:1.0:1787857821.438961:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1175 00000100:00100000:1.0:1787857821.438979:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29500:x1874704171718144:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857821.439009:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857821.439040:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d02 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.439089:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.439108:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.439126:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.439264:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.439287:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.439298:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857821.439314:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857821.439319:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053c00, rc 0) 00000100:00100000:1.0:1787857821.439393:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29500:x1874704171718144:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 422us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857821.439402:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1175 00000100:00100000:3.0:1787857821.449645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857821.453170:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171718400 00000100:00100000:0.0:1787857821.453187:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171718400 00000100:00100000:0.0:1787857821.453305:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1176 00000100:00100000:0.0:1787857821.453318:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29500:x1874704171718400:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857821.453411:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.453430:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.453444:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857821.456727:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0c82053 reply state 00000000c5d25104 transno 4294968069 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857821.456812:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857821.456990:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29500:x1874704171718400:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 3671us (7349us total) trans 4294968069 rc 0/0 00000100:00100000:0.0:1787857821.457000:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1176 00010000:00010000:0.0:1787857821.459974:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.459993:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.460001:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.460011:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857821.460017:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.460026:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.460048:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857821.460052:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787857821.460057:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.460064:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cd67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.466577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857821.467906:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171718528 00000100:00100000:0.0:1787857821.467921:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171718528 00000100:00100000:0.0:1787857821.468010:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1177 00000100:00100000:0.0:1787857821.468023:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:29500:x1874704171718528:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857821.468056:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857821.468084:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d09 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.468154:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 49 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.468172:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 49 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.468188:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857821.468191:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857821.468196:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857821.468264:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29500:x1874704171718528:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 245us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857821.468271:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1177 00000100:00100000:3.0:1787857821.474652:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.475007:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171718656 00000100:00100000:3.0:1787857821.475022:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171718656 00000100:00100000:3.0:1787857821.475102:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:3.0:1787857821.475116:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6120050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29500:x1874704171718656:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787857821.475340:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6120050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29500:x1874704171718656:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 224us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.475350:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:0.0:1787857821.485798:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.486002:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171718912 00000100:00100000:3.0:1787857821.486013:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171718912 00000100:00100000:3.0:1787857821.486117:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 234 00000100:00100000:3.0:1787857821.486130:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:29500:x1874704171718912:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857821.486393:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29500:x1874704171718912:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 265us (605us total) trans 4294968070 rc 0/0 00000100:00100000:3.0:1787857821.486401:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 234 00000100:00100000:0.0:1787857821.491795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.491911:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171719168 00000100:00100000:1.0:1787857821.491925:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171719168 00000100:00100000:1.0:1787857821.491989:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1178 00000100:00100000:1.0:1787857821.492000:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29500:x1874704171719168:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857821.492142:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29500:x1874704171719168:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 143us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857821.492150:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1178 00000100:00100000:0.0:1787857821.497451:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.497596:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171719424 00000100:00100000:1.0:1787857821.497610:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171719424 00000100:00100000:1.0:1787857821.497707:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1179 00000100:00100000:1.0:1787857821.497718:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29500:x1874704171719424:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857821.497748:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857821.497777:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.497976:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.497994:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 51 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.498004:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.498066:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 51 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.498083:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 51 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857821.498101:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188261376:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857821.498271:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857821.504908:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.505746:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188261376:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857821.505788:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.506015:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171719552 00000100:00100000:3.0:1787857821.506024:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171719552 00010000:00010000:3.0:1787857821.506080:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 52 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.506124:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 351 00000100:00100000:3.0:1787857821.506135:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171719552:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857821.506155:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857821.506165:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 52 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.506192:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 52 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.506225:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cd6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d09 expref: 52 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.506242:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857821.506248:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.506260:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.506270:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.506293:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857821.506369:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171719552:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 234us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.506389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 351 00010000:00010000:1.0:1787857821.507164:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.507191:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857821.507216:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00000004:00080000:1.0:1787857821.507859:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:1.0:1787857821.508059:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.508085:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.508095:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.508121:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857821.508126:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.508134:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.508151:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857821.508154:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857821.508160:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.508166:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052a00/0xd3f183cab4a7cd7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.510033:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd75 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d10 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.510059:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9998e1a0c700) 00010000:00010000:1.0:1787857821.510063:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857821.510069:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cd75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d10 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.510086:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053a00, rc 0) 00000100:00100000:1.0:1787857821.511293:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29500:x1874704171719424:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 13564us (13855us total) trans 4294968071 rc 301/301 00000100:00100000:1.0:1787857821.511308:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1179 00000100:00100000:3.0:1787857821.516076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.516444:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171719808 00000100:00100000:2.0:1787857821.516459:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171719808 00000100:00100000:3.0:1787857821.516594:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 235 00000100:00100000:3.0:1787857821.516613:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:29500:x1874704171719808:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857821.517315:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:29500:x1874704171719808:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 698us (1242us total) trans 4294968072 rc 0/0 00000100:00100000:3.0:1787857821.523688:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 235 00000100:00100000:3.0:1787857821.526240:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.526389:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171719936 00000100:00100000:2.0:1787857821.526403:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171719936 00000100:00100000:2.0:1787857821.526482:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1180 00000100:00100000:2.0:1787857821.526496:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:29500:x1874704171719936:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857821.526536:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857821.526576:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cd8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d17 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.526699:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cd91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.526719:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cd91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.526734:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cd91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857821.526782:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00000004:00200000:2.0:1787857821.526788:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857821.526962:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cd91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.526997:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cd8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d17 expref: 53 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.527014:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cd91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d17 expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.527029:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857821.527032:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787857821.527038:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74a00, rc 0) 00000100:00100000:2.0:1787857821.527120:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:29500:x1874704171719936:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 628us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.527128:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1180 00000100:00100000:3.0:1787857821.530546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.530650:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171720064 00000100:00100000:2.0:1787857821.530662:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171720064 00000100:00100000:2.0:1787857821.530742:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 315 00000100:00100000:2.0:1787857821.530752:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171720064:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857821.530775:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857821.530812:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d1e expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857821.530887:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857821.530915:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=645s v=(0 0) 00010000:00010000:2.0:1787857821.530920:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857821.530930:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.530952:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.530968:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75200, rc 0) 00000100:00100000:2.0:1787857821.531047:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171720064:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 296us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.531054:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 315 00000100:00100000:3.0:1787857821.539841:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.539899:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171720320 00000100:00100000:3.0:1787857821.539913:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171720320 00000100:00100000:3.0:1787857821.539994:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1181 00000100:00100000:3.0:1787857821.540007:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:29500:x1874704171720320:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857821.540164:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:29500:x1874704171720320:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.540172:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1181 00000100:00100000:3.0:1787857821.546334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.546881:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171720448 00000100:00100000:2.0:1787857821.546894:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171720448 00000100:00100000:2.0:1787857821.546972:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 316 00000100:00100000:2.0:1787857821.546984:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:29500:x1874704171720448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857821.547008:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857821.547032:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d25 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.547074:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.547085:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857821.547091:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857821.547098:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.547145:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.547161:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 10 pid: 8490 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857821.547178:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b403c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188261504:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857821.547924:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c85c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857821.550785:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188261632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857821.550901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857821.550982:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188261632 00000100:00100000:2.0:1787857821.550992:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188261632 00000100:00100000:2.0:1787857821.551054:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787857821.551064:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188261632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857821.551114:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857821.551168:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188261632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.551176:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787857821.551239:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188261632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857821.558613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.558662:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171720576 00000100:00100000:2.0:1787857821.558682:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171720576 00010000:00010000:2.0:1787857821.558740:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 11 pid: 8490 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857821.558889:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 352 00000100:00100000:2.0:1787857821.558902:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171720576:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857821.558925:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857821.558957:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 11 pid: 8490 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.558976:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 11 pid: 8490 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.559014:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857821.559019:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857821.559030:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.559041:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.559090:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857821.559108:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b40780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188261760:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857821.559209:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b840c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787857821.559524:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007325aeeb/0xd3f183cab4a7cd98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d1e expref: 11 pid: 8490 timeout: 745 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.559539:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b403c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188261504:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857821.559569:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.559606:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74400, rc 0) 00000100:00100000:3.0:1787857821.559645:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:29500:x1874704171720448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 12664us (13327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.559654:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 316 00000100:00100000:3.0:1787857821.572716:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857821.573237:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b40780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188261760:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857821.573282:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857821.573363:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171720576:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 14464us (14762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857821.573387:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 352 00000100:00100000:1.0:1787857821.573559:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171720704 00000100:00100000:1.0:1787857821.573588:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171720704 00002000:00100000:1.0:1787857821.573656:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (0->157) req@ffff9997c5c6c780 x1874704171720704/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:467/0 lens 648/0 e 0 to 0 dl 1787857832 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857821.573668:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5c6c780 with x1874704171720704 ext(0->157) 00002000:00010000:1.0:1787857821.573686:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c5c6c780 00000100:00100000:1.0:1787857821.573718:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:1.0:1787857821.573728:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171720704:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787857821.574409:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171720704:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 678us (1706us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1787857821.574418:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 103 00002000:00100000:1.0:1787857821.574426:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (0->157) req@ffff9997c5c6c780 x1874704171720704/t4294967357(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:467/0 lens 648/448 e 0 to 0 dl 1787857832 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857821.574435:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5c6c780 with x1874704171720704 ext(0->157) 00002000:00010000:1.0:1787857821.574439:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c5c6c780 00000100:00100000:1.0:1787857821.596865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.596921:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171720832 00000100:00100000:1.0:1787857821.596934:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171720832 00000100:00100000:1.0:1787857821.597012:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1182 00000100:00100000:1.0:1787857821.597023:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:29500:x1874704171720832:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787857821.690637:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968069 is committed 00000001:00080000:1.0:1787857821.690677:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968071 is committed 00000001:00080000:1.0:1787857821.690695:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968066 is committed 00000001:00080000:1.0:1787857821.690703:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968072 is committed 00000100:00100000:3.0:1787857821.701111:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29500:x1874704171720832:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 104073us (104242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.701131:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1182 00000100:00100000:3.0:1787857821.705794:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.705891:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171720960 00000100:00100000:1.0:1787857821.705906:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171720960 00000100:00100000:1.0:1787857821.706007:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 317 00000100:00100000:1.0:1787857821.706020:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171720960:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787857821.782148:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00000100:00100000:1.0:1787857821.784544:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171720960:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 78511us (78750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857821.784576:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 317 00000100:00100000:0.0:1787857821.794196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857821.795124:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171721216 00000100:00100000:0.0:1787857821.795137:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171721216 00000100:00100000:0.0:1787857821.795214:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1183 00000100:00100000:0.0:1787857821.795230:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29500:x1874704171721216:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857821.795284:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857821.795310:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7cd91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d17 expref: 46 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.795335:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857821.795340:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857821.795372:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.795400:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.795411:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857821.795941:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9187c1a reply state 000000000558da65 transno 4294968073 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857821.795952:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857821.798432:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29500:x1874704171721216:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 3195us (4237us total) trans 4294968073 rc 0/0 00000100:00100000:0.0:1787857821.798459:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1183 00000100:00100000:3.0:1787857821.802180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857821.802226:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802242:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802251:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802258:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857821.802263:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802272:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802294:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857821.802306:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857821.802314:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802322:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cda6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.802376:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171721344 00000100:00100000:3.0:1787857821.802388:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171721344 00000100:00100000:3.0:1787857821.802463:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1184 00000100:00100000:3.0:1787857821.802475:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29500:x1874704171721344:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857821.802507:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857821.802531:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d2c expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802611:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802631:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.802653:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857821.802656:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857821.802659:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72a00, rc 0) 00000100:00100000:3.0:1787857821.802757:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29500:x1874704171721344:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 283us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.802767:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1184 00000100:00100000:3.0:1787857821.811172:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.811224:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171721472 00000100:00100000:3.0:1787857821.811243:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171721472 00000100:00100000:3.0:1787857821.811295:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:3.0:1787857821.811305:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171721472:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787857821.811593:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787857821.811597:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb mtime from disk: 0 -> 1787857800 00002000:00010000:3.0:1787857821.811599:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb atime from disk: 0 -> 1787857800 00002000:00010000:3.0:1787857821.811602:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb ctime from disk: 0 -> 1787857800 00002000:00010000:3.0:1787857821.811726:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787857821.811785:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171721472:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 481us (623us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1787857821.811794:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:2.0:1787857821.817220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.818071:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171721728 00000100:00100000:2.0:1787857821.818087:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171721728 00000100:00100000:2.0:1787857821.818182:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1185 00000100:00100000:2.0:1787857821.818198:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:29500:x1874704171721728:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787857821.818688:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.818713:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.818724:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.818772:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.818790:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 47 pid: 5856 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857821.818809:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b40f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188261888:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857821.818991:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857821.832199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.832259:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b40f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188261888:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857821.832293:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.832373:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171721856 00000100:00100000:3.0:1787857821.832381:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171721856 00010000:00010000:3.0:1787857821.832425:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 48 pid: 5856 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.832463:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 353 00000100:00100000:3.0:1787857821.832475:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2350:x1874704171721856:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857821.832490:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857821.832507:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 48 pid: 5856 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.832564:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 48 pid: 5856 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.832595:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cd60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d02 expref: 48 pid: 5856 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.833863:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857821.833875:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.833887:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.833895:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.833927:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857821.833999:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171721856:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1522us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.834011:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 353 00010000:00010000:3.0:1787857821.834171:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.834180:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.834214:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.834236:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.834244:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.834251:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857821.834256:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.834264:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.834276:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857821.834279:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787857821.834285:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.834291:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7cdb4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.834347:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29500:x1874704171721728:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 16154us (17146us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787857821.834357:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1185 00000100:00100000:3.0:1787857821.842321:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.842531:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171721984 00000100:00100000:2.0:1787857821.842545:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171721984 00000100:00100000:2.0:1787857821.842621:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00100000:2.0:1787857821.842638:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171721984:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857821.842720:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.842795:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.842807:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857821.842855:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857821.842863:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.842927:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.842953:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 10 pid: 6714 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857821.842979:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188262016:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857821.843118:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857821.849900:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857821.849943:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171722112 00000100:00100000:0.0:1787857821.849954:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171722112 00010000:00010000:0.0:1787857821.850019:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 11 pid: 6714 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857821.850065:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 354 00000100:00100000:0.0:1787857821.850076:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171722112:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857821.850095:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857821.850124:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 11 pid: 6714 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.850140:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 11 pid: 6714 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.850177:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857821.850183:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857821.850189:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.850201:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.850229:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857821.850316:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171722112:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 241us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857821.850323:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 354 00010000:00010000:3.0:1787857821.852014:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7cd9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d25 expref: 10 pid: 6714 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.852041:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188262016:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857821.852085:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852101:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852109:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852157:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852168:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852178:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852186:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857821.852191:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852202:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852229:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.852259:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7cdbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.852411:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171721984:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 9778us (10303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.852424:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00100000:0.0:1787857821.856424:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.856738:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171722368 00000100:00100000:3.0:1787857821.856751:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171722368 00000100:00100000:3.0:1787857821.856902:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1186 00000100:00100000:3.0:1787857821.856914:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:29500:x1874704171722368:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857821.857043:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.857067:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.857084:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.857506:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.857520:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.857529:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.857729:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857821.857748:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 47 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857821.857768:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188262144:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857821.857920:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb66780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857821.866692:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.866848:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188262144:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857821.866890:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857821.867497:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171722496 00000100:00100000:2.0:1787857821.867507:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171722496 00010000:00010000:2.0:1787857821.869087:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 48 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857821.869271:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 355 00000100:00100000:2.0:1787857821.869290:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2350:x1874704171722496:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857821.869322:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857821.869332:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 48 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.869349:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 48 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.869392:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7cdad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d2c expref: 48 pid: 19301 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.869408:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857821.869414:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.869436:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.869445:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.869484:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857821.869585:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171722496:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 304us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.869595:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 355 00010000:00010000:1.0:1787857821.869681:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.869691:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857821.869987:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968074 00000001:00080000:1.0:1787857821.870187:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968075 00000001:00080000:1.0:1787857821.870248:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968076 00000100:00100000:1.0:1787857821.870358:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188262272:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857821.870438:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857821.870484:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857821.871028:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188262272 00000100:00100000:3.0:1787857821.871038:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188262272 00000100:00100000:3.0:1787857821.871097:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787857821.871110:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188262272:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787857821.871231:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188262272:12345-0@lo:1000:mdt00_000.0 Request processed in 124us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857821.871239:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787857821.871363:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188262272:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787857821.873019:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968077 00000100:00100000:1.0:1787857821.873171:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188262400:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857821.873250:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857821.873308:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857821.873493:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188262400 00000100:00100000:3.0:1787857821.873503:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188262400 00000100:00100000:3.0:1787857821.873581:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787857821.873593:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188262400:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787857821.873909:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1874704188262400:12345-0@lo:1000:mdt00_000.0 Request processed in 316us (657us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1787857821.873919:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787857821.874037:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188262400:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787857821.874216:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968078 00010000:00010000:0.0:1787857821.874268:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.874279:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.874291:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.874298:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857821.874302:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.874310:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.874327:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857821.874330:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857821.874335:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.874342:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7cdc9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.876273:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.876290:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.876297:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.876303:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857821.876308:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.876320:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.877147:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379500) 00010000:00010000:0.0:1787857821.877152:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857821.877162:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cd05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ced expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.877177:0:5856:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cd05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ced expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.877188:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cd05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ced expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857821.877245:0:5856:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74800/0xd3f183cab4a7cd05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ced expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857821.877261:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188262528:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857821.877349:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857821.881014:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.881312:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171722624 00000100:00100000:2.0:1787857821.881326:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171722624 00000100:00100000:2.0:1787857821.881411:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:2.0:1787857821.881427:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29499:x1874704171722624:12345-192.168.204.36@tcp:49:diff.0 00000100:00100000:1.0:1787857821.881743:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188262528:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857821.881803:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857821.881858:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29499:x1874704171722624:12345-192.168.204.36@tcp:49:diff.0 Request processed in 435us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857821.881868:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 236 00010000:00010000:1.0:1787857821.881890:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7ccfe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.881931:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.881948:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.881962:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.881973:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.881980:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.881986:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.881992:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857821.881995:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882003:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882017:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379500) 00010000:00010000:1.0:1787857821.882020:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857821.882031:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882036:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cdd0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882049:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882055:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882061:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882066:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857821.882069:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882075:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882084:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff9998c3379500) 00010000:00010000:1.0:1787857821.882087:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857821.882161:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.882168:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cdc2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857821.883031:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857821.883039:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787857821.883282:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:29500:x1874704171722368:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 26364us (26865us total) trans 4294968079 rc 0/0 00000100:00100000:1.0:1787857821.883295:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1186 00000020:00080000:1.0:1787857821.883323:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787857821.885445:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857821.885471:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857821.885541:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857821.885653:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171722752 00000100:00100000:1.0:1787857821.885677:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171722752 00000100:00100000:1.0:1787857821.885749:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 320 00000100:00100000:1.0:1787857821.885760:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:29499:x1874704171722752:12345-192.168.204.36@tcp:101:diff.0 00010000:00010000:1.0:1787857821.885788:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857821.885835:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cdd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d33 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857821.885868:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 158, mtime: 0x6a908b88, atime: 0x6a908b88, ctime: 0x6a908b88, blocks: 0xb 00010000:00010000:1.0:1787857821.885898:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=645s v=(0 0) 00010000:00010000:1.0:1787857821.885903:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857821.885914:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cdd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d33 expref: 16 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.885933:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d70c5a0c/0xd3f183cab4a7cdd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d33 expref: 16 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.885948:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052a00, rc 0) 00000100:00100000:1.0:1787857821.886020:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:29499:x1874704171722752:12345-192.168.204.36@tcp:101:diff.0 Request processed in 261us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857821.886027:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 320 00000100:00100000:0.0:1787857821.889618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.889721:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171723008 00000100:00100000:3.0:1787857821.889744:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171723008 00000100:00100000:3.0:1787857821.889811:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:3.0:1787857821.889846:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:29500:x1874704171723008:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787857821.890857:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787857821.891060:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968080 00010000:00010000:2.0:1787857821.891130:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.891151:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.891167:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.891178:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.891185:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.891192:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857821.891225:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857821.891358:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:29500:x1874704171723008:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1512us (1752us total) trans 4294968081 rc 0/0 00000100:00100000:2.0:1787857821.891369:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 237 00000020:00080000:2.0:1787857821.891376:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787857821.891744:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857821.891754:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.891764:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857821.891781:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.891792:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.891809:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:1.0:1787857821.891844:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857821.891851:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 1/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.891858:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7cdde lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857821.891883:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857821.891885:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857821.891887:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857821.894380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857821.894461:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171723136 00000100:00100000:3.0:1787857821.894476:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171723136 00002000:00100000:3.0:1787857821.894550:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->4095) req@ffff9997c5b43c00 x1874704171723136/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:467/0 lens 488/0 e 0 to 0 dl 1787857832 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857821.894563:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5b43c00 with x1874704171723136 ext(0->4095) 00002000:00010000:3.0:1787857821.894570:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c5b43c00 00000100:00100000:3.0:1787857821.894612:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 104 00000100:00100000:3.0:1787857821.894624:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171723136:12345-192.168.204.36@tcp:3:diff.0 00000100:00100000:3.0:1787857821.894945:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171723136:12345-192.168.204.36@tcp:3:diff.0 Request processed in 322us (579us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787857821.894954:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 104 00002000:00100000:3.0:1787857821.894972:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->4095) req@ffff9997c5b43c00 x1874704171723136/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:467/0 lens 488/4536 e 0 to 0 dl 1787857832 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857821.894981:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5b43c00 with x1874704171723136 ext(0->4095) 00002000:00010000:3.0:1787857821.894985:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c5b43c00 00000100:00100000:0.0:1787857821.900076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857821.900259:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171723392 00000100:00100000:2.0:1787857821.900272:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171723392 00000100:00100000:2.0:1787857821.900368:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00100000:2.0:1787857821.900381:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:29499:x1874704171723392:12345-192.168.204.36@tcp:35:diff.0 00000100:00100000:2.0:1787857821.901197:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+96:29499:x1874704171723392:12345-192.168.204.36@tcp:35:diff.0 Request processed in 812us (1133us total) trans 4294968082 rc 0/0 00000100:00100000:2.0:1787857821.901208:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 238 00010000:00010000:1.0:1787857822.447105:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857823.011924:0:20975:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857823.011936:0:20975:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857823.011994:0:20975:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 3 00000040:00080000:1.0:1787857823.012005:0:20975:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857823.470226:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857823.919531:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857823.919542:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857823.919964:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 2 00000040:00080000:0.0:1787857823.919972:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857824.494300:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857824.622389:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188262656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857824.622466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857824.622885:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188262656 00000100:00100000:3.0:1787857824.622895:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188262656 00000100:00100000:3.0:1787857824.623008:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787857824.623019:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188262656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857824.623055:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787857824.623406:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857824.623720:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188262656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 701us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857824.623729:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787857824.623810:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188262656:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787857824.792098:0:21027:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857824.792107:0:21027:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857824.792290:0:21027:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 2 00000040:00080000:1.0:1787857824.792302:0:21027:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787857825.517999:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857825.872930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857825.872982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857825.873022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857825.873032:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171723520 00000100:00100000:3.0:1787857825.873043:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171723520 00000100:00100000:2.0:1787857825.873050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857825.873076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857825.873101:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 583 00000100:00100000:2.0:1787857825.873107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857825.873117:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171723520:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857825.873137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857825.873163:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171724032 00000100:00100000:2.0:1787857825.873167:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171724032 00000100:00100000:3.0:1787857825.873199:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171723520:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857825.873207:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 583 00000100:00100000:2.0:1787857825.873217:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171723648 00000100:00100000:2.0:1787857825.873222:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171723648 00000100:00100000:2.0:1787857825.873253:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 444 00000100:00100000:2.0:1787857825.873262:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2348:x1874704171724032:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857825.873266:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 445 00000100:00100000:3.0:1787857825.873279:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:2348:x1874704171723648:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857825.873310:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2348:x1874704171724032:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857825.873317:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 444 00000100:00100000:3.0:1787857825.873332:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+96:2348:x1874704171723648:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 55us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857825.873339:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 445 00000100:00080000:2.0:1787857825.873339:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857825.873382:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171723776 00000100:00100000:2.0:1787857825.873387:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171723776 00000100:00100000:2.0:1787857825.873418:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171724288 00000100:00100000:2.0:1787857825.873421:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171724288 00000100:00100000:2.0:1787857825.873435:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171723904 00000100:00100000:2.0:1787857825.873437:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171723904 00000100:00100000:2.0:1787857825.873448:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171724160 00000100:00100000:2.0:1787857825.873451:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171724160 00000100:00100000:2.0:1787857825.873465:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:2.0:1787857825.873471:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171723776:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857825.873501:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171723776:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857825.873509:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:2.0:1787857825.873523:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 450 00000100:00100000:2.0:1787857825.873528:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171724288:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857825.873553:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171724288:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857825.873573:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 450 00000100:00100000:2.0:1787857825.873585:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 451 00000100:00100000:2.0:1787857825.873603:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171723904:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857825.873626:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171723904:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857825.873632:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 451 00000100:00100000:2.0:1787857825.873645:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 452 00000100:00100000:2.0:1787857825.873650:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171724160:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857825.873675:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171724160:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857825.873681:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 452 00000100:00080000:2.0:1787857825.873703:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857825.873706:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857826.158854:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188262912:0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.158936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857826.158981:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188263424:0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.159006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857826.159033:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857826.159039:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188263040:0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.159060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857826.159182:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188263168:0@lo:400:kworker.0 00000100:00100000:2.0:1787857826.159212:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857826.159230:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857826.159235:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188262784:0@lo:400:kworker.0 00000100:00100000:2.0:1787857826.159264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857826.159288:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188263296:0@lo:400:kworker.0 00000100:00100000:2.0:1787857826.159311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857826.159337:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188263424 00000100:00100000:2.0:1787857826.159344:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188263424 00000100:00100000:2.0:1787857826.159392:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188263168 00000100:00100000:2.0:1787857826.159395:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188263168 00000100:00100000:2.0:1787857826.159417:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1787857826.159426:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188263424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857826.159477:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188263424:12345-0@lo:400:kworker.0 Request processed in 52us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857826.159485:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1787857826.159501:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1787857826.159507:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188263168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857826.159538:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188263168:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857826.159716:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188262912 00000100:00100000:1.0:1787857826.159721:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188262912 00000100:00100000:1.0:1787857826.159752:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188263040 00000100:00100000:1.0:1787857826.159755:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188263040 00000100:00100000:1.0:1787857826.159776:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188263296 00000100:00100000:1.0:1787857826.159790:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188263296 00000100:00100000:1.0:1787857826.159833:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1787857826.159841:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188262912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857826.159878:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188262912:12345-0@lo:400:kworker.0 Request processed in 39us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857826.159885:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1787857826.159898:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1787857826.159904:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188263040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857826.159930:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188263040:12345-0@lo:400:kworker.0 Request processed in 27us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857826.159936:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1787857826.159947:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1787857826.159953:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188263296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857826.159979:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188263296:12345-0@lo:400:kworker.0 Request processed in 27us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857826.159984:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1787857826.160457:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188262784 00000100:00100000:3.0:1787857826.160462:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188262784 00000100:00100000:3.0:1787857826.160497:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1787857826.160503:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188262784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.160541:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188262784:12345-0@lo:400:kworker.0 Request processed in 38us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857826.160643:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00080000:3.0:1787857826.160689:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857826.160695:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857826.160698:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857826.160729:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188263040:0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.160741:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188262912:0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.160751:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188263424:0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.160785:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188262784:0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.160796:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188263296:0@lo:400:kworker.0 00000100:00100000:3.0:1787857826.160807:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188263168:0@lo:400:kworker.0 00000100:00100000:2.0:1787857826.160905:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00010000:00010000:1.0:1787857826.542351:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857826.675457:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857826.675495:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188263552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857826.675569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857826.675652:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188263552 00000100:00100000:3.0:1787857826.675661:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188263552 00000100:00100000:3.0:1787857826.675705:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787857826.675715:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188263552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857826.675749:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857826.675798:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188263552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857826.675804:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787857826.675894:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188263552:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787857826.706987:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968079 is committed 00000020:00080000:1.0:1787857826.707017:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9997c27f7d80 refcount 2 committed 0 result 0 batchid 24 00000020:00080000:1.0:1787857826.707022:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c3d33b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9997c27f7300 00000020:00080000:1.0:1787857826.707026:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9997c3d33700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998ffb57000 00000020:00080000:3.0:1787857826.707065:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 24 committed batchid 23 00000020:00080000:3.0:1787857826.707265:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00000001:00080000:1.0:1787857826.707270:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968082 is committed 00000001:00080000:1.0:1787857826.707277:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968081 is committed 00000001:00080000:0.0:1787857827.232258:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00000001:00080000:0.0:1787857827.232277:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00010000:00010000:2.0:1787857827.567615:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857828.590007:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857829.172195:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857829.172279:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171724416 00000100:00100000:1.0:1787857829.172296:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171724416 00000100:00100000:1.0:1787857829.172397:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1187 00000100:00100000:1.0:1787857829.172424:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29395:x1874704171724416:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787857829.172556:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:29395:x1874704171724416:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 135us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857829.172564:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1187 00000100:00080000:3.0:1787857829.174088:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857829.615080:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857829.742579:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188263680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857829.742691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857829.742957:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188263680 00000100:00100000:1.0:1787857829.742969:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188263680 00000100:00100000:1.0:1787857829.743066:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787857829.743079:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188263680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857829.743125:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787857829.743210:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857829.745007:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000100:00100000:1.0:1787857829.745012:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188263680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1925us (2311us total) trans 0 rc 0/0 00000004:00080000:3.0:1787857829.745018:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967359 committed transno 4294967359 00000100:00100000:1.0:1787857829.745030:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787857829.745592:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188263680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857830.642551:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857830.870083:0:21226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 15:10:29 (1787857829) 00000100:00100000:3.0:1787857831.000812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857831.000870:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.000873:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171724672 00000100:00100000:1.0:1787857831.000883:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171724672 00000100:00100000:3.0:1787857831.000901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857831.000939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.000959:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:3.0:1787857831.000965:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.000973:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+95:2348:x1874704171724672:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857831.000993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.001056:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+95:2348:x1874704171724672:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857831.001065:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:1.0:1787857831.001080:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171725056 00000100:00100000:1.0:1787857831.001084:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171725056 00000100:00100000:1.0:1787857831.001106:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 450 00000100:00100000:1.0:1787857831.001113:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2348:x1874704171725056:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857831.001780:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171724928 00000100:00100000:2.0:1787857831.001787:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171724928 00000100:00100000:2.0:1787857831.001852:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171725184 00000100:00100000:2.0:1787857831.001857:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171725184 00000100:00100000:2.0:1787857831.001889:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171724800 00000100:00100000:2.0:1787857831.001893:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171724800 00000100:00100000:2.0:1787857831.001925:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 455 00000100:00100000:2.0:1787857831.001934:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171724928:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857831.007168:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.008943:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2348:x1874704171725056:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 7818us (7939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857831.008966:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 450 00000100:00080000:1.0:1787857831.009064:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857831.009072:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857831.009076:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857831.009089:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171725312 00000100:00100000:1.0:1787857831.009098:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 456 00000100:00100000:3.0:1787857831.009100:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171725312 00000100:00100000:3.0:1787857831.009150:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 457 00000100:00100000:3.0:1787857831.009160:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171724800:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857831.009218:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171724800:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 61us (8254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857831.009226:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 457 00000100:00100000:3.0:1787857831.009243:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 458 00000100:00100000:3.0:1787857831.009249:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171725312:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857831.009277:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171725312:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857831.009285:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 458 00000100:00100000:1.0:1787857831.009302:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171725184:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857831.009306:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171724544 00000100:00100000:3.0:1787857831.009312:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171724544 00000100:00100000:3.0:1787857831.009344:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 585 00000100:00100000:1.0:1787857831.009346:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171725184:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 234us (8441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857831.009355:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171724544:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857831.009357:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 456 00000100:00100000:3.0:1787857831.009391:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171724544:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (8450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857831.009399:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 585 00000100:00080000:1.0:1787857831.009845:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857831.010462:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2348:x1874704171724928:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 8514us (9576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857831.010475:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 455 00000100:00100000:3.0:1787857831.276135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857831.276245:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171725440 00000100:00100000:2.0:1787857831.276254:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171725440 00000100:00100000:2.0:1787857831.276309:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1188 00000100:00100000:2.0:1787857831.276319:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:30120:x1874704171725440:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787857831.276429:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:30120:x1874704171725440:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 112us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857831.276437:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1188 00000100:00100000:3.0:1787857831.278079:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188264192:0@lo:400:kworker.0 00000100:00100000:2.0:1787857831.278085:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188263936:0@lo:400:kworker.0 00000100:00100000:0.0:1787857831.278139:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188264064:0@lo:400:kworker.0 00000100:00100000:1.0:1787857831.278152:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188263808:0@lo:400:kworker.0 00000100:00100000:2.0:1787857831.278190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857831.278201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857831.278223:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188263936 00000100:00100000:0.0:1787857831.278229:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188263936 00000100:00100000:0.0:1787857831.278276:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1787857831.278284:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188263936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857831.278292:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857831.278338:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188264320:0@lo:400:kworker.0 00000100:00100000:0.0:1787857831.278344:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188263936:12345-0@lo:400:kworker.0 Request processed in 61us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857831.278352:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1787857831.278355:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188263936:0@lo:400:kworker.0 00000100:00100000:3.0:1787857831.278357:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188264192 00000100:00100000:3.0:1787857831.278364:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188264192 00000100:00100000:1.0:1787857831.278367:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857831.278369:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188264448:0@lo:400:kworker.0 00000100:00100000:2.0:1787857831.278407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857831.278413:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188263808 00000100:00100000:1.0:1787857831.278418:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188263808 00000100:00100000:1.0:1787857831.278454:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1787857831.278461:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188263808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857831.278517:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188263808:12345-0@lo:400:kworker.0 Request processed in 56us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857831.278524:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1787857831.278553:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188264320 00000100:00100000:1.0:1787857831.278557:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188264320 00000100:00100000:1.0:1787857831.278581:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1787857831.278587:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188264320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857831.278632:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188264320:12345-0@lo:400:kworker.0 Request processed in 45us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857831.278638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857831.278639:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1787857831.278651:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188264064 00000100:00100000:1.0:1787857831.278654:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188264064 00000100:00100000:1.0:1787857831.278680:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1787857831.278686:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188264064:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787857831.278686:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857831.278691:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857831.278699:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188264448 00000100:00100000:2.0:1787857831.278705:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188264448 00000100:00100000:1.0:1787857831.278724:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188264064:12345-0@lo:400:kworker.0 Request processed in 37us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857831.278724:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188263808:0@lo:400:kworker.0 00000100:00100000:1.0:1787857831.278731:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1787857831.278740:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188264320:0@lo:400:kworker.0 00000100:00100000:2.0:1787857831.278756:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1787857831.278764:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1787857831.278770:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188264192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857831.278771:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188264064:0@lo:400:kworker.0 00000100:00100000:1.0:1787857831.278775:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188264448:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787857831.278801:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857831.278882:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188264192:12345-0@lo:400:kworker.0 Request processed in 117us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857831.278890:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188264448:12345-0@lo:400:kworker.0 Request processed in 116us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857831.278897:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1787857831.278904:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1787857831.278974:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188264448:0@lo:400:kworker.0 00000100:00100000:3.0:1787857831.278983:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188264192:0@lo:400:kworker.0 00000100:00100000:3.0:1787857831.301645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857831.301931:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171725568 00000100:00100000:0.0:1787857831.301944:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171725568 00000100:00100000:0.0:1787857831.302031:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1189 00000100:00100000:0.0:1787857831.302043:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+95:30121:x1874704171725568:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857831.302070:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857831.302097:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cde5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d3a expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302192:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302209:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302225:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302381:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302404:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302417:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302764:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302772:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302779:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302786:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.302791:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302802:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302868:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857831.302871:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.302876:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302882:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cdec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302895:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302901:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302906:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302912:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.302914:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302919:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302926:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff9997c3d03800) 00010000:00010000:0.0:1787857831.302928:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.302931:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302940:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7cdf3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.302989:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cde5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d3a expref: 96 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.303014:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857831.303016:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.303020:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cde5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d3a expref: 96 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.303029:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857831.303124:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+95:30121:x1874704171725568:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1081us (1500us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857831.303133:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1189 00000100:00100000:1.0:1787857831.310687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857831.311038:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171725824 00000100:00100000:0.0:1787857831.311049:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171725824 00000100:00100000:0.0:1787857831.311289:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1190 00000100:00100000:0.0:1787857831.311301:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+95:30121:x1874704171725824:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1787857831.311362:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857831.311390:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ca18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3bf8 expref: 95 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.311413:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857831.311418:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857831.311752:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.311768:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.311778:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.311812:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 43 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.311890:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 43 pid: 7656 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857831.311906:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188264576:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857831.311999:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9d5e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857831.314894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857831.315365:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188264576:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857831.315394:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857831.315976:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171725952 00000100:00100000:0.0:1787857831.315983:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171725952 00010000:00010000:0.0:1787857831.316019:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 44 pid: 7656 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857831.316208:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 356 00000100:00100000:0.0:1787857831.316219:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2350:x1874704171725952:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857831.316235:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857831.316243:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 44 pid: 7656 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.316254:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 44 pid: 7656 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.316276:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7ca57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3c0d expref: 44 pid: 7656 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.316293:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857831.316298:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.316306:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.316314:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.316537:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857831.316599:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:2350:x1874704171725952:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 380us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857831.316617:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 356 00010000:00010000:1.0:1787857831.317345:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.317356:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.317381:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.317393:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.317402:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857831.322670:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00010000:00010000:1.0:1787857831.322691:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.322703:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.322711:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.322718:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857831.322723:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.322731:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.322749:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:1.0:1787857831.322752:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.322762:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.322768:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7cdfa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857831.322789:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5188942 reply state 00000000dd48cf7e transno 4294968083 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857831.322798:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857831.323153:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+96:30121:x1874704171725824:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 11848us (12469us total) trans 4294968083 rc 0/0 00000100:00100000:1.0:1787857831.323174:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1190 00010000:00010000:0.0:1787857831.325450:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.325467:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.325561:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.325571:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.325575:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.325584:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.325600:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff9998e1a0cc00) 00010000:00010000:0.0:1787857831.325603:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.325608:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.325615:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce01 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857831.338387:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.341930:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171726080 00000100:00100000:1.0:1787857831.341953:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171726080 00000100:00100000:1.0:1787857831.342037:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1191 00000100:00100000:1.0:1787857831.342049:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+95:30122:x1874704171726080:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857831.342075:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857831.342100:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ce08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d41 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.342186:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ce0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.342201:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ce0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.342214:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ce0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857831.342274:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857831.342278:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857831.342301:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ce0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.342326:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ce08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d41 expref: 97 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.342346:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ce0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d41 expref: 96 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.342373:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:1.0:1787857831.342376:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857831.342380:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053200, rc 0) 00000100:00100000:1.0:1787857831.342454:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+96:30122:x1874704171726080:12345-192.168.204.36@tcp:101:bash.0 Request processed in 406us (4077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857831.342462:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1191 00000100:00100000:3.0:1787857831.355649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857831.355930:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171726208 00000100:00100000:0.0:1787857831.355942:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171726208 00000100:00100000:0.0:1787857831.356005:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1192 00000100:00100000:0.0:1787857831.356016:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+96:30122:x1874704171726208:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857831.356144:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857831.356167:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7ce16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d48 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356234:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356363:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356380:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356397:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356404:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356412:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356539:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7ce2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356548:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7ce2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356556:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7ce2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857831.356589:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:0.0:1787857831.356593:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857831.356618:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7ce2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356629:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356637:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356647:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356653:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.356658:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356666:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356677:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857831.356681:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.356686:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356693:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356707:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356713:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356719:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356725:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.356727:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356738:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356745:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff9997c3d03800) 00010000:00010000:0.0:1787857831.356748:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.356751:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356757:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.356802:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7ce16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d48 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.357020:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70a00/0xd3f183cab4a7ce2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d48 expref: 97 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.357152:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:0.0:1787857831.357156:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857831.357159:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70a00, rc 0) 00000100:00100000:0.0:1787857831.357721:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+97:30122:x1874704171726208:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1590us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857831.357731:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1192 00000100:00100000:3.0:1787857831.365254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.365379:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171726336 00000100:00100000:1.0:1787857831.365389:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171726336 00000100:00100000:1.0:1787857831.365519:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1193 00000100:00100000:1.0:1787857831.365530:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+97:30122:x1874704171726336:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857831.365553:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857831.365576:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ce32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d4f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365659:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365673:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365685:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365700:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365708:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365737:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365914:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365922:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365929:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365935:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857831.365939:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365946:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365958:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:1.0:1787857831.365961:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.365966:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365972:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7ce39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365986:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.365992:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.366004:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.366009:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857831.366011:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.366017:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.366026:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9998e1a0ce00) 00010000:00010000:1.0:1787857831.366028:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.366032:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.366038:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.366071:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ce32 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d4f expref: 98 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.366081:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:1.0:1787857831.366083:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.366087:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ce32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d4f expref: 98 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.366096:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:1.0:1787857831.366213:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+97:30122:x1874704171726336:12345-192.168.204.36@tcp:101:bash.0 Request processed in 684us (968us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857831.366229:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1193 00000100:00100000:2.0:1787857831.384470:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.384625:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171726464 00000100:00100000:1.0:1787857831.384635:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171726464 00000100:00100000:1.0:1787857831.384700:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1194 00000100:00100000:1.0:1787857831.384710:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+43:30123:x1874704171726464:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857831.384730:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857831.384751:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ce47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d56 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.384895:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.384910:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.384922:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857831.384981:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787857831.384984:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857831.385003:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.385026:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7ce47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 45 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.385044:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.385071:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:1.0:1787857831.385074:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857831.385077:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:1.0:1787857831.385142:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:30123:x1874704171726464:12345-192.168.204.36@tcp:101:rm.0 Request processed in 433us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857831.385150:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1194 00000100:00100000:3.0:1787857831.389559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857831.389677:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171726592 00000100:00100000:0.0:1787857831.389687:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171726592 00000100:00100000:0.0:1787857831.389807:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1195 00000100:00100000:0.0:1787857831.389860:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:30123:x1874704171726592:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857831.389883:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857831.389907:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7ce55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d5d expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.389980:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.389995:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390006:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390019:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390026:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390032:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390160:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7ce6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390168:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7ce6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390175:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7ce6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857831.390206:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:0.0:1787857831.390210:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857831.390233:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7ce6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390248:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390254:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390261:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390268:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.390272:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390280:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390306:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857831.390309:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.390314:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390320:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ce5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390334:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390339:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390349:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390355:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.390357:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390363:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390370:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff9997c3d03800) 00010000:00010000:0.0:1787857831.390372:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.390375:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390380:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7ce63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390416:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7ce55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d5d expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390441:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71000/0xd3f183cab4a7ce6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d5d expref: 45 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.390449:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:0.0:1787857831.390451:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857831.390454:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71000, rc 0) 00000100:00100000:0.0:1787857831.390536:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30123:x1874704171726592:12345-192.168.204.36@tcp:101:rm.0 Request processed in 719us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857831.390547:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1195 00000100:00100000:2.0:1787857831.395122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.395233:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171726720 00000100:00100000:1.0:1787857831.395246:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171726720 00000100:00100000:1.0:1787857831.395349:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1196 00000100:00100000:1.0:1787857831.395359:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30123:x1874704171726720:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857831.395379:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857831.395399:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ce71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395466:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395497:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395509:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395525:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395532:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395559:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395624:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395633:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395639:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395645:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857831.395649:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395657:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395670:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:1.0:1787857831.395673:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.395678:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395686:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ce78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395699:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395706:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395721:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395727:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857831.395730:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395737:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395744:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9998e1a0ce00) 00010000:00010000:1.0:1787857831.395746:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.395749:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395753:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ce7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395798:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ce71 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d64 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395808:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:1.0:1787857831.395811:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.395855:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7ce71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d64 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.395872:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053c00, rc 0) 00000100:00100000:1.0:1787857831.395945:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30123:x1874704171726720:12345-192.168.204.36@tcp:101:rm.0 Request processed in 587us (842us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857831.395962:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1196 00000100:00100000:1.0:1787857831.399618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857831.399712:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171726848 00000100:00100000:3.0:1787857831.399722:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171726848 00000100:00100000:3.0:1787857831.399998:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1197 00000100:00100000:3.0:1787857831.400009:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30123:x1874704171726848:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857831.400045:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857831.400066:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7ce86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d6b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400145:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400159:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400169:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400181:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400188:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400194:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400258:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400265:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400272:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400279:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857831.400283:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400307:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400321:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:3.0:1787857831.400324:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857831.400328:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400334:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ce8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400348:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400354:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400360:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400364:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857831.400367:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400373:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400380:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9998d12ef700) 00010000:00010000:3.0:1787857831.400382:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857831.400384:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400394:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ce94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400429:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7ce86 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d6b expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400449:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:3.0:1787857831.400452:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857831.400456:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7ce86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d6b expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.400466:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73200, rc 0) 00000100:00100000:3.0:1787857831.400560:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30123:x1874704171726848:12345-192.168.204.36@tcp:101:rm.0 Request processed in 553us (952us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857831.400568:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1197 00000100:00100000:3.0:1787857831.414867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857831.415958:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171726976 00000100:00100000:0.0:1787857831.415972:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171726976 00000100:00100000:0.0:1787857831.416106:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1198 00000100:00100000:0.0:1787857831.416118:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30124:x1874704171726976:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857831.416140:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857831.416165:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7ce9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d72 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416418:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416434:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416447:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416461:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416468:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416475:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416553:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416564:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416570:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416576:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.416579:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416586:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416598:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:0.0:1787857831.416600:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.416605:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416611:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cea2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416625:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416630:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416635:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416640:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.416643:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416649:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416655:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9997c3d03800) 00010000:00010000:0.0:1787857831.416657:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.416660:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416665:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cea9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416702:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7ce9b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d72 expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416712:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:0.0:1787857831.416714:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.416717:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71400/0xd3f183cab4a7ce9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d72 expref: 46 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.416726:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71400, rc 0) 00000100:00100000:0.0:1787857831.416809:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30124:x1874704171726976:12345-192.168.204.36@tcp:101:cp.0 Request processed in 693us (1991us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857831.416869:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1198 00000100:00100000:0.0:1787857831.425866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.426174:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171727104 00000100:00100000:1.0:1787857831.426193:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171727104 00000100:00100000:1.0:1787857831.426264:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1199 00000100:00100000:1.0:1787857831.426274:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30124:x1874704171727104:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857831.426297:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857831.426319:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ceb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d79 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426398:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426415:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426428:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426444:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426451:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426457:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426533:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426556:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426563:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426569:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857831.426573:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426582:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426596:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:1.0:1787857831.426600:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.426606:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426611:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7ceb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426625:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426631:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426637:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426642:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857831.426652:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426659:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426667:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9998e1a0ce00) 00010000:00010000:1.0:1787857831.426670:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.426673:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426678:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cebe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426725:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ceb0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d79 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426736:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:1.0:1787857831.426738:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857831.426742:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7ceb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d79 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857831.426751:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052000, rc 0) 00000100:00100000:1.0:1787857831.427709:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30124:x1874704171727104:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1423us (1883us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857831.427719:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1199 00000100:00100000:1.0:1787857831.438312:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857831.442580:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171727360 00000100:00100000:3.0:1787857831.442602:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171727360 00000100:00100000:2.0:1787857831.442771:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1200 00000100:00100000:2.0:1787857831.442792:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30124:x1874704171727360:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857831.442850:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857831.442874:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cec5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d80 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443033:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443052:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443065:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443081:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443089:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443096:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857831.443728:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:2.0:1787857831.443930:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443942:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443950:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443982:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443989:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.443997:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.444003:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857831.444008:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.444015:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.444025:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:2.0:1787857831.444028:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857831.444032:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.444038:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cecc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857831.444050:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ea6bbde reply state 00000000bc202634 transno 4294968084 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857831.444059:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857831.444087:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cec5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.444109:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.444116:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:2.0:1787857831.444119:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857831.444121:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75e00, rc 0) 00000100:00100000:2.0:1787857831.444207:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30124:x1874704171727360:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1419us (6078us total) trans 4294968084 rc 0/0 00000100:00100000:2.0:1787857831.444215:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1200 00010000:00010000:3.0:1787857831.453594:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.453610:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.453617:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.453624:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857831.453629:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.453637:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.453654:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9998c3379c00) 00010000:00010000:3.0:1787857831.453657:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857831.453662:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.453668:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7ced3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857831.453922:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857831.453989:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171727488 00000100:00100000:2.0:1787857831.454000:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171727488 00000100:00100000:2.0:1787857831.454064:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 321 00000100:00100000:2.0:1787857831.454076:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171727488:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857831.454097:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857831.454116:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d87 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857831.454142:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857831.454167:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=655s v=(0 0) 00010000:00010000:2.0:1787857831.454172:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857831.454182:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.454200:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.454219:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74600, rc 0) 00000100:00100000:2.0:1787857831.454286:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171727488:12345-192.168.204.36@tcp:101:cp.0 Request processed in 211us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857831.454294:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 321 00000100:00100000:2.0:1787857831.461389:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857831.461491:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171727616 00000100:00100000:3.0:1787857831.461502:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171727616 00000100:00100000:3.0:1787857831.461569:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 322 00000100:00100000:3.0:1787857831.461582:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:30124:x1874704171727616:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857831.461606:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857831.461627:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d8e expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.461661:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.461672:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857831.461676:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857831.461682:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.461723:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.461737:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 12 pid: 6714 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857831.461754:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188264704:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857831.462876:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857831.467591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857831.468117:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171727744 00000100:00100000:3.0:1787857831.468129:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171727744 00010000:00010000:3.0:1787857831.468195:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 13 pid: 6714 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857831.468287:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 357 00000100:00100000:3.0:1787857831.468307:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171727744:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857831.468323:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857831.468350:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 13 pid: 6714 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.468366:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 13 pid: 6714 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.468395:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857831.468400:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857831.468409:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.468419:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857831.468456:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857831.468470:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188264832:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857831.468560:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787857831.470464:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cee8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d87 expref: 13 pid: 6714 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857831.470512:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188264704:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857831.470547:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.470563:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73200, rc 0) 00000100:00100000:3.0:1787857831.470599:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188264832:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857831.470614:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857831.470630:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:30124:x1874704171727616:12345-192.168.204.36@tcp:101:cp.0 Request processed in 9049us (9253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857831.470643:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171727744:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2335us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857831.470643:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 322 00000100:00100000:3.0:1787857831.470657:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 357 00000100:00100000:1.0:1787857831.473769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857831.473931:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171728000 00000100:00100000:2.0:1787857831.473941:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171728000 00000100:00100000:2.0:1787857831.473997:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:2.0:1787857831.474007:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6123050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30124:x1874704171728000:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:2.0:1787857831.474365:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6123050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30124:x1874704171728000:12345-192.168.204.36@tcp:35:cp.0 Request processed in 358us (603us total) trans 4294968085 rc 0/0 00000100:00100000:2.0:1787857831.474378:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:1.0:1787857831.539444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857831.539700:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171728128 00000100:00100000:0.0:1787857831.539711:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171728128 00000100:00100000:0.0:1787857831.539794:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1201 00000100:00100000:0.0:1787857831.539806:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+97:30127:x1874704171728128:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857831.539883:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857831.539912:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cef6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d95 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.539987:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540001:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540012:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540027:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540035:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540042:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540153:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540161:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540168:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857831.540319:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:0.0:1787857831.540324:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857831.540345:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540357:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540366:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540372:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540379:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540385:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.540390:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540398:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540410:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:0.0:1787857831.540413:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.540418:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540424:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cefd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540636:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540643:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540649:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540655:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857831.540658:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540664:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540672:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9997c3d03800) 00010000:00010000:0.0:1787857831.540675:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857831.540679:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540685:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540723:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7cef6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540737:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.540749:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:0.0:1787857831.540751:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857831.540754:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:0.0:1787857831.541333:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+98:30127:x1874704171728128:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1526us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857831.541342:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1201 00000100:00100000:1.0:1787857831.546668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857831.546931:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171728256 00000100:00100000:2.0:1787857831.546942:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171728256 00000100:00100000:2.0:1787857831.547006:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 323 00000100:00100000:2.0:1787857831.547016:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171728256:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857831.547037:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857831.547057:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cf12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3d9c expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857831.547146:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188264960:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857831.547250:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3cc00 going to sleep for 11 seconds 00002000:00010000:2.0:1787857831.554959:0:6713:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857831.554967:0:6713:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb mtime: 0 -> 1787857831 00002000:00010000:2.0:1787857831.554970:0:6713:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb atime: 0 -> 1787857831 00002000:00010000:2.0:1787857831.554971:0:6713:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb ctime: 0 -> 1787857831 00000100:00100000:2.0:1787857831.554997:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188264960:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857831.555035:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cf12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d9c expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.555060:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099f780c5/0xd3f183cab4a7cf12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d9c expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.555075:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74600, rc 0) 00000100:00100000:2.0:1787857831.555149:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171728256:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 8133us (8491us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857831.555162:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 323 00000100:00100000:1.0:1787857831.559754:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857831.559892:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171728384 00000100:00100000:2.0:1787857831.559902:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171728384 00000100:00100000:2.0:1787857831.559958:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1202 00000100:00100000:2.0:1787857831.559968:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+98:30127:x1874704171728384:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857831.559989:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857831.560008:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cf19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3da3 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.560071:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.560084:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.560095:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857831.560153:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:2.0:1787857831.560157:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857831.560191:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.560216:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7cf19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 100 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.560232:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857831.560245:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:2.0:1787857831.560247:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857831.560250:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75600, rc 0) 00000100:00100000:2.0:1787857831.560311:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+99:30127:x1874704171728384:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 345us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857831.560318:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1202 00000100:00100000:1.0:1787857831.564498:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857831.564602:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171728512 00000100:00100000:0.0:1787857831.564613:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171728512 00000100:00100000:0.0:1787857831.564673:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 324 00000100:00100000:0.0:1787857831.564683:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171728512:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857831.564702:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857831.564723:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7cf27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3daa expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857831.564801:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188265088:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857831.564929:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9d5e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857831.567693:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188265088:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857831.567730:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7cf27 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3daa expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.567755:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daafe3e2/0xd3f183cab4a7cf27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3daa expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857831.567773:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857831.567895:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+12:2349:x1874704171728512:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3211us (3479us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857831.567904:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 324 00000100:00100000:2.0:1787857831.572883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857831.575529:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171728768 00000100:00100000:1.0:1787857831.575545:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171728768 00000100:00100000:1.0:1787857831.575675:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1203 00000100:00100000:1.0:1787857831.575687:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+99:30127:x1874704171728768:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1787857831.576031:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 136 off12816 00000100:00100000:1.0:1787857831.576147:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+99:30127:x1874704171728768:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 462us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857831.576156:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1203 00010000:00010000:2.0:1787857831.662394:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857831.790068:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188265216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857831.790149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857831.790399:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188265216 00000100:00100000:2.0:1787857831.790408:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188265216 00000100:00100000:2.0:1787857831.790550:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787857831.790561:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188265216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857831.790597:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857831.790724:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188265216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857831.791251:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188265216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857831.792016:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000001:00080000:2.0:1787857831.821877:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968083 is committed 00000001:00080000:2.0:1787857831.822074:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968085 is committed 00000020:00080000:2.0:1787857831.822085:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 24 batchid updated 00000020:00080000:3.0:1787857831.822234:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 24 00000020:00080000:3.0:1787857831.822252:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 24 00000040:00080000:2.0:1787857832.111237:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857832.111248:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857832.111294:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 35 count 3 00000040:00080000:2.0:1787857832.111300:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857832.111601:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188265344:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857832.111737:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857832.119517:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188265344:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857832.123500:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857832.123590:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171728896 00000100:00100000:1.0:1787857832.123600:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171728896 00000100:00100000:1.0:1787857832.123691:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1204 00000100:00100000:1.0:1787857832.123701:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30138:x1874704171728896:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857832.123734:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857832.123882:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30138:x1874704171728896:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 182us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857832.123890:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1204 00000100:00100000:2.0:1787857832.142841:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857832.142873:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171729152 00000100:00100000:0.0:1787857832.142882:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171729152 00000100:00100000:0.0:1787857832.142940:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1205 00000100:00100000:0.0:1787857832.142950:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30138:x1874704171729152:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857832.142969:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857832.142988:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cf2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3db1 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.143094:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.143107:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.143121:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857832.143132:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:0.0:1787857832.143302:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7cf2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db1 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.143321:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db1 expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.143336:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:0.0:1787857832.143339:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857832.143343:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71c00, rc 0) 00000100:00100000:0.0:1787857832.143410:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30138:x1874704171729152:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 461us (592us total) trans 4294968086 rc 0/0 00000100:00100000:0.0:1787857832.143417:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1205 00000100:00100000:3.0:1787857832.149798:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.149872:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857832.149873:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171729408 00000100:00100000:1.0:1787857832.149884:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171729408 00000100:00100000:3.0:1787857832.149911:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171729280 00000100:00100000:3.0:1787857832.149916:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171729280 00000100:00100000:1.0:1787857832.149952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00100000:3.0:1787857832.149957:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 325 00000100:00100000:1.0:1787857832.149964:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2348:x1874704171729408:12345-192.168.204.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787857832.149972:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171729280:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857832.149983:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857832.150017:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7cf35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db1 expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.150025:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.150037:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:1.0:1787857832.150043:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857832.150048:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.150059:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857832.150064:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857832.150068:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857832.150098:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2348:x1874704171729408:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 136us (309us total) trans 0 rc 0/0 00010000:00010000:3.0:1787857832.150102:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857832.150113:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 53 00010000:00010000:3.0:1787857832.150135:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 11 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.150153:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188265472:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857832.150223:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857832.156930:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.157370:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188265472:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857832.157404:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857832.157510:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171729536 00000100:00100000:0.0:1787857832.157518:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171729536 00002000:00100000:0.0:1787857832.157574:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (0->157) req@ffff999901450000 x1874704171729536/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:478/0 lens 648/0 e 0 to 0 dl 1787857843 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857832.157583:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901450000 with x1874704171729536 ext(0->157) 00010000:00010000:0.0:1787857832.157591:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 12 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.157606:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 12 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857832.157615:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff999901450000 00000100:00100000:0.0:1787857832.157653:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:0.0:1787857832.157665:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171729536:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:0.0:1787857832.158259:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171729536:12345-192.168.204.36@tcp:4:cp.0 Request processed in 594us (1334us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787857832.158267:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00002000:00100000:0.0:1787857832.158275:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (0->157) req@ffff999901450000 x1874704171729536/t4294967370(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:478/0 lens 648/448 e 0 to 0 dl 1787857843 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857832.158284:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901450000 with x1874704171729536 ext(0->157) 00010000:00010000:0.0:1787857832.158292:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 14 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.158305:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 14 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857832.158312:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff999901450000 00000100:00100000:2.0:1787857832.165636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857832.165722:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171729664 00000100:00100000:0.0:1787857832.165734:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171729664 00010000:00010000:0.0:1787857832.165789:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 14 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857832.165852:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 358 00000100:00100000:0.0:1787857832.165863:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171729664:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857832.165878:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857832.165903:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 14 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.165919:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 14 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.165945:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ab8ed67/0xd3f183cab4a7ceef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d8e expref: 14 pid: 14028 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.165964:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857832.165968:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857832.165973:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.165982:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.166011:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857832.166064:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171729664:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 204us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857832.166071:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 358 00010000:00010000:2.0:1787857832.166662:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.166897:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.166926:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.166936:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.166945:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.166952:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857832.166956:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.166963:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.166981:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.166989:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000519815eb/0xd3f183cab4a7cf43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857832.167061:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171729280:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 17095us (17187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857832.167070:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 325 00000100:00100000:2.0:1787857832.182582:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.182733:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171729920 00000100:00100000:3.0:1787857832.182744:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171729920 00000100:00100000:3.0:1787857832.182805:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1206 00000100:00100000:3.0:1787857832.182838:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30138:x1874704171729920:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857832.182968:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30138:x1874704171729920:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 153us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857832.182977:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1206 00000100:00100000:0.0:1787857832.187954:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.188288:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171730048 00000100:00100000:2.0:1787857832.188298:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171730048 00000100:00100000:2.0:1787857832.188348:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 326 00000100:00100000:2.0:1787857832.188355:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171730048:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857832.188433:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857832.188456:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3db8 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857832.188556:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a908ba7, atime: 0x0, ctime: 0x6a908ba7, blocks: 0x1 00010000:00010000:2.0:1787857832.188576:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787857832.188581:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857832.188591:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.188608:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.188622:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74e00, rc 0) 00000100:00100000:2.0:1787857832.188693:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171730048:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 337us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857832.188701:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 326 00000100:00100000:2.0:1787857832.202510:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857832.202975:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171730304 00000100:00100000:0.0:1787857832.202985:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171730304 00000100:00100000:0.0:1787857832.203266:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1207 00000100:00100000:0.0:1787857832.203279:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30138:x1874704171730304:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857832.203393:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30138:x1874704171730304:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 118us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857832.203402:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1207 00000100:00100000:1.0:1787857832.212351:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.212439:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171730432 00000100:00100000:3.0:1787857832.212450:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171730432 00002000:00100000:3.0:1787857832.212511:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff999901451680 x1874704171730432/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:478/0 lens 488/0 e 0 to 0 dl 1787857843 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857832.212524:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901451680 with x1874704171730432 ext(0->4095) 00002000:00010000:3.0:1787857832.212530:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999901451680 00000100:00100000:3.0:1787857832.212578:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 105 00000100:00100000:3.0:1787857832.212589:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171730432:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787857832.212810:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171730432:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 222us (641us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787857832.213018:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 105 00002000:00100000:3.0:1787857832.213026:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff999901451680 x1874704171730432/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:478/0 lens 488/4536 e 0 to 0 dl 1787857843 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857832.213035:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901451680 with x1874704171730432 ext(0->4095) 00002000:00010000:3.0:1787857832.213039:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999901451680 00000100:00100000:0.0:1787857832.222307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857832.222646:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171730560 00000100:00100000:1.0:1787857832.222656:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171730560 00000100:00100000:1.0:1787857832.222867:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1208 00000100:00100000:1.0:1787857832.222879:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30138:x1874704171730560:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857832.222905:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857832.222929:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cf51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3dbf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.222969:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.222981:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.222992:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.223094:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cf51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.223128:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.223137:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:1.0:1787857832.223140:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857832.223143:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053400, rc 0) 00000100:00100000:1.0:1787857832.223646:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30138:x1874704171730560:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 768us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857832.223656:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1208 00000100:00100000:0.0:1787857832.235577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.237536:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171730688 00000100:00100000:3.0:1787857832.237551:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171730688 00000100:00100000:3.0:1787857832.237631:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1209 00000100:00100000:3.0:1787857832.237642:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30138:x1874704171730688:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857832.237676:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857832.237796:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30138:x1874704171730688:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 155us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857832.237804:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1209 00000100:00100000:2.0:1787857832.245762:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.246011:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171730816 00000100:00100000:3.0:1787857832.246021:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171730816 00000100:00100000:3.0:1787857832.246088:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 327 00000100:00100000:3.0:1787857832.246099:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171730816:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857832.246141:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246158:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857832.246163:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857832.246170:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246184:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246215:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246223:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246231:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246238:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857832.246242:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246251:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246266:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.246274:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e797f6e5/0xd3f183cab4a7cf5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.246346:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171730816:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 249us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857832.246354:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 327 00000100:00100000:1.0:1787857832.253247:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.253536:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171731072 00000100:00100000:3.0:1787857832.253547:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171731072 00000100:00100000:3.0:1787857832.253622:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1210 00000100:00100000:3.0:1787857832.253633:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30138:x1874704171731072:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857832.253707:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.253726:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.253736:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.253769:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.253784:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 48 pid: 5858 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.253799:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188265600:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857832.254575:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857832.258289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.258394:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188265600:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857832.258427:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.268384:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171731200 00000100:00100000:3.0:1787857832.268401:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171731200 00010000:00010000:3.0:1787857832.268450:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 49 pid: 5858 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.268507:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 359 00000100:00100000:3.0:1787857832.268517:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2350:x1874704171731200:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857832.268532:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857832.268539:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 49 pid: 5858 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268552:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 49 pid: 5858 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268574:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7cf58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dbf expref: 49 pid: 5858 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268588:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:3.0:1787857832.268593:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268604:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268616:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268642:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857832.268698:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2350:x1874704171731200:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 183us (10418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857832.268706:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 359 00010000:00010000:3.0:1787857832.268737:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268745:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268942:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268951:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268957:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268963:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857832.268967:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268975:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268984:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:3.0:1787857832.268987:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857832.268991:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.268997:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7cf66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.269109:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30138:x1874704171731072:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 15478us (15870us total) trans 4294968087 rc 0/0 00000100:00100000:3.0:1787857832.269118:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1210 00000040:00080000:3.0:1787857832.270707:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857832.270714:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857832.272023:0:21277:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857832.272029:0:21277:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857832.272074:0:21277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 35 count 3 00000040:00080000:2.0:1787857832.272080:0:21277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787857832.276328:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787857832.276347:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857832.278765:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.278910:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171731456 00000100:00100000:2.0:1787857832.278920:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171731456 00000100:00100000:2.0:1787857832.279012:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 240 00000100:00100000:2.0:1787857832.279023:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30138:x1874704171731456:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857832.279280:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30138:x1874704171731456:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 258us (525us total) trans 4294968088 rc 0/0 00000100:00100000:2.0:1787857832.279289:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 240 00000100:00100000:3.0:1787857832.433780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857832.437050:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171731712 00000100:00100000:1.0:1787857832.437067:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171731712 00000100:00100000:1.0:1787857832.437134:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1211 00000100:00100000:1.0:1787857832.437144:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+98:30144:x1874704171731712:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857832.437163:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857832.437183:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cf6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3dc6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.437296:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cf74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.437311:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cf74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.437323:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cf74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857832.437352:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:1.0:1787857832.438166:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cf6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dc6 expref: 101 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.438185:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cf74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dc6 expref: 100 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.438193:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:1.0:1787857832.438196:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857832.438199:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053c00, rc 0) 00000100:00100000:1.0:1787857832.438269:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+100:30144:x1874704171731712:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1126us (4511us total) trans 4294968089 rc 0/0 00000100:00100000:1.0:1787857832.438277:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1211 00000100:00100000:0.0:1787857832.446665:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.447524:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171731840 00000100:00100000:3.0:1787857832.447536:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171731840 00000100:00100000:3.0:1787857832.447650:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 328 00000100:00100000:3.0:1787857832.447661:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171731840:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857832.447680:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857832.447699:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3dcd expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.447726:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857832.447731:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857832.447740:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 13 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.447757:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 13 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.447771:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72c00, rc 0) 00000100:00100000:3.0:1787857832.447853:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171731840:12345-192.168.204.36@tcp:101:cat.0 Request processed in 192us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857832.447861:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 328 00000100:00100000:1.0:1787857832.449067:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857832.449167:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171731968 00000100:00100000:1.0:1787857832.449175:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171731968 00000100:00100000:1.0:1787857832.450047:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:1.0:1787857832.450057:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:2348:x1874704171731968:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857832.450072:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857832.450098:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7cf74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dc6 expref: 100 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.450117:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:1.0:1787857832.450122:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857832.450167:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+99:2348:x1874704171731968:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 112us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857832.450191:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:1.0:1787857832.457984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.458153:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171732096 00000100:00100000:3.0:1787857832.458174:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171732096 00002000:00100000:3.0:1787857832.458348:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff999901451e00 x1874704171732096/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:478/0 lens 488/0 e 0 to 0 dl 1787857843 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857832.458360:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901451e00 with x1874704171732096 ext(0->4095) 00002000:00010000:3.0:1787857832.458367:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999901451e00 00000100:00100000:3.0:1787857832.458401:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 106 00000100:00100000:3.0:1787857832.458411:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171732096:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:3.0:1787857832.458668:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171732096:12345-192.168.204.36@tcp:3:cat.0 Request processed in 258us (695us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787857832.458677:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 106 00002000:00100000:3.0:1787857832.458684:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff999901451e00 x1874704171732096/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:478/0 lens 488/4536 e 0 to 0 dl 1787857843 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857832.458691:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901451e00 with x1874704171732096 ext(0->4095) 00002000:00010000:3.0:1787857832.458695:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999901451e00 00000100:00100000:0.0:1787857832.468013:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.468129:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171732352 00000100:00100000:3.0:1787857832.468140:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171732352 00000100:00100000:3.0:1787857832.468303:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 241 00000100:00100000:3.0:1787857832.468313:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+99:30144:x1874704171732352:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857832.468580:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:30144:x1874704171732352:12345-192.168.204.36@tcp:35:cat.0 Request processed in 269us (770us total) trans 4294968090 rc 0/0 00000100:00100000:3.0:1787857832.468588:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 241 00000100:00100000:3.0:1787857832.500591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857832.500680:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171732608 00000100:00100000:1.0:1787857832.500704:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171732608 00000100:00100000:1.0:1787857832.500879:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1212 00000100:00100000:1.0:1787857832.500891:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:30145:x1874704171732608:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857832.500929:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857832.500961:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cf89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3dd4 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.501091:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cf90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.501107:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cf90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.501121:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cf90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857832.501134:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:1.0:1787857832.501286:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cf89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dd4 expref: 103 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.501302:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cf90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dd4 expref: 102 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.501308:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:1.0:1787857832.501310:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857832.501327:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:1.0:1787857832.501378:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:30145:x1874704171732608:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 492us (800us total) trans 4294968091 rc 0/0 00000100:00100000:1.0:1787857832.501384:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1212 00000100:00100000:1.0:1787857832.504519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.504583:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171732736 00000100:00100000:2.0:1787857832.504593:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171732736 00000100:00100000:2.0:1787857832.504652:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 329 00000100:00100000:2.0:1787857832.504662:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171732736:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:2.0:1787857832.504708:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.504731:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.504740:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 13 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.504747:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857832.504752:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857832.504756:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.504794:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 13 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.504809:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 13 pid: 14028 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857832.505048:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188265728:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857832.505410:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.505424:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 12 pid: 6713 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.505435:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188265856:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857832.505483:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857832.509507:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857832.509544:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.509587:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171732864 00000100:00100000:2.0:1787857832.509595:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171732864 00010000:00010000:2.0:1787857832.509629:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 14 pid: 14028 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857832.509882:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171732992 00000100:00100000:2.0:1787857832.509887:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171732992 00010000:00010000:2.0:1787857832.509906:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 13 pid: 6713 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.510203:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188265728:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857832.510223:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188265856:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857832.510254:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857832.511238:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 360 00000100:00100000:2.0:1787857832.511255:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+14:2349:x1874704171732864:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857832.511275:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857832.511311:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 14 pid: 14028 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511328:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 14 pid: 14028 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511354:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7cf82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dcd expref: 14 pid: 14028 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511375:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857832.511433:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 361 00000100:00100000:2.0:1787857832.511439:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171732864:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 190us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857832.511446:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171732992:12345-192.168.204.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787857832.511454:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 360 00010000:00010000:0.0:1787857832.511498:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857832.511512:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 13 pid: 6713 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.511525:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 13 pid: 6713 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.511541:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4e624c/0xd3f183cab4a7cf4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3db8 expref: 13 pid: 6713 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.511555:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857832.511559:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857832.511564:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.511573:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.511608:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857832.511634:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171732992:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 193us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857832.511641:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 361 00010000:00010000:2.0:1787857832.511662:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511680:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511707:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511726:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511735:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511743:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857832.511747:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511966:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511982:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.511989:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7cf9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857832.512043:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+12:2350:x1874704171732736:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 7382us (7534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857832.512051:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 329 00000100:00100000:1.0:1787857832.515015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.515437:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171733248 00000100:00100000:2.0:1787857832.515449:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171733248 00000100:00100000:2.0:1787857832.515551:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 242 00000100:00100000:2.0:1787857832.515560:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+102:30145:x1874704171733248:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:2.0:1787857832.515624:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x23:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cf90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dd4 expref: 102 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857832.515913:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968092 00000001:00080000:2.0:1787857832.517079:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968093 00010000:00010000:2.0:1787857832.517153:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.517581:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.517590:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 105 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.517599:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.517639:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 105 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.517662:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 105 pid: 19301 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857832.518239:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188265984:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857832.518639:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.518652:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 48 pid: 5857 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857832.518662:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188266112:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857832.518697:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857832.523399:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188265984:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857832.523561:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.523640:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188266112:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857832.523670:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.523778:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171733376 00000100:00100000:3.0:1787857832.523786:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171733376 00010000:00010000:3.0:1787857832.523851:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 106 pid: 19301 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857832.523893:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 362 00000100:00100000:3.0:1787857832.523903:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+106:2350:x1874704171733376:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857832.523921:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857832.523929:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 106 pid: 19301 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.523942:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 106 pid: 19301 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.525110:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7cf0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d95 expref: 106 pid: 19301 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.525140:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:3.0:1787857832.525146:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.525154:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.525161:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857832.525325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.525375:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+105:2350:x1874704171733376:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1472us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857832.525386:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 362 00000100:00100000:2.0:1787857832.525521:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171733504 00000100:00100000:2.0:1787857832.525527:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171733504 00010000:00010000:2.0:1787857832.525551:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 49 pid: 5857 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857832.527609:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 363 00000100:00100000:2.0:1787857832.527633:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2349:x1874704171733504:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857832.527658:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857832.527669:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 49 pid: 5857 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.527685:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 49 pid: 5857 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.527709:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7ceda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d80 expref: 49 pid: 5857 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.527741:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:2.0:1787857832.527746:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.527761:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.527769:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.527793:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857832.527854:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171733504:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 233us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857832.527862:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 363 00010000:00010000:0.0:1787857832.528322:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.528330:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857832.528457:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968094 00000001:00080000:0.0:1787857832.528690:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968095 00000001:00080000:0.0:1787857832.528762:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968096 00000100:00100000:0.0:1787857832.529303:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188266240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787857832.531565:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857832.531610:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857832.531934:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188266240 00000100:00100000:1.0:1787857832.531943:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188266240 00000100:00100000:1.0:1787857832.532005:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787857832.532015:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188266240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857832.532135:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188266240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857832.532142:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787857832.532302:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188266240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787857832.532731:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968097 00000100:00100000:0.0:1787857832.532838:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188266368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787857832.532875:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857832.532891:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857832.532998:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188266368 00000100:00100000:1.0:1787857832.533003:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188266368 00000100:00100000:1.0:1787857832.533110:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787857832.533120:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188266368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857832.533294:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1874704188266368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 176us (418us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787857832.533301:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787857832.533359:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188266368:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:0.0:1787857832.533380:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.533389:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.533396:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.533403:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857832.533408:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.533420:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.533436:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:0.0:1787857832.533440:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787857832.533445:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.533451:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7cfa5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857832.533629:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x49:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787857832.533735:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 64 off9440 00000004:00080000:0.0:1787857832.533747:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 656583929845ns, next at 657583927863ns, rc = 0 00000001:00080000:0.0:1787857832.533754:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968098 00010000:00010000:0.0:1787857832.533789:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379400) 00010000:00010000:0.0:1787857832.533792:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787857832.533799:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cf90 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dd4 expref: 109 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857832.533928:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:30145:x1874704171733248:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 18368us (18923us total) trans 4294968099 rc 0/0 00000100:00100000:0.0:1787857832.533937:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 242 00000020:00080000:0.0:1787857832.533941:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1787857832.600419:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857832.600499:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171733760 00000100:00100000:3.0:1787857832.600510:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171733760 00000100:00100000:3.0:1787857832.600572:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1213 00000100:00100000:3.0:1787857832.600581:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:30151:x1874704171733760:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857832.600606:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857832.600627:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cfac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ddb expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.600698:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.600727:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.600739:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.600763:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.600770:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.600777:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601201:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cfc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601212:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601220:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857832.601230:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:3.0:1787857832.601327:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601335:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601343:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601350:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857832.601355:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601363:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601376:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:3.0:1787857832.601379:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857832.601383:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601390:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7cfb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601404:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601410:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601415:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601422:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857832.601424:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601429:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601439:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9998d12ef700) 00010000:00010000:3.0:1787857832.601442:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857832.601445:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601450:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7cfba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601504:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7cfac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ddb expref: 111 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601519:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cfc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ddb expref: 110 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857832.601526:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:3.0:1787857832.601529:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857832.601531:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:2.0:1787857832.601810:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+110:30151:x1874704171733760:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1228us (1400us total) trans 4294968100 rc 0/0 00000100:00100000:2.0:1787857832.601846:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1213 00000100:00100000:2.0:1787857832.605859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857832.605933:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171734016 00000100:00100000:0.0:1787857832.605943:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171734016 00000100:00100000:0.0:1787857832.606009:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:0.0:1787857832.606020:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+110:30151:x1874704171734016:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:0.0:1787857832.606036:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857832.606061:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7cfc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ddb expref: 110 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857832.606082:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:0.0:1787857832.606093:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857832.606152:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+109:30151:x1874704171734016:12345-192.168.204.36@tcp:103:cat.0 Request processed in 135us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857832.606160:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:1.0:1787857832.610046:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857832.611892:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171734144 00000100:00100000:2.0:1787857832.611906:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171734144 00000100:00100000:2.0:1787857832.612025:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1214 00000100:00100000:2.0:1787857832.612036:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+109:30151:x1874704171734144:12345-192.168.204.36@tcp:58:cat.0 00010000:00010000:2.0:1787857832.612136:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.612153:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857832.612165:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857832.612358:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].35, 136 off12952 00000100:00100000:2.0:1787857832.612450:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+109:30151:x1874704171734144:12345-192.168.204.36@tcp:58:cat.0 Request processed in 415us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857832.612470:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1214 00000100:00100000:0.0:1787857832.616883:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857832.623493:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171734272 00000100:00100000:1.0:1787857832.623510:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171734272 00000100:00100000:1.0:1787857832.623614:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1215 00000100:00100000:1.0:1787857832.623625:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+109:30151:x1874704171734272:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857832.623665:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857832.623791:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3de2 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.623880:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.623891:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 110 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.623911:0:7656:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.623924:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 110 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.623937:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:1.0:1787857832.623940:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857832.623944:0:7656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 110 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857832.623952:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052000, rc 0) 00000100:00100000:1.0:1787857832.624018:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+110:30151:x1874704171734272:12345-192.168.204.36@tcp:101:cat.0 Request processed in 394us (7143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857832.624026:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1215 00010000:00010000:2.0:1787857832.686506:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857833.326054:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857833.326063:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857833.326210:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 36 count 3 00000040:00080000:3.0:1787857833.326217:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857833.326330:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188266496:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857833.326681:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857833.341876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.341997:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171734400 00000100:00100000:2.0:1787857833.342006:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171734400 00000100:00100000:2.0:1787857833.342082:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1216 00000100:00100000:2.0:1787857833.342094:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30152:x1874704171734400:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857833.342133:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857833.342261:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30152:x1874704171734400:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 169us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857833.342271:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1216 00000100:00100000:2.0:1787857833.342336:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188266496:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1787857833.342868:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857833.359218:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.359376:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171734528 00000100:00100000:1.0:1787857833.359387:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171734528 00000100:00100000:1.0:1787857833.359459:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1217 00000100:00100000:1.0:1787857833.359485:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30152:x1874704171734528:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787857833.359564:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359584:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359599:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359615:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359623:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359630:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359653:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359661:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359668:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857833.359705:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:1.0:1787857833.359709:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857833.359723:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359744:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359750:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359757:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359763:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857833.359767:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359774:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359786:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857833.359789:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857833.359793:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.359985:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7cfdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360000:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360007:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360013:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360025:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857833.360028:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360034:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360042:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x92f5931a (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857833.360044:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857833.360047:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360053:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7cfe4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360066:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360071:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360076:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360079:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857833.360082:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360087:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360101:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:1.0:1787857833.360103:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857833.360106:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.360112:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7cfeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857833.360600:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30152:x1874704171734528:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 1113us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857833.360609:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1217 00000100:00100000:3.0:1787857833.373382:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857833.373465:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171734784 00000100:00100000:0.0:1787857833.373475:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171734784 00000100:00100000:0.0:1787857833.373538:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1218 00000100:00100000:0.0:1787857833.373552:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30152:x1874704171734784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857833.373582:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857833.373603:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cff2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3de9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373707:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373723:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373735:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857833.373747:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:0.0:1787857833.373908:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373916:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373923:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373929:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857833.373933:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373940:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373952:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:0.0:1787857833.373955:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857833.373960:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.373966:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7cff9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.374009:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cff2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de9 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.374022:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:0.0:1787857833.374025:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857833.374029:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7cff2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de9 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.374039:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70600, rc 0) 00000100:00100000:1.0:1787857833.375021:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30152:x1874704171734784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1467us (1644us total) trans 4294968101 rc 301/301 00000100:00100000:1.0:1787857833.375033:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1218 00000100:00100000:2.0:1787857833.406210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.411418:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171734912 00000100:00100000:1.0:1787857833.411436:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171734912 00000100:00100000:1.0:1787857833.412130:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1219 00000100:00100000:1.0:1787857833.412142:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30152:x1874704171734912:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857833.412184:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857833.412319:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30152:x1874704171734912:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 179us (6120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857833.412327:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1219 00000100:00100000:0.0:1787857833.423172:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.423622:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171735168 00000100:00100000:1.0:1787857833.423635:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171735168 00000100:00100000:1.0:1787857833.423729:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1220 00000100:00100000:1.0:1787857833.423743:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30152:x1874704171735168:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857833.424091:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857833.424120:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d007 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3df0 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.426480:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d00e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.426516:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d00e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.426531:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d00e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857833.426552:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00010000:00010000:1.0:1787857833.426627:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d007 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df0 expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.426654:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d00e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df0 expref: 51 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.426663:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857833.426667:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857833.426671:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052200, rc 0) 00000100:00100000:1.0:1787857833.427012:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:30152:x1874704171735168:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3270us (3849us total) trans 4294968102 rc 0/0 00000100:00100000:1.0:1787857833.427021:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1220 00000100:00100000:3.0:1787857833.434282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.434571:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171735424 00000100:00100000:1.0:1787857833.434581:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171735424 00000100:00100000:1.0:1787857833.434636:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1221 00000100:00100000:1.0:1787857833.434657:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:30152:x1874704171735424:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857833.434720:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857833.434756:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d00e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df0 expref: 51 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.434774:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857833.434784:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857833.434811:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.434871:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 109 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.434882:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.434918:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 109 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.434933:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 109 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857833.434949:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188266624:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857833.435052:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857833.439377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.439856:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188266624:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857833.439890:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857833.448291:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171735552 00000100:00100000:3.0:1787857833.448311:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171735552 00010000:00010000:3.0:1787857833.448401:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 110 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857833.448501:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 364 00000100:00100000:3.0:1787857833.448514:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+110:2350:x1874704171735552:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857833.448536:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857833.448545:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 110 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.448560:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 110 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.448593:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7cf20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3da3 expref: 110 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.448617:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:3.0:1787857833.448623:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.448634:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.448644:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.448691:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857833.448781:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+109:2350:x1874704171735552:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 270us (9415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857833.448790:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 364 00000100:00080000:0.0:1787857833.448878:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857833.450317:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450335:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450377:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450394:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450405:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450764:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450772:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450780:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450786:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857833.450791:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450800:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450866:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:2.0:1787857833.450870:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857833.450874:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450881:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d01c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450893:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450899:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450904:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450909:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857833.450911:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450917:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450924:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x7796e88a (ffff9998c3379900) 00010000:00010000:2.0:1787857833.450926:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857833.450929:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.450940:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d023 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x7796e88a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857833.451035:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:30152:x1874704171735424:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 16374us (16760us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857833.451044:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1221 00000100:00100000:0.0:1787857833.460568:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.460661:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171735680 00000100:00100000:1.0:1787857833.460670:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171735680 00000100:00100000:1.0:1787857833.460731:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1222 00000100:00100000:1.0:1787857833.460741:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:30152:x1874704171735680:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857833.460761:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857833.460784:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d02a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3df7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.460852:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.460866:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.460879:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.461003:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d02a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.461026:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.461035:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857833.461038:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857833.461042:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857833.461365:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:30152:x1874704171735680:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 398us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857833.461385:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1222 00000100:00100000:2.0:1787857833.473497:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.473613:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171735936 00000100:00100000:1.0:1787857833.473625:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171735936 00000100:00100000:1.0:1787857833.473699:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1223 00000100:00100000:1.0:1787857833.473711:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:30152:x1874704171735936:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857833.473881:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.473907:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.473922:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857833.474228:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec6c27ee reply state 00000000b65a2b0a transno 4294968103 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857833.474239:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857833.474357:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:30152:x1874704171735936:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 648us (874us total) trans 4294968103 rc 0/0 00000100:00100000:1.0:1787857833.474367:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1223 00010000:00010000:0.0:1787857833.479999:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.480017:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.480023:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.480027:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857833.480031:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.480036:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.480054:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:0.0:1787857833.480056:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787857833.480060:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.480063:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d038 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857833.504776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.504905:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171736064 00000100:00100000:1.0:1787857833.504914:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171736064 00000100:00100000:1.0:1787857833.504984:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1224 00000100:00100000:1.0:1787857833.504994:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:30152:x1874704171736064:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857833.505017:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857833.505037:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3dfe expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.505131:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.505296:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.505308:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857833.505310:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857833.505315:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053400, rc 0) 00000100:00100000:1.0:1787857833.505424:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:30152:x1874704171736064:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 430us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857833.505431:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1224 00000100:00100000:3.0:1787857833.508572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.508762:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171736192 00000100:00100000:2.0:1787857833.508773:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171736192 00000100:00100000:0.0:1787857833.508929:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 243 00000100:00100000:0.0:1787857833.508943:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:30152:x1874704171736192:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787857833.509129:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:30152:x1874704171736192:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 189us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857833.509136:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 243 00000100:00100000:0.0:1787857833.516733:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.516986:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171736448 00000100:00100000:2.0:1787857833.517005:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171736448 00000100:00100000:2.0:1787857833.517070:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 244 00000100:00100000:2.0:1787857833.517082:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6122450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:30152:x1874704171736448:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857833.517345:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6122450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30152:x1874704171736448:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 264us (622us total) trans 4294968104 rc 0/0 00000100:00100000:2.0:1787857833.517354:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 244 00000100:00100000:0.0:1787857833.526116:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.528380:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171736704 00000100:00100000:1.0:1787857833.528401:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171736704 00000100:00100000:1.0:1787857833.528479:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1225 00000100:00100000:1.0:1787857833.528488:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30152:x1874704171736704:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857833.528605:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30152:x1874704171736704:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 118us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857833.528612:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1225 00000100:00100000:3.0:1787857833.546423:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.546522:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171736960 00000100:00100000:2.0:1787857833.546533:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171736960 00000100:00100000:2.0:1787857833.546617:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1226 00000100:00100000:2.0:1787857833.546629:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30152:x1874704171736960:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857833.546649:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857833.546676:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e05 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.546790:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.546806:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.546863:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.546905:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.546920:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 55 pid: 5856 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857833.546935:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188266752:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857833.547050:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857833.552385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.552778:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188266752:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857833.552858:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.552988:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171737088 00000100:00100000:0.0:1787857833.552996:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171737088 00010000:00010000:0.0:1787857833.553047:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 56 pid: 5856 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.553084:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 365 00000100:00100000:0.0:1787857833.553094:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:2350:x1874704171737088:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857833.553109:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857833.553116:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 56 pid: 5856 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.553129:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 56 pid: 5856 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.553162:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d03f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3dfe expref: 56 pid: 5856 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.553177:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:0.0:1787857833.553183:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.553196:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.553204:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.553238:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857833.553270:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553280:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.553294:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:2350:x1874704171737088:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 200us (919us total) trans 0 rc 0/0 00000004:00200000:1.0:1787857833.553300:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00000100:00100000:0.0:1787857833.553303:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 365 00000004:00080000:1.0:1787857833.553623:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:1.0:1787857833.553755:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553765:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553773:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553779:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857833.553784:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553792:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553802:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857833.553805:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857833.553809:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553842:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d04d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553895:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d046 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e05 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553905:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:1.0:1787857833.553908:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857833.553912:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e05 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.553933:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:1.0:1787857833.553970:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30152:x1874704171736960:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 7343us (7597us total) trans 4294968105 rc 301/301 00000100:00100000:1.0:1787857833.553978:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1226 00000100:00100000:3.0:1787857833.562542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.563716:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171737344 00000100:00100000:2.0:1787857833.563728:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171737344 00000100:00100000:2.0:1787857833.563802:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 245 00000100:00100000:2.0:1787857833.563813:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30152:x1874704171737344:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857833.564787:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:30152:x1874704171737344:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 973us (2252us total) trans 4294968106 rc 0/0 00000100:00100000:2.0:1787857833.564796:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 245 00000100:00100000:0.0:1787857833.568189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.568370:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171737472 00000100:00100000:1.0:1787857833.568381:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171737472 00000100:00100000:1.0:1787857833.568457:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1227 00000100:00100000:1.0:1787857833.568467:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:30152:x1874704171737472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857833.568492:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857833.568516:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d05b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e0c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.568588:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.568602:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.568615:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857833.568649:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00000004:00200000:1.0:1787857833.568653:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857833.568668:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.568691:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d05b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e0c expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.568729:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e0c expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.568748:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857833.568752:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787857833.568755:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053400, rc 0) 00000100:00100000:1.0:1787857833.568813:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:30152:x1874704171737472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 347us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857833.568860:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1227 00000100:00100000:2.0:1787857833.576322:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857833.576466:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171737600 00000100:00100000:0.0:1787857833.576479:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171737600 00000100:00100000:0.0:1787857833.576574:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 330 00000100:00100000:0.0:1787857833.576585:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171737600:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857833.576603:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857833.576622:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e13 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857833.576648:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857833.576672:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1787857833.576677:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857833.576686:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.576705:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 9 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.576725:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00080000:2.0:1787857833.576750:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857833.576782:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171737600:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 200us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857833.576790:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 330 00000100:00100000:3.0:1787857833.607507:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.607977:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171737856 00000100:00100000:2.0:1787857833.607987:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171737856 00000100:00100000:2.0:1787857833.608106:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1228 00000100:00100000:2.0:1787857833.608116:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:30152:x1874704171737856:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857833.608233:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:30152:x1874704171737856:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 118us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857833.608240:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1228 00000100:00100000:2.0:1787857833.617076:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857833.617146:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171737984 00000100:00100000:0.0:1787857833.617738:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171737984 00000100:00100000:0.0:1787857833.617814:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 331 00000100:00100000:0.0:1787857833.617868:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:30152:x1874704171737984:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857833.617887:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857833.617903:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e1a expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.617937:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.617947:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857833.617952:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857833.617957:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.617993:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.618008:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 10 pid: 6714 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.618024:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c30421c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188266880:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857833.618131:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857833.623713:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c30421c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188266880:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857833.623784:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.623809:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71400, rc 0) 00000100:00100000:0.0:1787857833.623933:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:30152:x1874704171737984:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6066us (6866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857833.623943:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 331 00000100:00100000:2.0:1787857833.627382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857833.627529:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171738112 00000100:00100000:0.0:1787857833.627539:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171738112 00010000:00010000:0.0:1787857833.627584:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 10 pid: 6714 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.627689:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 366 00000100:00100000:0.0:1787857833.627700:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171738112:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857833.627726:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857833.627749:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 10 pid: 6714 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.627763:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 10 pid: 6714 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.627793:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7d069 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e13 expref: 10 pid: 6714 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.627811:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857833.627861:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857833.627879:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.627890:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.627932:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.627948:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c30421c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188267008:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857833.628038:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857833.639055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.639270:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171738240 00000100:00100000:1.0:1787857833.639287:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171738240 00002000:00100000:1.0:1787857833.639357:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x18:0x0] (0->157) req@ffff999901589680 x1874704171738240/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:479/0 lens 648/0 e 0 to 0 dl 1787857844 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857833.639368:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901589680 with x1874704171738240 ext(0->157) 00002000:00010000:1.0:1787857833.639374:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff999901589680 00000100:00100000:1.0:1787857833.639413:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:1.0:1787857833.639424:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901589680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171738240:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787857833.640228:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c30421c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188267008:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857833.640267:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857833.640343:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171738112:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 12642us (12970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857833.640356:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 366 00000100:00100000:1.0:1787857833.640418:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901589680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171738240:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 991us (1374us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787857833.640429:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 107 00002000:00100000:1.0:1787857833.640452:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x18:0x0] (0->157) req@ffff999901589680 x1874704171738240/t4294967360(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:479/0 lens 648/448 e 0 to 0 dl 1787857844 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857833.640462:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901589680 with x1874704171738240 ext(0->157) 00002000:00010000:1.0:1787857833.640474:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff999901589680 00000100:00100000:3.0:1787857833.647417:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.647665:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171738368 00000100:00100000:1.0:1787857833.647681:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171738368 00000100:00100000:1.0:1787857833.647769:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1229 00000100:00100000:1.0:1787857833.647782:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:30152:x1874704171738368:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787857833.711947:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857833.770304:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:30152:x1874704171738368:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 122509us (122890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857833.770331:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1229 00000001:00080000:2.0:1787857833.771147:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968101 is committed 00000001:00080000:2.0:1787857833.771161:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968099 is committed 00000004:00080000:2.0:1787857833.771165:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 21 committed 00000020:00080000:2.0:1787857833.771196:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff999900d59480 refcount 2 committed 0 result 0 batchid 25 00000020:00080000:2.0:1787857833.771202:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f0ce5d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff999900d59180 00000020:00080000:2.0:1787857833.771207:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f0ce5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998c71fd800 00000001:00080000:2.0:1787857833.771232:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968105 is committed 00000001:00080000:2.0:1787857833.771251:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968106 is committed 00000001:00080000:2.0:1787857833.771274:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968100 is committed 00000020:00080000:3.0:1787857833.771603:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25 committed batchid 24 00000020:00080000:3.0:1787857833.772071:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 24 00000100:00100000:0.0:1787857833.772525:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857833.772563:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188267136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787857833.772662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857833.773185:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188267136 00000100:00100000:2.0:1787857833.773201:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188267136 00000100:00100000:2.0:1787857833.773301:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787857833.773500:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188267136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787857833.773543:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:26 count 1 00002000:00010000:2.0:1787857833.773775:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a908ba7, atime: 0x0, ctime: 0x6a908ba7, blocks: 0x1 00010000:00010000:2.0:1787857833.773786:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.773808:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1787857833.773813:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857833.773864:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.773883:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.773894:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.773902:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.773923:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1787857833.774505:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857833.775767:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188267136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2376us (3024us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787857833.775783:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:2.0:1787857833.776056:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857833.776064:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.776080:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857833.776087:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.776108:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.776133:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.776147:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d077 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.776172:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857833.776175:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857833.776177:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787857833.776594:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998e185f480/2, rc 0, transno 4294967372 00000100:00100000:0.0:1787857833.776604:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188267136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787857833.777087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857833.777540:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171738496 00000100:00100000:3.0:1787857833.777548:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171738496 00000100:00100000:3.0:1787857833.777616:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 333 00000100:00100000:3.0:1787857833.777629:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171738496:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787857833.844806:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171738496:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 67161us (67704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857833.844849:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 333 00000001:00080000:0.0:1787857833.845147:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000100:00100000:1.0:1787857833.852655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.853020:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171738752 00000100:00100000:2.0:1787857833.853031:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171738752 00000100:00100000:2.0:1787857833.853114:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1230 00000100:00100000:2.0:1787857833.853124:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30152:x1874704171738752:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857833.853198:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857833.853231:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d062 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e0c expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.853253:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:2.0:1787857833.853259:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857833.853290:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.853320:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.853332:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857833.853696:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c46c697a reply state 0000000095de4dc3 transno 4294968107 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857833.853707:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857833.856914:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30152:x1874704171738752:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 3234us (3717us total) trans 4294968107 rc 0/0 00000100:00100000:2.0:1787857833.856933:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1230 00000100:00100000:1.0:1787857833.862239:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.862313:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171738880 00000100:00100000:2.0:1787857833.862324:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171738880 00000100:00100000:2.0:1787857833.862402:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1231 00000100:00100000:2.0:1787857833.862414:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30152:x1874704171738880:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857833.862460:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857833.862485:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e21 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.862574:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 49 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.862591:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 49 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.862612:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:2.0:1787857833.862616:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857833.862621:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75000, rc 0) 00000100:00100000:2.0:1787857833.862696:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30152:x1874704171738880:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 284us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857833.862704:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1231 00010000:00010000:3.0:1787857833.865975:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.865993:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.866001:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.866008:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857833.866013:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.866022:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.866042:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:3.0:1787857833.866045:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857833.866051:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.866058:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d07e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.871635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.871804:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171739008 00000100:00100000:1.0:1787857833.871965:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171739008 00000100:00100000:1.0:1787857833.872085:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 334 00000100:00100000:1.0:1787857833.872099:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2347:x1874704171739008:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787857833.872622:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787857833.872627:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1787857831 00002000:00010000:1.0:1787857833.872629:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb atime from disk: 0 -> 1787857832 00002000:00010000:1.0:1787857833.872631:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1787857831 00002000:00010000:1.0:1787857833.872633:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787857833.872712:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171739008:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 615us (1087us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1787857833.872721:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 334 00000100:00100000:2.0:1787857833.876344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857833.876579:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171739264 00000100:00100000:3.0:1787857833.876589:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171739264 00000100:00100000:3.0:1787857833.876659:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1232 00000100:00100000:3.0:1787857833.876671:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30152:x1874704171739264:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787857833.876752:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.876774:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.876784:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.876852:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.876868:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 48 pid: 5858 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857833.876883:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188267264:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857833.876982:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857833.880930:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188267264:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857833.880966:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857833.881571:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857833.881630:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171739392 00000100:00100000:3.0:1787857833.881638:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171739392 00010000:00010000:3.0:1787857833.881686:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 49 pid: 5858 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857833.881794:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 367 00000100:00100000:3.0:1787857833.881804:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2349:x1874704171739392:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857833.881862:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857833.881870:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 49 pid: 5858 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.881882:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 49 pid: 5858 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.881907:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d031 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3df7 expref: 49 pid: 5858 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.881925:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:3.0:1787857833.881930:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.881950:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.881964:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.881991:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857833.882042:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171739392:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 239us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857833.882050:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 367 00010000:00010000:0.0:1787857833.882121:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.882129:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.882168:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.882175:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.882182:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.882188:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857833.882193:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.882200:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.882214:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:0.0:1787857833.882216:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787857833.882220:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.882226:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d08c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.882273:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30152:x1874704171739264:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 5605us (5938us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787857833.882282:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1232 00000100:00100000:3.0:1787857833.884750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.885503:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171739520 00000100:00100000:2.0:1787857833.885513:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171739520 00000100:00100000:2.0:1787857833.885616:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 335 00000100:00100000:2.0:1787857833.885627:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171739520:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857833.885672:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.885694:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.885704:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857833.885708:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857833.885713:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.885761:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.885776:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 10 pid: 6711 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857833.885797:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188267392:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857833.885902:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb7fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857833.889642:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188267392:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857833.889677:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857833.889692:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.889854:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171739648 00000100:00100000:1.0:1787857833.889862:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171739648 00010000:00010000:1.0:1787857833.889900:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 11 pid: 6711 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857833.889937:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 368 00000100:00100000:1.0:1787857833.889947:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171739648:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857833.889978:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857833.890004:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 11 pid: 6711 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.890016:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 11 pid: 6711 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.890040:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000295251ac/0xd3f183cab4a7d070 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e1a expref: 11 pid: 6711 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.890056:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857833.890060:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857833.890066:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.890077:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.890107:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857833.890133:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.890142:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857833.890163:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171739648:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 217us (472us total) trans 0 rc 0/0 00010000:00010000:2.0:1787857833.890167:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857833.890170:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 368 00010000:00010000:2.0:1787857833.890175:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.890183:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.890190:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857833.890195:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.890210:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.890222:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.890230:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cff94520/0xd3f183cab4a7d093 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857833.890276:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171739520:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 4652us (5545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857833.890284:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 335 00000100:00100000:1.0:1787857833.894699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857833.894798:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171739904 00000100:00100000:3.0:1787857833.894809:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171739904 00000100:00100000:3.0:1787857833.894903:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1233 00000100:00100000:3.0:1787857833.894914:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30152:x1874704171739904:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857833.895001:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.895018:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.895029:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.895256:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.895269:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 48 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.895279:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.895328:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 48 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.895342:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 48 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857833.895356:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188267520:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857833.895527:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857833.899723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.899793:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188267520:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857833.899843:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.900455:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171740032 00000100:00100000:0.0:1787857833.900462:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171740032 00010000:00010000:0.0:1787857833.900497:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 49 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857833.900539:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 369 00000100:00100000:0.0:1787857833.900549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2349:x1874704171740032:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857833.900564:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857833.900571:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 49 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.900584:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 49 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.900607:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e21 expref: 49 pid: 7656 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.900628:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:0.0:1787857833.900633:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.900641:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.900649:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857833.900680:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857833.900728:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171740032:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 180us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857833.900746:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 369 00010000:00010000:1.0:1787857833.900874:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.900883:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857833.901088:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968108 00000001:00080000:1.0:1787857833.901277:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968109 00000001:00080000:1.0:1787857833.901592:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968110 00000100:00100000:1.0:1787857833.901679:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188267648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857833.901736:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857833.901774:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857833.903605:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188267648 00000100:00100000:3.0:1787857833.903618:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188267648 00000100:00100000:3.0:1787857833.903757:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787857833.903768:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188267648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787857833.903906:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188267648:12345-0@lo:1000:mdt00_000.0 Request processed in 139us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857833.903915:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787857833.904014:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188267648:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787857833.905091:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968111 00000100:00100000:2.0:1787857833.905190:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188267776:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787857833.905255:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787857833.905380:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857833.905862:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9d5e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787857833.906081:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188267776 00000100:00100000:1.0:1787857833.906090:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188267776 00000100:00100000:1.0:1787857833.906198:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787857833.906209:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1874704188267776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857833.906681:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1874704188267776:12345-0@lo:1000:mdt00_000.0 Request processed in 474us (1424us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787857833.906690:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787857833.906993:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5856:1874704188267776:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787857833.907090:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968112 00010000:00010000:2.0:1787857833.907123:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907196:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907205:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907210:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857833.907216:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907223:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907239:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:2.0:1787857833.907242:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857833.907246:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907252:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907282:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907288:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907294:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907298:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857833.907301:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907306:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907447:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:2.0:1787857833.907450:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857833.907458:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907469:0:5856:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907478:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.907511:0:5856:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857833.907527:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188267904:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857833.907644:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f9d5e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857833.912152:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.912702:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188267904:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857833.912742:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912754:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7cfcf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912794:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912809:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912850:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912862:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912868:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912875:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912881:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857833.912885:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912893:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912904:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:2.0:1787857833.912906:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857833.912909:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912915:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d0a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912925:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912930:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912935:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912940:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857833.912943:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912949:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912956:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:2.0:1787857833.912958:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857833.912961:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.912967:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d09a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857833.913326:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171740160 00000100:00100000:3.0:1787857833.913333:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171740160 00000040:00080000:0.0:1787857833.913653:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857833.913658:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857833.914167:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787857833.914175:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857833.914343:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 246 00000100:00100000:3.0:1787857833.914355:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:30151:x1874704171740160:12345-192.168.204.36@tcp:49:cat.0 00000100:00100000:2.0:1787857833.914806:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:30152:x1874704171739904:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 19891us (20115us total) trans 4294968113 rc 0/0 00000100:00100000:2.0:1787857833.914832:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1233 00000020:00080000:2.0:1787857833.914837:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787857833.915060:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:30151:x1874704171740160:12345-192.168.204.36@tcp:49:cat.0 Request processed in 706us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857833.915068:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 246 00000100:00100000:3.0:1787857833.919227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857833.919344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857833.919997:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171740416 00000100:00100000:1.0:1787857833.920008:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171740416 00000100:00100000:1.0:1787857833.920063:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 247 00000100:00100000:1.0:1787857833.920074:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:30152:x1874704171740416:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787857833.921036:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x24:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787857833.921146:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968114 00010000:00010000:1.0:1787857833.921196:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921214:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921226:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921246:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921252:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921258:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921280:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857833.921719:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30152:x1874704171740416:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1643us (2501us total) trans 4294968115 rc 0/0 00000100:00100000:1.0:1787857833.921874:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 247 00000020:00080000:1.0:1787857833.921881:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787857833.921907:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857833.921913:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921923:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857833.921927:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921935:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921947:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff9998e1a0ce00) 00010000:00010000:1.0:1787857833.921950:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857833.921955:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921971:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d0af lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857833.921987:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857833.921989:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857833.921990:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857833.922113:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171740544 00000100:00100000:2.0:1787857833.922121:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171740544 00000100:00080000:1.0:1787857833.922280:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857833.922618:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 336 00000100:00100000:2.0:1787857833.922628:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:30151:x1874704171740544:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857833.922642:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857833.922658:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e28 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857833.922681:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 158, mtime: 0x6a908ba7, atime: 0x6a908ba8, ctime: 0x6a908ba7, blocks: 0xb 00010000:00010000:2.0:1787857833.922701:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1787857833.922705:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857833.922714:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 17 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.922738:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 17 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.922749:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74e00, rc 0) 00000100:00100000:2.0:1787857833.922781:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+17:30151:x1874704171740544:12345-192.168.204.36@tcp:101:cat.0 Request processed in 156us (3437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857833.922788:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 336 00000100:00100000:1.0:1787857833.927766:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857833.927925:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171740672 00000100:00100000:0.0:1787857833.927937:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171740672 00002000:00100000:0.0:1787857833.927992:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff9998e185cb40 x1874704171740672/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:479/0 lens 488/0 e 0 to 0 dl 1787857844 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857833.928002:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998e185cb40 with x1874704171740672 ext(0->4095) 00002000:00010000:0.0:1787857833.928008:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998e185cb40 00000100:00100000:0.0:1787857833.928045:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:0.0:1787857833.928057:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:365dae28-8203-4526-83a5-01baf5c55d8b+17:2350:x1874704171740672:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:0.0:1787857833.928534:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:365dae28-8203-4526-83a5-01baf5c55d8b+17:2350:x1874704171740672:12345-192.168.204.36@tcp:3:cat.0 Request processed in 476us (777us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857833.928543:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 108 00002000:00100000:0.0:1787857833.928551:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff9998e185cb40 x1874704171740672/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:479/0 lens 488/4536 e 0 to 0 dl 1787857844 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857833.928559:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998e185cb40 with x1874704171740672 ext(0->4095) 00002000:00010000:0.0:1787857833.928563:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998e185cb40 00000100:00100000:0.0:1787857833.934868:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857833.934985:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171740928 00000100:00100000:3.0:1787857833.934995:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171740928 00000100:00100000:3.0:1787857833.935056:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 248 00000100:00100000:3.0:1787857833.935066:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+97:30151:x1874704171740928:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857833.935358:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+98:30151:x1874704171740928:12345-192.168.204.36@tcp:35:cat.0 Request processed in 293us (501us total) trans 4294968116 rc 0/0 00000100:00100000:3.0:1787857833.935366:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 248 00000100:00100000:1.0:1787857833.975315:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857833.976185:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171741056 00000100:00100000:3.0:1787857833.976195:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171741056 00000100:00100000:3.0:1787857833.976264:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1234 00000100:00100000:3.0:1787857833.976274:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+98:30153:x1874704171741056:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857833.976299:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857833.976320:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d0bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e2f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.976402:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.976417:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.976430:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.976466:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.976473:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.976486:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977034:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977044:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977051:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857833.977089:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:3.0:1787857833.977093:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857833.977112:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977124:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977246:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977253:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977259:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977266:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857833.977270:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977278:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977290:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:3.0:1787857833.977293:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857833.977298:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977305:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d0c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977319:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977325:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977330:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977335:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857833.977338:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977345:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977351:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9998d12efe00) 00010000:00010000:3.0:1787857833.977354:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857833.977357:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977366:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d0cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977401:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d0bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 100 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977416:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.977423:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:3.0:1787857833.977425:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857833.977428:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72000, rc 0) 00000100:00100000:3.0:1787857833.977686:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+99:30153:x1874704171741056:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1412us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857833.977695:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1234 00000100:00100000:0.0:1787857833.985402:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857833.985542:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171741184 00000100:00100000:3.0:1787857833.985552:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171741184 00000100:00100000:3.0:1787857833.985613:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1235 00000100:00100000:3.0:1787857833.985622:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+99:30153:x1874704171741184:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857833.985644:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857833.985665:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d0d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e36 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.985746:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.985761:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.985774:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857833.986159:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 7680 00000004:00200000:3.0:1787857833.986164:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857833.986234:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.986261:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d0d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 101 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.986278:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 100 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857833.986287:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:3.0:1787857833.986290:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857833.986293:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72e00, rc 0) 00000100:00100000:3.0:1787857833.986362:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:30153:x1874704171741184:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 740us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857833.986370:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1235 00000100:00100000:0.0:1787857833.998441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857833.998729:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171741440 00000100:00100000:2.0:1787857833.998741:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171741440 00000100:00100000:2.0:1787857833.998799:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1236 00000100:00100000:2.0:1787857833.998809:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:30153:x1874704171741440:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857833.998863:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857833.998885:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d0e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e3d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.998997:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d0ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.999014:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d0ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.999028:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d0ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857833.999041:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:2.0:1787857833.999181:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d0e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e3d expref: 103 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.999201:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d0ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e3d expref: 102 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857833.999210:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:2.0:1787857833.999213:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787857833.999216:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857833.999271:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:30153:x1874704171741440:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 463us (849us total) trans 4294968117 rc 0/0 00000100:00100000:2.0:1787857833.999278:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1236 00000100:00100000:2.0:1787857834.010866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857834.010999:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171741568 00000100:00100000:1.0:1787857834.011010:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171741568 00000100:00100000:1.0:1787857834.011064:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 337 00000100:00100000:1.0:1787857834.011074:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+17:2350:x1874704171741568:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:1.0:1787857834.011122:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.011155:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 17 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.011164:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787857834.011168:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857834.011173:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.011210:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 17 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.011244:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 17 pid: 14028 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857834.011258:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa82d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188268032:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857834.011353:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857834.025612:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857834.025868:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171741696 00000100:00100000:3.0:1787857834.025876:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171741696 00010000:00010000:3.0:1787857834.025927:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 18 pid: 14028 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857834.025982:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 370 00000100:00100000:3.0:1787857834.025992:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171741696:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857834.026011:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857834.026034:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 18 pid: 14028 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.026049:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 18 pid: 14028 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.026079:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857834.026085:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857834.026091:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.026101:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.026121:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857834.026189:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171741696:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 198us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857834.026196:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 370 00010000:00010000:1.0:1787857834.026997:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c4e624c/0xd3f183cab4a7d0b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e28 expref: 17 pid: 14028 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857834.027020:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa82d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188268032:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857834.027047:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027058:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027066:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027100:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027109:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027151:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027159:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857834.027163:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027173:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027190:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.027199:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d0fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857834.027263:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171741568:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 16190us (16449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857834.027271:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 337 00000100:00100000:2.0:1787857834.032496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857834.032618:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171741952 00000100:00100000:3.0:1787857834.032628:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171741952 00000100:00100000:3.0:1787857834.032682:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 249 00000100:00100000:3.0:1787857834.032700:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6009850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:30153:x1874704171741952:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:3.0:1787857834.032769:0:5859:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x23:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d0ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e3d expref: 102 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857834.033036:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968118 00000001:00080000:3.0:1787857834.034007:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968119 00010000:00010000:3.0:1787857834.034065:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.034081:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 105 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.034090:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 105 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.034099:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.034143:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 105 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.034156:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 105 pid: 5858 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857834.034172:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188268160:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857834.034259:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 105 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.034269:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 105 pid: 7656 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857834.034283:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188268288:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857834.034307:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d13f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787857834.039255:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188268160:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857834.039270:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5859:1874704188268288:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857834.039299:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857834.042625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857834.042711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857834.042965:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171742208 00000100:00100000:3.0:1787857834.042975:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171742208 00010000:00010000:3.0:1787857834.043016:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 106 pid: 7656 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857834.043060:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171742080 00000100:00100000:3.0:1787857834.043064:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171742080 00010000:00010000:3.0:1787857834.043079:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 107 pid: 5858 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857834.043164:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 371 00000100:00100000:3.0:1787857834.043175:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+107:2349:x1874704171742208:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857834.043190:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857834.043198:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 107 pid: 7656 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043209:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 107 pid: 7656 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043239:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7cfd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3de2 expref: 107 pid: 7656 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043256:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:3.0:1787857834.043261:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043271:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043277:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857834.043347:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:2349:x1874704171742208:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 174us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857834.043355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 371 00000100:00100000:3.0:1787857834.043384:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 372 00000100:00100000:3.0:1787857834.043391:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+105:2349:x1874704171742080:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857834.043399:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857834.043403:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 105 pid: 5858 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043414:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 105 pid: 5858 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043425:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d0d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e2f expref: 105 pid: 5858 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043582:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:3.0:1787857834.043586:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043594:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043602:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.043627:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857834.043646:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+104:2349:x1874704171742080:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 256us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857834.043653:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 372 00010000:00010000:2.0:1787857834.044095:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.044106:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857834.044237:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968120 00000001:00080000:2.0:1787857834.044680:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968121 00000001:00080000:2.0:1787857834.044954:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968122 00000100:00100000:2.0:1787857834.045038:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c32940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188268416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787857834.045096:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857834.045121:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fd0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857834.047327:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188268416 00000100:00100000:1.0:1787857834.047339:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188268416 00000100:00100000:1.0:1787857834.047572:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787857834.047584:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188268416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857834.047703:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188268416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 121us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857834.047933:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787857834.048060:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c32940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188268416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787857834.048662:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968123 00000100:00100000:2.0:1787857834.048875:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c32940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188268544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787857834.048920:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857834.048940:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fd0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857834.049009:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188268544 00000100:00100000:1.0:1787857834.049014:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188268544 00000100:00100000:1.0:1787857834.049037:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787857834.049045:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1874704188268544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857834.049207:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5859:x1874704188268544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (286us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787857834.049215:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787857834.049572:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c32940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5859:1874704188268544:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1787857834.049594:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.049604:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.049613:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.049619:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857834.049624:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.049637:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.049653:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:2.0:1787857834.049655:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787857834.049660:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.049665:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d103 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857834.049989:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x4a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787857834.050092:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].10, 64 off8856 00000004:00080000:2.0:1787857834.050105:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 658100286976ns, next at 659100284949ns, rc = 0 00000001:00080000:2.0:1787857834.050112:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968124 00010000:00010000:2.0:1787857834.050212:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:2.0:1787857834.050216:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787857834.050223:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d0ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e3d expref: 108 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857834.050590:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6009850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+107:30153:x1874704171741952:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 17890us (18103us total) trans 4294968125 rc 0/0 00000100:00100000:2.0:1787857834.050600:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 249 00000020:00080000:2.0:1787857834.050605:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1787857834.143113:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857834.143395:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171742464 00000100:00100000:3.0:1787857834.143411:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171742464 00000100:00100000:3.0:1787857834.143530:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1237 00000100:00100000:3.0:1787857834.143543:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+107:30159:x1874704171742464:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857834.143581:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857834.143611:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d10a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.143738:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.143771:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.143789:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.143807:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.143813:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.143873:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144343:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d11f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144353:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d11f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144360:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d11f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857834.144372:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:3.0:1787857834.144486:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144493:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144500:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144506:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857834.144510:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144518:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144530:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:3.0:1787857834.144533:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857834.144537:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144543:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d111 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144557:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144562:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144567:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144572:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857834.144575:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144580:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144587:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff9998d12efe00) 00010000:00010000:3.0:1787857834.144590:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857834.144593:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144600:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144661:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d10a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e44 expref: 110 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144674:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d11f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e44 expref: 109 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.144682:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998d12ef700) 00010000:00010000:3.0:1787857834.144684:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857834.144687:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857834.144762:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+109:30159:x1874704171742464:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1222us (1664us total) trans 4294968126 rc 0/0 00000100:00100000:3.0:1787857834.144770:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1237 00000100:00100000:1.0:1787857834.152066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857834.153460:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171742720 00000100:00100000:2.0:1787857834.153474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171742720 00000100:00100000:2.0:1787857834.153628:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:2.0:1787857834.153642:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+109:30159:x1874704171742720:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:2.0:1787857834.153669:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857834.153708:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d11f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e44 expref: 109 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.153739:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998d12ef700) 00010000:00010000:2.0:1787857834.153763:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857834.153881:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:30159:x1874704171742720:12345-192.168.204.36@tcp:103:cat.0 Request processed in 241us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857834.153890:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:1.0:1787857834.156621:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857834.156729:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171742848 00000100:00100000:2.0:1787857834.156742:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171742848 00000100:00100000:2.0:1787857834.158055:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1238 00000100:00100000:2.0:1787857834.158218:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:30159:x1874704171742848:12345-192.168.204.36@tcp:58:cat.0 00010000:00010000:2.0:1787857834.158337:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.158357:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.158371:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857834.158644:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 136 off13088 00000100:00100000:2.0:1787857834.158934:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:30159:x1874704171742848:12345-192.168.204.36@tcp:58:cat.0 Request processed in 718us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857834.158944:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1238 00000100:00100000:0.0:1787857834.169330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857834.172313:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171742976 00000100:00100000:1.0:1787857834.172336:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171742976 00000100:00100000:1.0:1787857834.172454:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1239 00000100:00100000:1.0:1787857834.172468:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:30159:x1874704171742976:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857834.172495:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857834.172527:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d134 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e4b expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.172616:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.172629:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d134 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e4b expref: 109 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.172653:0:19301:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.172693:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d134 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e4b expref: 109 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.172748:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:1.0:1787857834.172753:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857834.172757:0:19301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d134 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e4b expref: 109 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857834.172766:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053c00, rc 0) 00000100:00100000:1.0:1787857834.172917:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+109:30159:x1874704171742976:12345-192.168.204.36@tcp:101:cat.0 Request processed in 451us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857834.172925:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1239 00010000:00010000:2.0:1787857834.734867:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857834.863031:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3041680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188268672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857834.863129:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857834.863316:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188268672 00000100:00100000:0.0:1787857834.863324:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188268672 00000100:00100000:0.0:1787857834.863382:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787857834.863394:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188268672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857834.863433:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3854565376 00000100:00100000:0.0:1787857834.863488:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874704188268672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857834.863495:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787857834.863551:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3041680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188268672:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787857834.926286:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857834.926296:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857834.926333:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 37 count 4 00000040:00080000:0.0:1787857834.926341:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857834.926494:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3041680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188268800:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857834.926687:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900e19240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857834.938541:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3041680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188268800:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857834.945689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857834.946092:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171743104 00000100:00100000:0.0:1787857834.946101:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171743104 00000100:00100000:0.0:1787857834.946169:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1240 00000100:00100000:0.0:1787857834.946179:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30160:x1874704171743104:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857834.946216:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857834.946328:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30160:x1874704171743104:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 150us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857834.946336:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1240 00000100:00100000:0.0:1787857834.956353:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857834.956605:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171743232 00000100:00100000:2.0:1787857834.956617:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171743232 00000100:00100000:2.0:1787857834.956687:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1241 00000100:00100000:2.0:1787857834.956697:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30160:x1874704171743232:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787857834.956793:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.956812:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.956864:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.956881:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.956888:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.956894:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957037:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957047:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957070:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857834.957358:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:2.0:1787857834.957363:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857834.957379:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957391:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957397:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957404:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957409:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857834.957423:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957431:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957444:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857834.957447:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857834.957454:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957460:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d13b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957479:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957484:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957490:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957494:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857834.957496:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957501:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957507:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x92f5931a (ffff9998c3379900) 00010000:00010000:2.0:1787857834.957509:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857834.957512:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957517:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d142 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957530:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957535:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957540:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957545:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857834.957547:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957552:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957558:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:2.0:1787857834.957560:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857834.957563:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.957569:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d149 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857834.957663:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30160:x1874704171743232:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 967us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857834.957672:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1241 00000100:00100000:2.0:1787857834.967893:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857834.967959:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171743488 00000100:00100000:3.0:1787857834.967969:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171743488 00000100:00100000:3.0:1787857834.968034:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1242 00000100:00100000:3.0:1787857834.968046:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30160:x1874704171743488:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857834.968124:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857834.968147:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d150 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968262:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968285:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968297:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857834.968308:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:3.0:1787857834.968428:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968436:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968442:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968449:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857834.968452:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968459:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968471:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:3.0:1787857834.968474:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857834.968479:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968486:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d157 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968536:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d150 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e52 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968546:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857834.968549:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857834.968552:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d150 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e52 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.968562:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857834.968657:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:30160:x1874704171743488:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 606us (765us total) trans 4294968127 rc 301/301 00000100:00100000:3.0:1787857834.968664:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1242 00000100:00100000:3.0:1787857834.971947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857834.972180:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171743616 00000100:00100000:1.0:1787857834.972190:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171743616 00000100:00100000:1.0:1787857834.972254:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1243 00000100:00100000:1.0:1787857834.972265:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:30160:x1874704171743616:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857834.972302:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857834.972424:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:30160:x1874704171743616:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 152us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857834.972432:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1243 00000100:00100000:0.0:1787857834.978896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857834.979623:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171743872 00000100:00100000:1.0:1787857834.979634:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171743872 00000100:00100000:1.0:1787857834.979686:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1244 00000100:00100000:1.0:1787857834.979694:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:30160:x1874704171743872:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857834.979722:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857834.979755:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d165 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e59 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.988500:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d16c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.988524:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d16c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.988537:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d16c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857834.988551:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00010000:00010000:2.0:1787857834.988617:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d165 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e59 expref: 58 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.988640:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d16c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e59 expref: 57 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857834.988650:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857834.988652:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857834.988656:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75600, rc 0) 00000100:00100000:2.0:1787857834.988928:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:30160:x1874704171743872:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 9226us (10034us total) trans 4294968128 rc 0/0 00000100:00100000:2.0:1787857834.988939:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1244 00000100:00100000:2.0:1787857834.998745:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857834.999090:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171744128 00000100:00100000:3.0:1787857834.999102:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171744128 00000100:00100000:3.0:1787857834.999483:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1245 00000100:00100000:3.0:1787857834.999492:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:30160:x1874704171744128:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857834.999557:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857834.999584:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d16c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e59 expref: 57 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.999604:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857834.999615:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857834.999640:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.999658:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 108 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.999668:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.999722:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 108 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857834.999737:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 108 pid: 5857 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857834.999753:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188268928:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857835.000254:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857835.005776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.006459:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171744256 00000100:00100000:2.0:1787857835.006471:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171744256 00010000:00010000:2.0:1787857835.006532:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 109 pid: 5857 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857835.006585:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 373 00000100:00100000:2.0:1787857835.006597:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+109:2350:x1874704171744256:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857835.006614:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857835.006622:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 109 pid: 5857 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.006636:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 109 pid: 5857 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.006665:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:2.0:1787857835.006671:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.006682:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.006691:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.006719:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857835.006781:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+109:2350:x1874704171744256:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 187us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857835.006790:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 373 00010000:00010000:3.0:1787857835.007612:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d0e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e36 expref: 108 pid: 5857 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857835.007633:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188268928:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857835.007655:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.007664:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.007670:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.007694:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.007705:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.007724:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008009:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008018:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008024:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008030:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857835.008035:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008043:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008054:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:3.0:1787857835.008056:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857835.008403:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008419:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d17a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008433:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008439:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008445:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008449:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857835.008452:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008457:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008464:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xc4c04955 (ffff9998d12efe00) 00010000:00010000:3.0:1787857835.008466:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857835.008469:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.008474:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d181 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xc4c04955 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787857835.009625:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857835.009864:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:30160:x1874704171744128:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 10366us (11126us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857835.009875:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1245 00000100:00100000:1.0:1787857835.013282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.013429:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171744384 00000100:00100000:2.0:1787857835.013440:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171744384 00000100:00100000:2.0:1787857835.013517:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1246 00000100:00100000:2.0:1787857835.013526:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:30160:x1874704171744384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857835.013546:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857835.013567:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d188 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e60 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.013599:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.013614:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.013629:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.013733:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 58 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.014106:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 57 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.014201:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:2.0:1787857835.014205:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857835.014209:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74e00, rc 0) 00000100:00080000:1.0:1787857835.014329:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857835.014364:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:30160:x1874704171744384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 839us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857835.014373:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1246 00000100:00100000:0.0:1787857835.028950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.029086:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171744640 00000100:00100000:2.0:1787857835.029098:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171744640 00000100:00100000:2.0:1787857835.029187:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1247 00000100:00100000:2.0:1787857835.029199:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:30160:x1874704171744640:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857835.029309:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.029331:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.029345:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857835.029580:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006695f0ac reply state 00000000a529a98c transno 4294968129 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857835.029590:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857835.029694:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:30160:x1874704171744640:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 496us (755us total) trans 4294968129 rc 0/0 00000100:00100000:2.0:1787857835.029702:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1247 00010000:00010000:0.0:1787857835.033367:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.033383:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.033390:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.033396:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857835.033400:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.033407:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.033441:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:0.0:1787857835.033444:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787857835.033449:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.033454:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d196 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857835.034769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.035080:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171744768 00000100:00100000:2.0:1787857835.035092:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171744768 00000100:00100000:2.0:1787857835.035165:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1248 00000100:00100000:2.0:1787857835.035175:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:30160:x1874704171744768:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857835.035205:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857835.035226:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.035290:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.035304:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.035314:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:2.0:1787857835.035317:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857835.035320:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74a00, rc 0) 00000100:00100000:2.0:1787857835.035397:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:30160:x1874704171744768:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 223us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857835.035409:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1248 00000100:00100000:2.0:1787857835.038769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857835.038947:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171744896 00000100:00100000:3.0:1787857835.038957:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171744896 00000100:00100000:3.0:1787857835.039012:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 250 00000100:00100000:3.0:1787857835.039022:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:30160:x1874704171744896:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787857835.039409:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:30160:x1874704171744896:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 387us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857835.039428:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 250 00000100:00100000:1.0:1787857835.045182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.045284:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171745152 00000100:00100000:2.0:1787857835.045294:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171745152 00000100:00100000:2.0:1787857835.045357:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 251 00000100:00100000:2.0:1787857835.045369:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:30160:x1874704171745152:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857835.045678:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:30160:x1874704171745152:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 311us (505us total) trans 4294968130 rc 0/0 00000100:00100000:2.0:1787857835.045687:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 251 00000100:00100000:0.0:1787857835.053070:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.053874:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171745408 00000100:00100000:2.0:1787857835.053886:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171745408 00000100:00100000:2.0:1787857835.053962:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1249 00000100:00100000:2.0:1787857835.053972:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:30160:x1874704171745408:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857835.054106:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:30160:x1874704171745408:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 136us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857835.054275:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1249 00000100:00100000:1.0:1787857835.057930:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857835.058083:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171745664 00000100:00100000:3.0:1787857835.058095:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171745664 00000100:00100000:3.0:1787857835.058170:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1250 00000100:00100000:3.0:1787857835.058180:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:30160:x1874704171745664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857835.058202:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857835.058227:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d1a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e6e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.058326:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.058341:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.058350:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 4/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.058383:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.058397:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 61 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857835.058423:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188269056:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857835.058508:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857835.066083:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857835.067861:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171745792 00000100:00100000:0.0:1787857835.067874:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171745792 00010000:00010000:0.0:1787857835.067937:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 62 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857835.067981:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 374 00000100:00100000:0.0:1787857835.067992:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:2350:x1874704171745792:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857835.068008:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857835.068015:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 62 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.068029:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 62 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.068074:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:0.0:1787857835.068081:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.068096:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.068104:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.068444:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857835.068519:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:2350:x1874704171745792:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 528us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857835.068528:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 374 00010000:00010000:3.0:1787857835.074299:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d19d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e67 expref: 61 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857835.074327:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188269056:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857835.074429:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.074906:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.074923:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857835.074948:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00000004:00080000:1.0:1787857835.075444:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:1.0:1787857835.075596:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075606:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075613:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075620:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857835.075625:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075634:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075670:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:1.0:1787857835.075673:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857835.075678:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075685:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d1ab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075754:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d1a4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e6e expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075764:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9997c3d03300) 00010000:00010000:1.0:1787857835.075767:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857835.075770:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d1a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e6e expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.075780:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72000, rc 0) 00000100:00100000:1.0:1787857835.077445:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:30160:x1874704171745664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 19257us (19525us total) trans 4294968131 rc 301/301 00000100:00100000:1.0:1787857835.077458:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1250 00000100:00100000:1.0:1787857835.098171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.098265:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171746048 00000100:00100000:2.0:1787857835.098276:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171746048 00000100:00100000:2.0:1787857835.098345:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 252 00000100:00100000:2.0:1787857835.098356:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:30160:x1874704171746048:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857835.098760:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:30160:x1874704171746048:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 404us (596us total) trans 4294968132 rc 0/0 00000100:00100000:2.0:1787857835.098770:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 252 00000100:00100000:0.0:1787857835.108377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857835.110098:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171746176 00000100:00100000:3.0:1787857835.110125:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171746176 00000100:00100000:3.0:1787857835.110198:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1251 00000100:00100000:3.0:1787857835.110209:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:30160:x1874704171746176:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857835.110236:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857835.110259:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d1b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e75 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.110333:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d1c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.110349:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.110361:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857835.110396:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00000004:00200000:3.0:1787857835.110400:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857835.110428:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.110454:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d1b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e75 expref: 63 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.110474:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e75 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.110489:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:3.0:1787857835.110492:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787857835.110496:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73e00, rc 0) 00000100:00100000:3.0:1787857835.110572:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:30160:x1874704171746176:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 363us (2204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857835.110580:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1251 00000100:00100000:1.0:1787857835.120987:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.121214:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171746304 00000100:00100000:2.0:1787857835.121223:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171746304 00000100:00100000:2.0:1787857835.121294:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00100000:2.0:1787857835.121305:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2348:x1874704171746304:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857835.121322:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857835.121343:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e7c expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857835.121371:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857835.121391:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1787857835.121396:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857835.121406:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.121435:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.121450:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75200, rc 0) 00000100:00100000:2.0:1787857835.121518:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171746304:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 215us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857835.121525:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00080000:1.0:1787857835.123289:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857835.130778:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.130905:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171746560 00000100:00100000:2.0:1787857835.130925:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171746560 00000100:00100000:2.0:1787857835.130988:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1252 00000100:00100000:2.0:1787857835.130998:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:30160:x1874704171746560:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857835.131127:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:30160:x1874704171746560:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 130us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857835.131139:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1252 00000100:00100000:0.0:1787857835.136491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.136811:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171746688 00000100:00100000:2.0:1787857835.136852:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171746688 00000100:00100000:2.0:1787857835.136907:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 339 00000100:00100000:2.0:1787857835.136927:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:30160:x1874704171746688:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857835.136945:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857835.136962:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e83 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.136994:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 14 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.137003:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857835.137008:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857835.137013:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 14 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.137045:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 14 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.137073:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 14 pid: 6713 timeout: 759 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857835.137087:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188269184:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857835.137942:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fd0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857835.148720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.149158:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188269184:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857835.149192:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 14 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.149214:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75000, rc 0) 00000100:00100000:2.0:1787857835.149280:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:30160:x1874704171746688:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 12363us (12799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857835.149301:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 339 00000100:00100000:1.0:1787857835.150336:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171746816 00000100:00100000:1.0:1787857835.150344:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171746816 00010000:00010000:1.0:1787857835.150379:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 14 pid: 6713 timeout: 759 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857835.150447:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 375 00000100:00100000:1.0:1787857835.150456:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171746816:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857835.150472:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857835.150494:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 14 pid: 6713 timeout: 759 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.150507:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 14 pid: 6713 timeout: 759 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.150531:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007325aeeb/0xd3f183cab4a7d1c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e7c expref: 14 pid: 6713 timeout: 759 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.150546:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857835.150550:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857835.150559:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.150569:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.150605:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857835.150618:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704a940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188269312:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857835.150699:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bf000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857835.159294:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.159384:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171746944 00000100:00100000:2.0:1787857835.159394:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171746944 00002000:00100000:2.0:1787857835.159459:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1b:0x0] (0->157) req@ffff9998efa6cb40 x1874704171746944/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:481/0 lens 648/0 e 0 to 0 dl 1787857846 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857835.159471:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6cb40 with x1874704171746944 ext(0->157) 00002000:00010000:2.0:1787857835.159477:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6cb40 00000100:00100000:2.0:1787857835.159509:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 109 00000100:00100000:2.0:1787857835.159519:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171746944:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787857835.160142:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2349:x1874704171746944:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 622us (856us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787857835.160152:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 109 00002000:00100000:2.0:1787857835.160159:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1b:0x0] (0->157) req@ffff9998efa6cb40 x1874704171746944/t4294967373(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:481/0 lens 648/448 e 0 to 0 dl 1787857846 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857835.160168:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6cb40 with x1874704171746944 ext(0->157) 00002000:00010000:2.0:1787857835.160172:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6cb40 00000100:00100000:1.0:1787857835.160592:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704a940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188269312:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857835.160616:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857835.160642:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171746816:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 10187us (11944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857835.160651:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 375 00000100:00100000:0.0:1787857835.170614:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857835.170712:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171747072 00000100:00100000:1.0:1787857835.170721:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171747072 00000100:00100000:1.0:1787857835.170780:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1253 00000100:00100000:1.0:1787857835.170791:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:30160:x1874704171747072:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787857835.212653:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:30160:x1874704171747072:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 41852us (42038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857835.212667:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1253 00000001:00080000:3.0:1787857835.213179:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968131 is committed 00000001:00080000:3.0:1787857835.213201:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968132 is committed 00000001:00080000:3.0:1787857835.213215:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968125 is committed 00000004:00080000:3.0:1787857835.213220:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000020:00080000:3.0:1787857835.213240:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c4fd0240 refcount 2 committed 0 result 0 batchid 27 00000020:00080000:3.0:1787857835.213245:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998c4fd0300 00000020:00080000:3.0:1787857835.213248:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff999901472c00 00000020:00080000:1.0:1787857835.213284:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 24 00000020:00080000:3.0:1787857835.214026:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c5b84cc0 refcount 2 committed 0 result 0 batchid 26 00000020:00080000:3.0:1787857835.214032:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998dbb7fcc0 00000020:00080000:3.0:1787857835.214035:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c5c9e800 00000001:00080000:3.0:1787857835.214061:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968126 is committed 00000020:00080000:3.0:1787857835.214075:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25 batchid updated 00000020:00080000:1.0:1787857835.214133:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 27 committed batchid 25 00000020:00080000:1.0:1787857835.214356:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25 00000100:00100000:1.0:1787857835.214872:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857835.214895:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188269440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787857835.214971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857835.216991:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188269440 00000100:00100000:2.0:1787857835.217006:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188269440 00000100:00100000:2.0:1787857835.217116:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787857835.217128:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874704188269440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787857835.217160:0:6711:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00002000:00010000:2.0:1787857835.217195:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 158, mtime: 0x6a908ba7, atime: 0x6a908ba8, ctime: 0x6a908ba7, blocks: 0xb 00010000:00010000:2.0:1787857835.217203:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.217221:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1787857835.217226:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857835.217232:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.217249:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.217260:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.217268:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.217285:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857835.217774:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1874704188269440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 649us (2802us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787857835.217783:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:1.0:1787857835.218773:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787857835.218788:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857835.218796:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.218807:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857835.218812:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.218866:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.218885:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.218894:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace0036b/0xd3f183cab4a7d1d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.218927:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857835.218929:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857835.218930:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787857835.218976:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c34f2940/2, rc 0, transno 4294967364 00000100:00100000:1.0:1787857835.218985:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188269440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787857835.220139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857835.220389:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171747200 00000100:00100000:3.0:1787857835.220397:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171747200 00000100:00100000:3.0:1787857835.220497:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 341 00000100:00100000:3.0:1787857835.220508:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171747200:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787857835.262684:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967370 is committed 00000001:00080000:1.0:1787857835.262726:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967371 is committed 00000001:00080000:1.0:1787857835.262745:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967373 is committed 00000001:00080000:1.0:1787857835.262752:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967372 is committed 00000100:00100000:0.0:1787857835.262983:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171747200:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 42463us (42833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857835.262996:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 341 00000100:00100000:3.0:1787857835.268667:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857835.268948:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171747456 00000100:00100000:1.0:1787857835.268957:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171747456 00000100:00100000:1.0:1787857835.269025:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1254 00000100:00100000:1.0:1787857835.269036:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30160:x1874704171747456:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857835.269093:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857835.269133:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d1c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e75 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.269175:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:1.0:1787857835.269181:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857835.269215:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.269229:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.269239:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857835.269435:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005defd27b reply state 00000000be1b8d79 transno 4294968133 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857835.269444:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857835.269542:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30160:x1874704171747456:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 507us (884us total) trans 4294968133 rc 0/0 00000100:00100000:1.0:1787857835.269549:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1254 00000100:00100000:1.0:1787857835.272925:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857835.272965:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171747584 00000100:00100000:1.0:1787857835.272975:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171747584 00000100:00100000:1.0:1787857835.273034:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1255 00000100:00100000:1.0:1787857835.273045:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30160:x1874704171747584:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857835.273070:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857835.273090:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e8a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.273155:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.273185:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.273207:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:1.0:1787857835.273211:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857835.273214:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053400, rc 0) 00000100:00100000:1.0:1787857835.273262:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:30160:x1874704171747584:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 219us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857835.273269:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1255 00010000:00010000:3.0:1787857835.273568:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.273579:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.273586:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.273592:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857835.273596:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.273604:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.273617:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:3.0:1787857835.273620:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857835.273623:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.273629:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d1dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857835.279063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.279250:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171747712 00000100:00100000:2.0:1787857835.279258:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171747712 00000100:00100000:2.0:1787857835.279319:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:2.0:1787857835.279330:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171747712:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787857835.279587:0:14028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787857835.279592:0:14028:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb mtime from disk: 0 -> 1787857831 00002000:00010000:2.0:1787857835.279594:0:14028:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb atime from disk: 0 -> 1787857833 00002000:00010000:2.0:1787857835.279596:0:14028:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb ctime from disk: 0 -> 1787857831 00002000:00010000:2.0:1787857835.279599:0:14028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787857835.279787:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171747712:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 336us (612us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787857835.279795:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:3.0:1787857835.282707:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857835.282936:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171747968 00000100:00100000:1.0:1787857835.282945:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171747968 00000100:00100000:1.0:1787857835.283003:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1256 00000100:00100000:1.0:1787857835.283012:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30160:x1874704171747968:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787857835.283085:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.283102:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 48 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.283242:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 4/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.283279:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 48 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.283292:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 48 pid: 7656 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857835.283324:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188269568:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857835.283430:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857835.287759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857835.287851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171748096 00000100:00100000:0.0:1787857835.287860:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171748096 00010000:00010000:0.0:1787857835.287902:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 49 pid: 7656 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857835.287951:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 376 00000100:00100000:0.0:1787857835.287961:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2349:x1874704171748096:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857835.287976:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857835.287983:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 49 pid: 7656 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.288001:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 49 pid: 7656 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.288025:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:0.0:1787857835.288030:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.288040:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.288048:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.288068:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857835.288139:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2349:x1874704171748096:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 179us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857835.288148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 376 00010000:00010000:2.0:1787857835.289134:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d18f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e60 expref: 48 pid: 7656 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857835.289155:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188269568:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857835.289177:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289185:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289191:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289220:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289227:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289233:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289239:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857835.289243:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289250:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289262:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:2.0:1787857835.289265:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787857835.289269:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.289276:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d1ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857835.289353:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30160:x1874704171747968:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 6342us (6657us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787857835.289363:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1256 00000100:00100000:1.0:1787857835.293676:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857835.293771:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171748224 00000100:00100000:2.0:1787857835.293781:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171748224 00000100:00100000:2.0:1787857835.293875:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00100000:2.0:1787857835.293886:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171748224:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857835.293943:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.293963:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.293972:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857835.293976:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857835.293981:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.294014:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.294027:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 12 pid: 14028 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857835.294041:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188269696:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857835.294123:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2f50240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857835.297516:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188269696:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857835.297547:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857835.300473:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857835.301051:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171748352 00000100:00100000:3.0:1787857835.301062:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171748352 00010000:00010000:3.0:1787857835.301118:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 13 pid: 14028 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857835.301164:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 377 00000100:00100000:3.0:1787857835.301173:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171748352:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857835.301189:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857835.301212:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 13 pid: 14028 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.301226:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 13 pid: 14028 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.301249:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031454cc6/0xd3f183cab4a7d1ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e83 expref: 13 pid: 14028 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.301266:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857835.301270:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857835.301275:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.301285:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.301321:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857835.301432:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.301442:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.301466:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.301474:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.301491:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.301498:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857835.301502:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.301511:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.301522:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.301529:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb46e4a6/0xd3f183cab4a7d1f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857835.302394:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171748352:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1218us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857835.302414:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 377 00000100:00100000:0.0:1787857835.304385:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171748224:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 10489us (10719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857835.304399:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00100000:3.0:1787857835.307910:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857835.308050:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171748608 00000100:00100000:0.0:1787857835.308059:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171748608 00000100:00100000:0.0:1787857835.308127:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1257 00000100:00100000:0.0:1787857835.308136:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30160:x1874704171748608:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857835.308214:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.308232:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.308244:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.308453:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.308465:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.308474:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 4/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.308515:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.308528:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 48 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857835.308542:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188269824:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857835.309121:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900e196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857835.311341:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188269824:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857835.311366:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857835.313168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857835.313287:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171748736 00000100:00100000:1.0:1787857835.313306:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171748736 00010000:00010000:1.0:1787857835.313351:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 49 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857835.313546:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 378 00000100:00100000:1.0:1787857835.313557:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2349:x1874704171748736:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857835.313572:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857835.313580:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 49 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.313593:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 49 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.313614:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d1e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e8a expref: 49 pid: 5858 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.313648:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:1.0:1787857835.313654:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.313725:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.313735:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.313798:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857835.313874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171748736:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 319us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857835.313882:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 378 00010000:00010000:2.0:1787857835.314384:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.314394:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857835.314652:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968134 00000001:00080000:2.0:1787857835.314887:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968135 00000001:00080000:2.0:1787857835.314997:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968136 00000100:00100000:2.0:1787857835.315074:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188269952:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787857835.315125:0:19301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857835.315162:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2f50180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857835.315225:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188269952 00000100:00100000:0.0:1787857835.315233:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188269952 00000100:00080000:2.0:1787857835.315400:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857835.315449:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787857835.315459:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188269952:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787857835.315548:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188269952:12345-0@lo:1000:mdt00_004.0 Request processed in 91us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857835.315555:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787857835.315612:0:19301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967372 gen 2 00000004:00080000:2.0:1787857835.315619:0:19301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967371 committed transno 4294967372 00000004:00080000:2.0:1787857835.315635:0:19301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9998e185f480, transno 4294967372 00000100:00100000:2.0:1787857835.315650:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188269952:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787857835.316037:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968137 00000100:00100000:2.0:1787857835.316091:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b42940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188270080:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787857835.316120:0:19301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857835.318017:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2f50240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857835.318475:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188270080 00000100:00100000:3.0:1787857835.318538:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188270080 00000100:00100000:3.0:1787857835.318576:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787857835.318584:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188270080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787857835.318798:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19301:x1874704188270080:12345-0@lo:1000:mdt00_004.0 Request processed in 213us (2676us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787857835.318806:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787857835.319098:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b42940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188270080:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787857835.319194:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968138 00010000:00010000:2.0:1787857835.319230:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319242:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319250:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319256:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857835.319261:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319268:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319285:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:2.0:1787857835.319427:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857835.319434:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319441:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d1ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319470:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319476:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319490:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319496:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857835.319499:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319504:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319513:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:2.0:1787857835.319515:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857835.319523:0:19301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d134 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e4b expref: 96 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319533:0:19301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d134 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e4b expref: 96 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319544:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d134 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e4b expref: 96 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857835.319575:0:19301:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053c00/0xd3f183cab4a7d134 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e4b expref: 96 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857835.319588:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188270208:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857835.319672:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857835.323543:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857835.323716:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188270208:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857835.323744:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323754:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d12d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323784:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323797:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323808:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323861:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323867:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323873:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323879:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857835.323883:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323890:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.323902:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:1.0:1787857835.323904:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857835.323908:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.324024:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052000/0xd3f183cab4a7d206 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.324036:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.324042:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.324047:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.324058:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857835.324061:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.324066:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.324075:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff9998c3379b00) 00010000:00010000:1.0:1787857835.324077:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857835.324080:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857835.324085:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d1f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857835.324325:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:30160:x1874704171748608:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 16189us (16422us total) trans 4294968139 rc 0/0 00000100:00100000:1.0:1787857835.324336:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1257 00000020:00080000:1.0:1787857835.324343:0:19301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787857835.326492:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171748864 00000100:00100000:3.0:1787857835.326506:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171748864 00000100:00100000:3.0:1787857835.326570:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 253 00000100:00100000:3.0:1787857835.326581:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+97:30159:x1874704171748864:12345-192.168.204.36@tcp:49:cat.0 00000100:00100000:3.0:1787857835.326716:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+97:30159:x1874704171748864:12345-192.168.204.36@tcp:49:cat.0 Request processed in 136us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857835.326723:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 253 00000040:00080000:2.0:1787857835.329551:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857835.329559:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857835.330469:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000100:00100000:1.0:1787857835.330980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857835.331076:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857835.332209:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171749120 00000100:00100000:3.0:1787857835.332219:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171749120 00000100:00100000:3.0:1787857835.332273:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 254 00000100:00100000:3.0:1787857835.332283:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c600a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:30160:x1874704171749120:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1787857835.333207:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857835.333634:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171749248 00000100:00100000:0.0:1787857835.333641:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171749248 00000004:00080000:3.0:1787857835.334658:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x25:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1787857835.334969:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 344 00000100:00100000:0.0:1787857835.334996:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+12:30159:x1874704171749248:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857835.335013:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857835.335035:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000295251ac/0xd3f183cab4a7d20d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e91 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857835.335063:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a908ba7, atime: 0x6a908ba9, ctime: 0x6a908ba7, blocks: 0xb 00010000:00010000:0.0:1787857835.335084:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=659s v=(0 0) 00010000:00010000:0.0:1787857835.335089:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857835.335100:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000295251ac/0xd3f183cab4a7d20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e91 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.335129:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000295251ac/0xd3f183cab4a7d20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e91 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.335143:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71400, rc 0) 00000100:00100000:0.0:1787857835.335209:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:30159:x1874704171749248:12345-192.168.204.36@tcp:101:cat.0 Request processed in 231us (4132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857835.335216:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 344 00000001:00080000:3.0:1787857835.335679:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968140 00010000:00010000:3.0:1787857835.335752:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.335765:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.335776:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.335786:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.335793:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.335799:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857835.335830:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857835.335896:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c600a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:30160:x1874704171749120:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 3615us (4921us total) trans 4294968141 rc 0/0 00000100:00100000:3.0:1787857835.335905:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 254 00000020:00080000:3.0:1787857835.335908:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857835.338941:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857835.338957:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.338972:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857835.338976:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.338985:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.339003:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff9998d12ef100) 00010000:00010000:0.0:1787857835.339006:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857835.339011:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.339017:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d214 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857835.339044:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857835.339046:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857835.339048:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857835.342336:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857835.342421:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171749376 00000100:00100000:0.0:1787857835.342430:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171749376 00002000:00100000:0.0:1787857835.342487:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (0->4095) req@ffff9998f7048780 x1874704171749376/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:481/0 lens 488/0 e 0 to 0 dl 1787857846 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857835.342499:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7048780 with x1874704171749376 ext(0->4095) 00002000:00010000:0.0:1787857835.342505:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f7048780 00000100:00100000:0.0:1787857835.342531:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 110 00000100:00100000:0.0:1787857835.342540:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171749376:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:0.0:1787857835.342744:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171749376:12345-192.168.204.36@tcp:3:cat.0 Request processed in 204us (418us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857835.342755:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 110 00002000:00100000:0.0:1787857835.342762:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (0->4095) req@ffff9998f7048780 x1874704171749376/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:481/0 lens 488/4536 e 0 to 0 dl 1787857846 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857835.342771:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7048780 with x1874704171749376 ext(0->4095) 00002000:00010000:0.0:1787857835.342774:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f7048780 00000100:00100000:3.0:1787857835.348576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857835.348765:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171749632 00000100:00100000:1.0:1787857835.348776:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171749632 00000100:00100000:1.0:1787857835.348856:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 255 00000100:00100000:1.0:1787857835.348866:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:30159:x1874704171749632:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857835.349158:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+98:30159:x1874704171749632:12345-192.168.204.36@tcp:35:cat.0 Request processed in 292us (592us total) trans 4294968142 rc 0/0 00000100:00100000:1.0:1787857835.349184:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 255 00000100:00080000:2.0:1787857835.351413:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787857835.758096:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857836.117144:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857836.117185:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857836.117216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857836.117248:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857836.117264:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857836.117280:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857836.117300:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857836.117331:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171750016 00000100:00100000:1.0:1787857836.117340:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171750016 00000100:00100000:1.0:1787857836.117403:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171750528 00000100:00100000:1.0:1787857836.117406:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171750528 00000100:00100000:1.0:1787857836.117421:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171750144 00000100:00100000:1.0:1787857836.117423:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171750144 00000100:00100000:1.0:1787857836.117433:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171750400 00000100:00100000:1.0:1787857836.117435:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171750400 00000100:00100000:1.0:1787857836.117451:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 461 00000100:00100000:1.0:1787857836.117461:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171750016:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857836.117533:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171750016:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 73us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.117542:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 461 00000100:00100000:1.0:1787857836.117561:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 462 00000100:00100000:1.0:1787857836.117567:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171750528:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857836.117594:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171750528:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.117620:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 462 00000100:00100000:1.0:1787857836.117634:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 463 00000100:00100000:1.0:1787857836.117640:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171750144:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857836.117662:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171750144:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.117667:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 463 00000100:00100000:1.0:1787857836.117678:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 464 00000100:00100000:1.0:1787857836.117683:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171750400:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857836.117725:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171750400:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.117731:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 464 00000100:00080000:1.0:1787857836.117749:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857836.117991:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171749760 00000100:00100000:3.0:1787857836.117997:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171749760 00000100:00100000:3.0:1787857836.118037:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 587 00000100:00100000:3.0:1787857836.118045:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171749760:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857836.118072:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171749760:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857836.118078:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 587 00000100:00100000:0.0:1787857836.118537:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171750272 00000100:00100000:0.0:1787857836.118542:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171750272 00000100:00100000:0.0:1787857836.118580:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171749888 00000100:00100000:0.0:1787857836.118584:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171749888 00000100:00100000:0.0:1787857836.118603:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 454 00000100:00100000:0.0:1787857836.118609:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171750272:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857836.118651:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171750272:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 43us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857836.118658:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 454 00000100:00100000:0.0:1787857836.118674:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 455 00000100:00100000:0.0:1787857836.118679:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+98:2349:x1874704171749888:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857836.118719:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+98:2349:x1874704171749888:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857836.118724:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 455 00000100:00100000:2.0:1787857836.398447:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188270336:0@lo:400:kworker.0 00000100:00100000:2.0:1787857836.398527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857836.404880:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857836.404914:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188270720:0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.405943:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188270592:0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.406002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857836.406042:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857836.406048:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188270464:0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.406069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857836.406110:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188270592 00000100:00100000:1.0:1787857836.406119:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188270592 00000100:00100000:1.0:1787857836.406166:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188270464 00000100:00100000:1.0:1787857836.406169:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188270464 00000100:00100000:1.0:1787857836.406186:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1787857836.406193:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188270592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.406239:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874704188270592:12345-0@lo:400:kworker.0 Request processed in 46us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.406254:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1787857836.406268:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1787857836.406273:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188270464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.406310:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188270464:12345-0@lo:400:kworker.0 Request processed in 36us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.406315:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:1.0:1787857836.406329:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857836.406353:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188270464:0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.406362:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874704188270592:0@lo:400:kworker.0 00000100:00100000:2.0:1787857836.410736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857836.410809:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188270336 00000100:00100000:2.0:1787857836.410835:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188270336 00000100:00100000:2.0:1787857836.410902:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1787857836.410912:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188270336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857836.410976:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188270336:12345-0@lo:400:kworker.0 Request processed in 66us (12449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857836.410988:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1787857836.411054:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188270336:0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.411278:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188270720 00000100:00100000:1.0:1787857836.411283:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188270720 00000100:00100000:1.0:1787857836.411333:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1787857836.411342:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874704188270720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.411395:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874704188270720:12345-0@lo:400:kworker.0 Request processed in 45us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.411402:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1787857836.411639:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188270976:0@lo:400:kworker.0 00000100:00100000:3.0:1787857836.411695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857836.411759:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188270976 00000100:00100000:3.0:1787857836.411763:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188270976 00000100:00100000:3.0:1787857836.411791:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1787857836.411798:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188270976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857836.411859:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188270976:12345-0@lo:400:kworker.0 Request processed in 61us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857836.411865:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1787857836.412019:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857836.412029:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188270848:0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.412060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857836.412090:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188270848 00000100:00100000:1.0:1787857836.412094:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188270848 00000100:00100000:1.0:1787857836.412130:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1787857836.412137:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188270848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857836.412172:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188270848:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.412194:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00080000:1.0:1787857836.412212:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857836.412233:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188270848:0@lo:400:kworker.0 00000100:00100000:3.0:1787857836.412279:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188270976:0@lo:400:kworker.0 00000100:00100000:2.0:1787857836.412612:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188270720:0@lo:400:kworker.0 00010000:00010000:2.0:1787857836.790376:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857836.911345:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857836.911371:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188271104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857836.911466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857836.911535:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188271104 00000100:00100000:1.0:1787857836.911543:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188271104 00000100:00100000:1.0:1787857836.911591:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787857836.911600:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188271104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857836.911622:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3853516800 00000100:00100000:1.0:1787857836.911664:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188271104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857836.911672:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787857836.911716:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188271104:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787857837.809010:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857838.830150:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857839.038327:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00000001:00080000:1.0:1787857839.038361:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00000001:00080000:1.0:1787857839.038369:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00010000:00010000:1.0:1787857839.861522:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857839.983713:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857839.984638:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188271232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857839.984712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857839.985155:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188271232 00000100:00100000:1.0:1787857839.985164:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188271232 00000100:00100000:1.0:1787857839.985271:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787857839.985282:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188271232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857839.985335:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857839.985507:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188271232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857839.985526:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1787857839.985663:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857839.985711:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967364 gen 2 00000004:00080000:0.0:1787857839.985718:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967362 committed transno 4294967364 00000004:00080000:0.0:1787857839.985736:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967363 committed transno 4294967364 00000004:00080000:0.0:1787857839.985995:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c34f2940, transno 4294967364 00000100:00100000:0.0:1787857839.986065:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188271232:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787857840.572668:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967374 is committed 00000001:00080000:1.0:1787857840.572683:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967375 is committed 00000001:00080000:3.0:1787857840.611756:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968134 is committed 00000001:00080000:3.0:1787857840.611772:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968142 is committed 00000020:00080000:3.0:1787857840.611787:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 27 batchid updated 00000001:00080000:3.0:1787857840.611804:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968139 is committed 00000020:00080000:3.0:1787857840.611812:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998d1d1f240 refcount 2 committed 0 result 0 batchid 28 00000020:00080000:3.0:1787857840.611834:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998d1d1f0c0 00000020:00080000:3.0:1787857840.611837:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c5c9e400 00000001:00080000:3.0:1787857840.611847:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968141 is committed 00000020:00080000:1.0:1787857840.613733:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 28 committed batchid 27 00000020:00080000:1.0:1787857840.613993:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 27 00010000:00010000:0.0:1787857840.885975:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857841.251740:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857841.251790:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857841.251853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857841.251888:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857841.251910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857841.251942:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857841.251967:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857841.251996:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171750912 00000100:00100000:1.0:1787857841.252005:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171750912 00000100:00100000:1.0:1787857841.252056:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171751424 00000100:00100000:1.0:1787857841.252059:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171751424 00000100:00100000:1.0:1787857841.252072:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171751040 00000100:00100000:1.0:1787857841.252074:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171751040 00000100:00100000:1.0:1787857841.252085:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171751296 00000100:00100000:1.0:1787857841.252087:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171751296 00000100:00100000:1.0:1787857841.252103:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 467 00000100:00100000:1.0:1787857841.252112:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171750912:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857841.252179:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171750912:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 68us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.252187:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 467 00000100:00100000:1.0:1787857841.252203:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 468 00000100:00100000:1.0:1787857841.252209:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171751424:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857841.252235:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171751424:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.252242:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 468 00000100:00100000:1.0:1787857841.252253:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 469 00000100:00100000:1.0:1787857841.252259:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171751040:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857841.252281:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171751040:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.252287:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 469 00000100:00100000:1.0:1787857841.252310:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 470 00000100:00100000:1.0:1787857841.252316:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171751296:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857841.252335:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171751296:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.252339:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 470 00000100:00100000:1.0:1787857841.252355:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171751168 00000100:00100000:1.0:1787857841.252357:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171751168 00000100:00100000:1.0:1787857841.252383:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171750784 00000100:00100000:1.0:1787857841.252385:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171750784 00000100:00100000:1.0:1787857841.252401:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 459 00000100:00100000:1.0:1787857841.252406:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2350:x1874704171751168:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857841.252429:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2350:x1874704171751168:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.252434:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 459 00000100:00100000:1.0:1787857841.252443:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 460 00000100:00100000:1.0:1787857841.252447:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+97:2350:x1874704171750784:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857841.252466:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+97:2350:x1874704171750784:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 19us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.252470:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 460 00000100:00080000:1.0:1787857841.252486:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857841.252489:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857841.252491:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857841.252879:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171750656 00000100:00100000:2.0:1787857841.252884:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171750656 00000100:00100000:2.0:1787857841.252927:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 589 00000100:00100000:2.0:1787857841.252936:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171750656:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857841.252979:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171750656:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 44us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857841.252986:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 589 00000100:00100000:1.0:1787857841.294533:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857841.294705:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171751552 00000100:00100000:2.0:1787857841.294715:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171751552 00000100:00100000:2.0:1787857841.294776:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1258 00000100:00100000:2.0:1787857841.294787:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30120:x1874704171751552:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787857841.295030:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30120:x1874704171751552:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 243us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857841.295038:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1258 00000100:00100000:1.0:1787857841.519051:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188271488:0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.519122:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857841.519181:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188272000:0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.519209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857841.519239:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857841.519245:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188271616:0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.519268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857841.519311:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188271488 00000100:00100000:1.0:1787857841.519317:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188271488 00000100:00100000:1.0:1787857841.519356:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188271616 00000100:00100000:1.0:1787857841.519359:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188271616 00000100:00100000:1.0:1787857841.519388:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1787857841.519396:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188271488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.519447:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188271488:12345-0@lo:400:kworker.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.519455:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1787857841.519470:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1787857841.519476:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188271616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.519503:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188271616:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.519509:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00080000:1.0:1787857841.519527:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857841.519555:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188271616:0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.519567:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188271488:0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.519592:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188272000 00000100:00100000:1.0:1787857841.519595:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188272000 00000100:00100000:1.0:1787857841.519625:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1787857841.519631:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188272000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.519665:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188272000:12345-0@lo:400:kworker.0 Request processed in 34us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.519671:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00080000:1.0:1787857841.519686:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857841.519700:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:1.0:1787857841.519705:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967375 committed transno 4294967375 00000100:00100000:1.0:1787857841.519721:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188272000:0@lo:400:kworker.0 00000100:00100000:2.0:1787857841.519868:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188271360:0@lo:400:kworker.0 00000100:00100000:2.0:1787857841.519905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857841.519937:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188271872:0@lo:400:kworker.0 00000100:00100000:2.0:1787857841.519958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857841.519980:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857841.519985:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188271744:0@lo:400:kworker.0 00000100:00100000:2.0:1787857841.520006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857841.520047:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188271744 00000100:00100000:2.0:1787857841.520051:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188271744 00000100:00100000:2.0:1787857841.520083:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1787857841.520089:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188271744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857841.520122:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188271744:12345-0@lo:400:kworker.0 Request processed in 34us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857841.520128:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00080000:2.0:1787857841.520141:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857841.520149:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188271872 00000100:00100000:2.0:1787857841.520152:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188271872 00000100:00100000:2.0:1787857841.520175:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1787857841.520181:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188271872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857841.520208:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188271872:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857841.520213:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00080000:2.0:1787857841.520226:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857841.520241:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188271744:0@lo:400:kworker.0 00000100:00100000:2.0:1787857841.520250:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188271872:0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.520374:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188271360 00000100:00100000:1.0:1787857841.520378:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188271360 00000100:00100000:1.0:1787857841.520412:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1787857841.520418:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188271360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857841.520453:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188271360:12345-0@lo:400:kworker.0 Request processed in 34us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857841.520458:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1787857841.520791:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188271360:0@lo:400:kworker.0 00010000:00010000:1.0:1787857841.901977:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857842.031174:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857842.031201:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188272128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857842.031270:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857842.031530:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188272128 00000100:00100000:1.0:1787857842.031544:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188272128 00000100:00100000:1.0:1787857842.031596:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787857842.031604:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188272128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857842.031639:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857842.031693:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188272128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857842.031701:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787857842.031841:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188272128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857842.926065:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857843.431409:0:21482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 15:10:41 (1787857841) 00000040:00080000:0.0:1787857843.503530:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857843.503540:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857843.507987:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 37 count 3 00000040:00080000:0.0:1787857843.508007:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857843.634416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857843.634522:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171751680 00000100:00100000:1.0:1787857843.634535:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171751680 00000100:00100000:1.0:1787857843.634599:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 591 00000100:00100000:1.0:1787857843.634610:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:30754:x1874704171751680:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787857843.634632:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857843.634653:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9997c5052000/0xd3f183cab4a7d21b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3e98 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857843.634688:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9997c5052000/0xd3f183cab4a7d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e98 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857843.634702:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9997c5052000/0xd3f183cab4a7d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e98 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857843.634712:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5052000, rc 0) 00000100:00100000:1.0:1787857843.634791:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30754:x1874704171751680:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 183us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857843.634799:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 591 00000100:00100000:1.0:1787857843.643276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857843.643359:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171751808 00000100:00100000:2.0:1787857843.643372:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171751808 00000100:00100000:2.0:1787857843.643443:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 592 00000100:00100000:2.0:1787857843.643455:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30754:x1874704171751808:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787857843.643985:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30754:x1874704171751808:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 529us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857843.643995:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 592 00000100:00100000:1.0:1787857843.648319:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857843.649093:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171751936 00000100:00100000:0.0:1787857843.649108:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171751936 00000100:00100000:0.0:1787857843.649240:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 593 00000100:00100000:0.0:1787857843.649264:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30754:x1874704171751936:12345-192.168.204.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787857843.649838:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30754:x1874704171751936:12345-192.168.204.36@tcp:503:mount.lustre.0 Request processed in 552us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857843.649849:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 593 00000100:00100000:3.0:1787857843.664622:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857843.664757:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171752064 00000100:00100000:1.0:1787857843.664772:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171752064 00000100:00100000:1.0:1787857843.664873:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 594 00000100:00100000:1.0:1787857843.664885:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30758:x1874704171752064:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787857843.665391:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30758:x1874704171752064:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 507us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857843.665401:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 594 00000100:00100000:0.0:1787857843.698513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857843.698655:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171752192 00000100:00100000:1.0:1787857843.698668:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171752192 00000100:00100000:1.0:1787857843.698743:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 595 00000100:00100000:1.0:1787857843.698754:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30758:x1874704171752192:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787857843.699218:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30758:x1874704171752192:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 464us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857843.699228:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 595 00000100:00100000:3.0:1787857843.712807:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857843.713081:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171752320 00000100:00100000:2.0:1787857843.713096:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171752320 00000100:00100000:2.0:1787857843.713174:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 596 00000100:00100000:2.0:1787857843.713186:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30758:x1874704171752320:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857843.713531:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30758:x1874704171752320:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 345us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857843.713541:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 596 00000100:00100000:3.0:1787857843.717471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857843.717596:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171752448 00000100:00100000:0.0:1787857843.717609:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171752448 00000100:00100000:0.0:1787857843.717682:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 597 00000100:00100000:0.0:1787857843.717693:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:30754:x1874704171752448:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787857843.717716:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857843.717740:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998efa71600/0xd3f183cab4a7d222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ec2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857843.717778:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998efa71600/0xd3f183cab4a7d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ec2 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857843.717791:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998efa71600/0xd3f183cab4a7d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ec2 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857843.717803:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857843.717920:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:30754:x1874704171752448:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 228us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857843.717928:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 597 00000100:00100000:0.0:1787857843.721637:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857843.722058:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171752576 00000100:00100000:1.0:1787857843.722071:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171752576 00000100:00100000:1.0:1787857843.722139:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 598 00000100:00100000:1.0:1787857843.722151:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:30754:x1874704171752576:12345-192.168.204.36@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787857843.722186:0:5851:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787857843.722219:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787857843.722224:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787857843.722228:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787857843.722231:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787857843.724218:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:30754:x1874704171752576:12345-192.168.204.36@tcp:256:mount.lustre.0 Request processed in 2058us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857843.724234:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 598 00000100:00100000:3.0:1787857843.727644:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857843.727803:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171752704 00000100:00100000:2.0:1787857843.727859:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171752704 00000100:00100000:2.0:1787857843.727923:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 599 00000100:00100000:2.0:1787857843.727935:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:30754:x1874704171752704:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787857843.727970:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857843.727998:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9998efa75e00/0xd3f183cab4a7d229 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ec9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857843.728035:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9998efa75e00/0xd3f183cab4a7d229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ec9 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857843.728047:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9998efa75e00/0xd3f183cab4a7d229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ec9 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857843.728058:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75e00, rc 0) 00000100:00100000:2.0:1787857843.728133:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30754:x1874704171752704:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 201us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857843.728141:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 599 00000100:00100000:0.0:1787857843.732022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857843.732147:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171752832 00000100:00100000:1.0:1787857843.732161:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171752832 00000100:00100000:1.0:1787857843.732238:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 600 00000100:00100000:1.0:1787857843.732261:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30754:x1874704171752832:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787857843.732663:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30754:x1874704171752832:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 413us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857843.732671:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 600 00000100:00100000:3.0:1787857843.734867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857843.734985:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171752960 00000100:00100000:0.0:1787857843.735000:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171752960 00000100:00100000:0.0:1787857843.735065:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 601 00000100:00100000:0.0:1787857843.735077:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30754:x1874704171752960:12345-192.168.204.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787857843.735598:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30754:x1874704171752960:12345-192.168.204.36@tcp:503:mount.lustre.0 Request processed in 522us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857843.735608:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 601 00000100:00100000:3.0:1787857843.738642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857843.738872:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171753088 00000100:00100000:2.0:1787857843.738883:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171753088 00000100:00100000:2.0:1787857843.738960:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 602 00000100:00100000:2.0:1787857843.738972:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30762:x1874704171753088:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857843.739356:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30762:x1874704171753088:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 384us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857843.739365:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 602 00000100:00100000:2.0:1787857843.747529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857843.748237:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171753216 00000100:00100000:1.0:1787857843.748298:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171753216 00000100:00100000:1.0:1787857843.748370:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 603 00000100:00100000:1.0:1787857843.748382:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30762:x1874704171753216:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787857843.748791:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:30762:x1874704171753216:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 409us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857843.748800:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 603 00000100:00100000:3.0:1787857843.764907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.764968:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.764996:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.765022:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.765042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.765059:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.765080:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.765114:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171753856 00000100:00100000:3.0:1787857843.765125:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171753856 00000100:00100000:3.0:1787857843.765188:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171754368 00000100:00100000:3.0:1787857843.765191:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171754368 00000100:00100000:3.0:1787857843.765203:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171753984 00000100:00100000:3.0:1787857843.765205:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171753984 00000100:00100000:3.0:1787857843.765216:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171754240 00000100:00100000:3.0:1787857843.765218:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171754240 00000100:00100000:3.0:1787857843.765234:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 473 00000100:00100000:3.0:1787857843.765253:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171753856:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857843.765339:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171753856:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 96us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857843.765346:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 473 00000100:00100000:3.0:1787857843.765367:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 474 00000100:00100000:3.0:1787857843.765372:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171754368:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857843.765393:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171754368:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857843.765399:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 474 00000100:00100000:3.0:1787857843.765409:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 475 00000100:00100000:3.0:1787857843.765414:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171753984:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857843.765430:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+13:2349:x1874704171753984:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 16us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857843.765436:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 475 00000100:00100000:3.0:1787857843.765445:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 476 00000100:00100000:3.0:1787857843.765450:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171754240:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857843.765467:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171754240:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 17us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857843.765472:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 476 00000100:00100000:3.0:1787857843.765488:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171753344 00000100:00100000:3.0:1787857843.765492:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171753344 00000100:00100000:3.0:1787857843.765506:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171754112 00000100:00100000:3.0:1787857843.765508:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171754112 00000100:00100000:3.0:1787857843.765531:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171753728 00000100:00100000:3.0:1787857843.765533:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171753728 00000100:00100000:3.0:1787857843.765545:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 464 00000100:00100000:3.0:1787857843.765550:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2349:x1874704171754112:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857843.765577:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2349:x1874704171754112:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857843.765583:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 464 00000100:00100000:3.0:1787857843.765593:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 465 00000100:00100000:3.0:1787857843.765598:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+97:2349:x1874704171753728:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857843.765614:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+97:2349:x1874704171753728:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 16us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857843.765619:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 465 00000100:00100000:3.0:1787857843.765628:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1259 00000100:00100000:3.0:1787857843.765633:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1874704171753344:12345-192.168.204.36@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787857843.765661:0:5856:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from fbe95d23-aca9-4437-bb82-726493375ab7@192.168.204.36@tcp t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:3.0:1787857843.765706:0:5856:0:(genops.c:1385:class_connect()) connect: client fbe95d23-aca9-4437-bb82-726493375ab7, cookie 0xd3f183cab4a7d230 00000004:00100000:3.0:1787857843.765749:0:5856:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787857843.766118:0:5856:0:(import.c:65:import_set_state_nolock()) ffff9998ffab6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857843.766148:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:2346:x1874704171753344:12345-192.168.204.36@tcp:38:mount.lustre.0 Request processed in 514us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857843.766156:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1259 00000100:00080000:3.0:1787857843.766183:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857843.766187:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857843.766189:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857843.768995:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.772132:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857843.782935:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171753472 00000100:00100000:2.0:1787857843.783044:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171753472 00000100:00100000:2.0:1787857843.783173:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171753600 00000100:00100000:2.0:1787857843.783177:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171753600 00000100:00080000:3.0:1787857843.783218:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857843.783287:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1260 00000100:00100000:0.0:1787857843.783315:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+7:0:x1874704171753472:12345-192.168.204.36@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787857843.783374:0:5857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:0.0:1787857843.783472:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+7:0:x1874704171753472:12345-192.168.204.36@tcp:41:mount.lustre.0 Request processed in 162us (14493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857843.783480:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1260 00000100:00100000:0.0:1787857843.783500:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1261 00000100:00100000:0.0:1787857843.783506:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+6:30754:x1874704171753600:12345-192.168.204.36@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787857843.783517:0:5857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:0.0:1787857843.783535:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+6:30754:x1874704171753600:12345-192.168.204.36@tcp:41:mount.lustre.0 Request processed in 29us (11421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857843.784591:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1261 00000100:00100000:3.0:1787857843.786231:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857843.787172:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171754496 00000100:00100000:1.0:1787857843.787185:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171754496 00000100:00100000:1.0:1787857843.787275:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1262 00000100:00100000:1.0:1787857843.787287:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+6:30754:x1874704171754496:12345-192.168.204.36@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787857843.787664:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+6:30754:x1874704171754496:12345-192.168.204.36@tcp:40:mount.lustre.0 Request processed in 378us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857843.787673:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1262 00000100:00100000:3.0:1787857843.792527:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.792585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857843.792685:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857843.793187:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171754624 00000100:00100000:1.0:1787857843.793200:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171754624 00000100:00100000:1.0:1787857843.793261:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171754752 00000100:00100000:1.0:1787857843.793264:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171754752 00000100:00100000:1.0:1787857843.793286:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 345 00000100:00100000:1.0:1787857843.793297:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1874704171754624:12345-192.168.204.36@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787857843.793338:0:6714:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from fbe95d23-aca9-4437-bb82-726493375ab7@192.168.204.36@tcp t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:1.0:1787857843.793388:0:6714:0:(genops.c:1385:class_connect()) connect: client fbe95d23-aca9-4437-bb82-726493375ab7, cookie 0xd3f183cab4a7d237 00002000:00100000:1.0:1787857843.793403:0:6714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fbe95d23-aca9-4437-bb82-726493375ab7/ffff9997c5a63000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787857843.793433:0:6714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787857843.793638:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 346 00000100:00100000:3.0:1787857843.793645:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2346:x1874704171754752:12345-192.168.204.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787857843.793663:0:14028:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from fbe95d23-aca9-4437-bb82-726493375ab7@192.168.204.36@tcp t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:3.0:1787857843.793703:0:14028:0:(genops.c:1385:class_connect()) connect: client fbe95d23-aca9-4437-bb82-726493375ab7, cookie 0xd3f183cab4a7d23e 00002000:00100000:3.0:1787857843.793708:0:14028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fbe95d23-aca9-4437-bb82-726493375ab7/ffff9998ffab7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787857843.793716:0:14028:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787857843.794028:0:14028:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787857843.794066:0:14028:0:(import.c:65:import_set_state_nolock()) ffff9998ffab5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857843.794148:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fbe95d23-aca9-4437-bb82-726493375ab7+6:2346:x1874704171754752:12345-192.168.204.36@tcp:8:mount.lustre.0 Request processed in 502us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857843.794157:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 346 00002000:00080000:1.0:1787857843.794723:0:6714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787857843.794793:0:6714:0:(import.c:65:import_set_state_nolock()) ffff9997c5a63800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787857843.794836:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbe95d23-aca9-4437-bb82-726493375ab7+6:2346:x1874704171754624:12345-192.168.204.36@tcp:8:mount.lustre.0 Request processed in 1540us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857843.794844:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 345 00000100:00100000:2.0:1787857843.794938:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171754880 00000100:00100000:2.0:1787857843.794954:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171754880 00000100:00100000:2.0:1787857843.795003:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 256 00000100:00100000:2.0:1787857843.795011:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:30754:x1874704171754880:12345-192.168.204.36@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787857843.795259:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000100:00100000:2.0:1787857843.795364:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:30754:x1874704171754880:12345-192.168.204.36@tcp:33:mount.lustre.0 Request processed in 353us (2857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857843.795372:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 256 00010000:00010000:1.0:1787857843.951416:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857844.120304:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.121026:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171755008 00000100:00100000:3.0:1787857844.121041:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171755008 00000100:00100000:3.0:1787857844.121116:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1263 00000100:00100000:3.0:1787857844.121128:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+6:30803:x1874704171755008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857844.121155:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857844.121183:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ef3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.121285:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.121312:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.121327:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857844.121518:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857844.121524:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857844.121987:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.122020:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 8 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.122040:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 7 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.122055:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:3.0:1787857844.122058:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857844.122062:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72800, rc 0) 00000100:00100000:3.0:1787857844.122149:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+7:30803:x1874704171755008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1023us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.122158:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1263 00000100:00100000:0.0:1787857844.136705:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857844.136769:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171755136 00000100:00100000:0.0:1787857844.136783:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171755136 00000100:00100000:0.0:1787857844.136880:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1264 00000100:00100000:0.0:1787857844.136893:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+7:30804:x1874704171755136:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857844.136923:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857844.136952:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3efa expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137051:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137070:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137085:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137103:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137111:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137118:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137668:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d268 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137681:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137690:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857844.137793:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787857844.137798:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857844.137917:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137930:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137937:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137944:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137952:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857844.137956:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137964:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137978:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857844.137981:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857844.137986:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.137997:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d25a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138009:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138014:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138020:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138024:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857844.138027:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138033:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138041:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9997c3d03100) 00010000:00010000:0.0:1787857844.138043:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857844.138046:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138052:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d261 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138097:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3efa expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138112:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d268 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3efa expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.138120:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:0.0:1787857844.138123:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857844.138125:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857844.138224:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+8:30804:x1874704171755136:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1332us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857844.138233:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1264 00000100:00100000:2.0:1787857844.146019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.146164:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171755392 00000100:00100000:3.0:1787857844.146178:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171755392 00000100:00100000:3.0:1787857844.146469:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1265 00000100:00100000:3.0:1787857844.146483:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+8:30804:x1874704171755392:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857844.146512:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857844.146540:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d26f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f01 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.146637:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.146656:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.146670:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.146687:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.146694:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.146702:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147439:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d284 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147453:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147462:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857844.147473:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787857844.147675:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147684:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147697:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147704:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857844.147708:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147717:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147732:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:3.0:1787857844.147736:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857844.147743:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147748:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d276 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147764:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147770:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147775:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147780:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857844.147782:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147787:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147794:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9998d12efc00) 00010000:00010000:3.0:1787857844.147796:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857844.147799:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.147804:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d27d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.148523:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d26f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f01 expref: 11 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.148549:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d284 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f01 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.148558:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857844.148560:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857844.148563:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72200, rc 0) 00000100:00100000:3.0:1787857844.148733:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:30804:x1874704171755392:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2252us (2727us total) trans 4294968143 rc 0/0 00000100:00100000:3.0:1787857844.148743:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1265 00000001:00100000:1.0:1787857844.150915:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fbe95d23-aca9-4437-bb82-726493375ab7 00000100:00100000:0.0:1787857844.154449:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.154561:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171755520 00000100:00100000:3.0:1787857844.154576:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171755520 00000100:00100000:3.0:1787857844.154654:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1266 00000100:00100000:3.0:1787857844.154666:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+10:30804:x1874704171755520:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787857844.155122:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+10:30804:x1874704171755520:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 457us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.155130:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1266 00000100:00100000:2.0:1787857844.164761:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857844.165353:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171755648 00000100:00100000:0.0:1787857844.165365:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171755648 00000100:00100000:0.0:1787857844.165452:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1267 00000100:00100000:0.0:1787857844.165465:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+97:30805:x1874704171755648:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857844.165492:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857844.165519:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d292 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f08 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.165613:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.165630:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.165643:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.165658:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.165665:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.165673:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166286:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166295:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166303:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166309:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857844.166313:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166322:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166337:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857844.166340:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857844.166346:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166352:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166369:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166376:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166383:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166388:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857844.166390:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166396:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166402:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff9997c3d03100) 00010000:00010000:0.0:1787857844.166405:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857844.166408:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166414:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d2a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166462:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d292 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f08 expref: 98 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166474:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857844.166477:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857844.166481:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d292 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f08 expref: 98 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.166492:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71c00, rc 0) 00000100:00100000:0.0:1787857844.166593:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+97:30805:x1874704171755648:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1131us (1847us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857844.166607:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1267 00000100:00100000:2.0:1787857844.172699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.172971:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171755904 00000100:00100000:3.0:1787857844.172985:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171755904 00000100:00100000:3.0:1787857844.173098:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1268 00000100:00100000:3.0:1787857844.173111:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+97:30805:x1874704171755904:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:3.0:1787857844.173193:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857844.173233:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7ce0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d41 expref: 97 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.173268:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:3.0:1787857844.173275:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857844.173653:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.173670:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.173680:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.173689:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.174111:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.174131:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 9 pid: 5858 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857844.174149:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa8a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188272256:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857844.175462:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.175478:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 44 pid: 5856 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857844.175493:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188272384:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857844.176357:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c11ca9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857844.179193:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa8a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188272256:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857844.179214:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188272384:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857844.179270:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857844.182211:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857844.182272:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.182363:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171756032 00000100:00100000:3.0:1787857844.182376:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171756032 00010000:00010000:3.0:1787857844.182435:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 10 pid: 5858 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857844.182484:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171756160 00000100:00100000:3.0:1787857844.182487:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171756160 00010000:00010000:3.0:1787857844.182502:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 45 pid: 5856 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857844.182533:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 379 00000100:00100000:3.0:1787857844.182545:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+10:2350:x1874704171756032:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857844.182702:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857844.182725:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 10 pid: 5858 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.182747:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 10 pid: 5858 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.182774:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d24c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ef3 expref: 10 pid: 5858 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.182795:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:3.0:1787857844.182811:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.182898:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857844.182961:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+9:2350:x1874704171756032:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 417us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.182972:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 379 00000100:00100000:3.0:1787857844.183016:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 380 00000100:00100000:3.0:1787857844.183028:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:2349:x1874704171756160:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857844.183037:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857844.183042:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 45 pid: 5856 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.183052:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 45 pid: 5856 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.183065:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7ce4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3d56 expref: 45 pid: 5856 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.183077:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:3.0:1787857844.183081:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.183089:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.183097:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.183119:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857844.183137:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171756160:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 114us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.183144:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 380 00010000:00010000:0.0:1787857844.183869:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.183882:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.183914:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.183928:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.183949:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857844.185634:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 512 00010000:00010000:0.0:1787857844.185655:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.185665:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.185673:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.185683:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857844.185689:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.185698:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.185716:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998e1a0ca00) 00010000:00010000:0.0:1787857844.185720:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857844.185725:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.186584:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d2a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857844.186619:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009db6c25 reply state 000000008ddf7177 transno 4294968144 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857844.186629:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857844.187288:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+98:30805:x1874704171755904:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 14173us (14597us total) trans 4294968144 rc 0/0 00000100:00100000:0.0:1787857844.187311:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1268 00010000:00010000:3.0:1787857844.204785:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.204845:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.204853:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.204860:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857844.204865:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.204873:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.204904:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff9997c3d03100) 00010000:00010000:3.0:1787857844.204908:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857844.204913:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.204920:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d2ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857844.242808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.243251:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171756288 00000100:00100000:3.0:1787857844.243265:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171756288 00000100:00100000:3.0:1787857844.243406:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1269 00000100:00100000:3.0:1787857844.243421:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:30809:x1874704171756288:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:3.0:1787857844.243449:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857844.243481:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d2b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f0f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.243578:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d2bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.243596:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d2bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.243611:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d2bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857844.243702:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857844.243707:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857844.243738:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d2bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.243770:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d2b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f0f expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.243796:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d2bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f0f expref: 45 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.243807:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12efc00) 00010000:00010000:3.0:1787857844.243810:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857844.243814:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73200, rc 0) 00000100:00100000:3.0:1787857844.243976:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30809:x1874704171756288:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 558us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.243985:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1269 00000100:00100000:0.0:1787857844.252064:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857844.252175:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857844.252326:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171756416 00000100:00100000:1.0:1787857844.252339:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171756416 00000100:00100000:2.0:1787857844.252483:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171756672 00000100:00100000:2.0:1787857844.252489:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171756672 00000100:00100000:2.0:1787857844.252540:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1270 00000100:00100000:2.0:1787857844.252552:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2349:x1874704171756416:12345-192.168.204.36@tcp:41:mkdir.0 00000004:00000024:2.0:1787857844.252612:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:0.0:1787857844.253037:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1271 00000100:00100000:0.0:1787857844.253049:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30809:x1874704171756672:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:0.0:1787857844.253107:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857844.253147:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d2bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f0f expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.253173:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12efc00) 00010000:00010000:0.0:1787857844.253188:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857844.253384:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30809:x1874704171756672:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 325us (1195us total) trans 0 rc -17/-17 00000100:00100000:0.0:1787857844.253392:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1271 00000100:00100000:2.0:1787857844.253522:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:2349:x1874704171756416:12345-192.168.204.36@tcp:41:mkdir.0 Request processed in 971us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857844.253541:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1270 00000100:00100000:2.0:1787857844.257720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.258037:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171756800 00000100:00100000:3.0:1787857844.258052:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171756800 00000100:00100000:2.0:1787857844.258245:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1272 00000100:00100000:2.0:1787857844.258257:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+44:30809:x1874704171756800:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:2.0:1787857844.258286:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857844.258329:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d2c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f16 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.258556:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.258575:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.258594:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857844.258673:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857844.258677:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857844.258704:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.263508:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d2c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.264052:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 45 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.264066:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857844.264070:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857844.264075:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74400, rc 0) 00000100:00100000:2.0:1787857844.264452:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30809:x1874704171756800:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 6195us (6745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857844.264464:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1272 00000100:00100000:0.0:1787857844.278074:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857844.282581:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171756928 00000100:00100000:2.0:1787857844.282603:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171756928 00000100:00100000:2.0:1787857844.282694:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1273 00000100:00100000:2.0:1787857844.282707:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+45:30809:x1874704171756928:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:2.0:1787857844.282744:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857844.282769:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d2d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f1d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283073:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283091:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283107:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283124:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283132:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283139:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283285:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d2e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283295:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283303:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857844.283355:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 512 00000004:00200000:2.0:1787857844.283360:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857844.283389:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283408:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283415:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283423:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283430:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857844.283435:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283443:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283458:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857844.283461:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857844.283466:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283473:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d2d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283487:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283493:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283500:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283505:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857844.283507:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283513:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283521:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff9998c3379d00) 00010000:00010000:2.0:1787857844.283523:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857844.283540:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283548:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d2df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283585:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d2d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f1d expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283602:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f1d expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.283610:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857844.283613:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857844.283615:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857844.283717:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30809:x1874704171756928:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 1012us (5658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857844.283725:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1273 00000100:00100000:3.0:1787857844.296984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857844.297229:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171757056 00000100:00100000:1.0:1787857844.297252:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171757056 00000100:00100000:1.0:1787857844.297346:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1274 00000100:00100000:1.0:1787857844.297358:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30810:x1874704171757056:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857844.297386:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857844.297416:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d2ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f24 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297508:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297525:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297552:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297576:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297583:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297590:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297683:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297691:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297698:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297705:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857844.297709:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297719:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297733:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998c3379800) 00010000:00010000:1.0:1787857844.297736:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857844.297743:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297749:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d2f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297765:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297772:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297777:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297782:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857844.297785:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297792:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297799:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857844.297801:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857844.297804:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.297810:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d2fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.298339:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d2ed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f24 expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.298353:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998c3379800) 00010000:00010000:1.0:1787857844.298356:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857844.298361:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d2ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f24 expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.298371:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:1.0:1787857844.298465:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30810:x1874704171757056:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1108us (1498us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857844.298473:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1274 00000100:00100000:3.0:1787857844.315405:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857844.316721:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171757312 00000100:00100000:2.0:1787857844.316747:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171757312 00000100:00100000:2.0:1787857844.317211:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1275 00000100:00100000:2.0:1787857844.317226:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30811:x1874704171757312:12345-192.168.204.36@tcp:101:dd.0 00010000:00010000:2.0:1787857844.317267:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857844.317272:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787857844.317310:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d2e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f1d expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.317337:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857844.317352:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857844.317381:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d302 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f2b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.317572:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.317588:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.317599:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.317614:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.317621:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.317628:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857844.319289:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:3.0:1787857844.319534:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319552:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319565:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319610:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319617:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319625:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319631:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857844.319636:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319645:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319660:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998c3379d00) 00010000:00010000:3.0:1787857844.319663:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857844.319669:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319680:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d309 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857844.319696:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e0ee5d0 reply state 0000000015939732 transno 4294968145 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857844.319707:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857844.319763:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d302 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319785:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.319793:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:3.0:1787857844.319795:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857844.319797:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72a00, rc 0) 00000100:00100000:3.0:1787857844.319943:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30811:x1874704171757312:12345-192.168.204.36@tcp:101:dd.0 Request processed in 2720us (4554us total) trans 4294968145 rc 0/0 00000100:00100000:3.0:1787857844.319953:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1275 00010000:00010000:3.0:1787857844.326222:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.326255:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.326264:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.326271:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857844.326278:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.326287:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.326309:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9998c3379200) 00010000:00010000:3.0:1787857844.326312:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857844.326317:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.326324:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d310 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857844.362632:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857844.368221:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171757440 00000100:00100000:1.0:1787857844.368251:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171757440 00000100:00100000:1.0:1787857844.368452:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00100000:1.0:1787857844.368466:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:30811:x1874704171757440:12345-192.168.204.36@tcp:101:dd.0 00010000:00010000:1.0:1787857844.368489:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857844.368516:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f32 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857844.368560:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857844.368589:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1787857844.368595:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857844.368605:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 9 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.368623:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 9 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.368639:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053400, rc 0) 00000100:00100000:1.0:1787857844.368742:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:30811:x1874704171757440:12345-192.168.204.36@tcp:101:dd.0 Request processed in 279us (6127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857844.368753:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00100000:1.0:1787857844.410584:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.410666:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171757568 00000100:00100000:3.0:1787857844.410680:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171757568 00002000:00100000:3.0:1787857844.410759:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff9997c1b430c0 x1874704171757568/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:490/0 lens 488/0 e 0 to 0 dl 1787857855 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857844.410772:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c1b430c0 with x1874704171757568 ext(0->1048575) 00002000:00010000:3.0:1787857844.410779:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c1b430c0 00000100:00100000:3.0:1787857844.410861:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 111 00000100:00100000:3.0:1787857844.410873:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171757568:12345-192.168.204.36@tcp:4:dd.0 00000100:00100000:0.0:1787857844.474476:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171757568:12345-192.168.204.36@tcp:4:dd.0 Request processed in 63595us (63897us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787857844.474491:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 111 00002000:00100000:0.0:1787857844.474504:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff9997c1b430c0 x1874704171757568/t4294967365(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:490/0 lens 488/448 e 0 to 0 dl 1787857855 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857844.474525:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c1b430c0 with x1874704171757568 ext(0->1048575) 00002000:00010000:0.0:1787857844.474532:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c1b430c0 00000100:00100000:1.0:1787857844.486209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857844.486362:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171757696 00000100:00100000:0.0:1787857844.486371:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171757696 00000100:00100000:0.0:1787857844.486434:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1276 00000100:00100000:0.0:1787857844.486443:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30811:x1874704171757696:12345-192.168.204.36@tcp:44:dd.0 00000040:00080000:0.0:1787857844.530169:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857844.530177:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857844.530286:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 37 count 3 00000040:00080000:0.0:1787857844.530293:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1787857844.621270:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968144 is committed 00000020:00080000:1.0:1787857844.621290:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 28 batchid updated 00000001:00080000:1.0:1787857844.621306:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968145 is committed 00000001:00080000:1.0:1787857844.621347:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968143 is committed 00000001:00100000:1.0:1787857844.621352:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fbe95d23-aca9-4437-bb82-726493375ab7 00000020:00080000:1.0:1787857844.621363:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00000020:00080000:1.0:1787857844.621376:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00000100:00100000:3.0:1787857844.621610:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30811:x1874704171757696:12345-192.168.204.36@tcp:44:dd.0 Request processed in 135155us (135409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.621623:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1276 00000100:00100000:3.0:1787857844.626261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857844.627507:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171757824 00000100:00100000:2.0:1787857844.627519:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171757824 00000100:00100000:2.0:1787857844.627992:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 348 00000100:00100000:2.0:1787857844.628005:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171757824:12345-192.168.204.36@tcp:16:dd.0 00000100:00100000:1.0:1787857844.654909:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171757824:12345-192.168.204.36@tcp:16:dd.0 Request processed in 26897us (28647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857844.654935:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 348 00000001:00080000:1.0:1787857844.654977:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00000100:00100000:2.0:1787857844.658082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.658138:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171758080 00000100:00100000:3.0:1787857844.658149:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171758080 00000100:00100000:3.0:1787857844.658202:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 257 00000100:00100000:3.0:1787857844.658211:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30811:x1874704171758080:12345-192.168.204.36@tcp:35:dd.0 00000100:00100000:3.0:1787857844.658713:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30811:x1874704171758080:12345-192.168.204.36@tcp:35:dd.0 Request processed in 501us (638us total) trans 4294968146 rc 0/0 00000100:00100000:3.0:1787857844.658722:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 257 00000100:00100000:3.0:1787857844.673560:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857844.673691:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171758208 00000100:00100000:1.0:1787857844.673700:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171758208 00000100:00100000:1.0:1787857844.673763:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1277 00000100:00100000:1.0:1787857844.673773:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30812:x1874704171758208:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857844.673796:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857844.673966:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f39 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674041:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674056:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674072:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674087:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674093:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674099:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674671:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674681:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674689:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857844.674770:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:1.0:1787857844.674773:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857844.674943:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674957:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674964:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674975:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674982:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857844.674986:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.674993:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675006:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:1.0:1787857844.675010:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857844.675014:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675020:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675032:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675039:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675045:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675049:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857844.675052:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675062:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675069:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff9998e1a0cc00) 00010000:00010000:1.0:1787857844.675072:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857844.675075:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675080:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d33a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675111:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f39 expref: 49 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675124:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053200/0xd3f183cab4a7d341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f39 expref: 48 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857844.675131:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:1.0:1787857844.675134:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857844.675136:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053200, rc 0) 00000100:00100000:1.0:1787857844.675283:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:30812:x1874704171758208:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1510us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857844.675602:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1277 00000100:00100000:1.0:1787857844.699990:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.700086:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171758336 00000100:00100000:3.0:1787857844.700097:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171758336 00000100:00100000:3.0:1787857844.700161:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1278 00000100:00100000:3.0:1787857844.700173:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+96:30814:x1874704171758336:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:3.0:1787857844.700199:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857844.700240:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f40 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.700321:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d34f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.700340:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.700358:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857844.700608:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857844.700613:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857844.700714:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d34f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.700738:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f40 expref: 98 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.700757:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d34f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f40 expref: 97 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.700765:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:3.0:1787857844.700768:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857844.700772:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:3.0:1787857844.700876:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+97:30814:x1874704171758336:12345-192.168.204.36@tcp:101:stat.0 Request processed in 706us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.700884:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1278 00000100:00100000:2.0:1787857844.708308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.708448:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171758464 00000100:00100000:3.0:1787857844.708458:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171758464 00000100:00100000:3.0:1787857844.708533:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1279 00000100:00100000:3.0:1787857844.708544:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+97:30814:x1874704171758464:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:3.0:1787857844.708563:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857844.708582:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f47 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.708649:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.708663:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.708674:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.708690:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.708698:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.708706:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709154:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d36b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709165:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709172:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857844.709267:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:3.0:1787857844.709271:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857844.709365:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709378:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709385:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709392:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709399:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857844.709403:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709412:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709424:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:3.0:1787857844.709427:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857844.709432:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709438:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d35d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709450:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709456:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709461:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709466:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857844.709469:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709476:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709483:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff9998d12ef600) 00010000:00010000:3.0:1787857844.709486:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857844.709488:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709498:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d364 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709528:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f47 expref: 99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709542:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72e00/0xd3f183cab4a7d36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f47 expref: 98 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.709549:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:3.0:1787857844.709551:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787857844.709554:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72e00, rc 0) 00000100:00100000:3.0:1787857844.709611:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+98:30814:x1874704171758464:12345-192.168.204.36@tcp:101:stat.0 Request processed in 1069us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.709619:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1279 00000100:00100000:1.0:1787857844.713876:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857844.714454:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171758592 00000100:00100000:2.0:1787857844.714465:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171758592 00000100:00100000:2.0:1787857844.714535:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1280 00000100:00100000:2.0:1787857844.714545:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+98:30814:x1874704171758592:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:2.0:1787857844.714564:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857844.714584:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d372 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f4e expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.714645:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.714659:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.714670:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.714685:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.714692:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.714703:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715047:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715056:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715063:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857844.715094:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:2.0:1787857844.715098:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857844.715116:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715128:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715135:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715141:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715148:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715155:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857844.715159:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715167:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715179:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:2.0:1787857844.715182:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857844.715186:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715193:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715205:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715211:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715217:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715222:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857844.715233:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715239:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715245:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9998c3379800) 00010000:00010000:2.0:1787857844.715247:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857844.715250:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715257:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715285:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d372 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 100 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715296:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.715304:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:2.0:1787857844.715306:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857844.715308:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857844.715361:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+99:30814:x1874704171758592:12345-192.168.204.36@tcp:101:stat.0 Request processed in 819us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857844.715368:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1280 00000100:00100000:1.0:1787857844.718223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.718352:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171758720 00000100:00100000:3.0:1787857844.718363:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171758720 00000100:00100000:3.0:1787857844.718422:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 349 00000100:00100000:3.0:1787857844.718431:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171758720:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:3.0:1787857844.718448:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857844.718464:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7d38e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f55 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857844.718517:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7019a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188272512:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857844.718606:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70f8a80 going to sleep for 11 seconds 00002000:00010000:3.0:1787857844.722129:0:6714:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:3.0:1787857844.722140:0:6714:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb mtime: 0 -> 1787857843 00002000:00010000:3.0:1787857844.722143:0:6714:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb atime: 0 -> 1787857843 00002000:00010000:3.0:1787857844.722146:0:6714:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb ctime: 0 -> 1787857843 00002000:00010000:3.0:1787857844.722148:0:6714:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb blocks: 1 -> 2051 00000100:00100000:3.0:1787857844.722171:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7019a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188272512:192.168.204.36@tcp:106: 00010000:00010000:3.0:1787857844.722211:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7d38e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f55 expref: 17 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.722247:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7d38e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f55 expref: 17 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.722262:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73e00, rc 0) 00000100:00100000:3.0:1787857844.722321:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171758720:12345-192.168.204.36@tcp:101:stat.0 Request processed in 3890us (4107us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857844.722331:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 349 00000100:00100000:2.0:1787857844.740038:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857844.740238:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171758848 00000100:00100000:1.0:1787857844.740248:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171758848 00000100:00100000:1.0:1787857844.740310:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 350 00000100:00100000:1.0:1787857844.740322:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171758848:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857844.740340:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857844.740359:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfd8b0f5/0xd3f183cab4a7d395 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f5c expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857844.740414:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b40f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188272640:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857844.740493:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857844.749566:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b40f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188272640:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857844.749603:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfd8b0f5/0xd3f183cab4a7d395 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f5c expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.749633:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfd8b0f5/0xd3f183cab4a7d395 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f5c expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857844.749647:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:0.0:1787857844.749709:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171758848:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 9389us (9680us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857844.749718:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 350 00000100:00100000:2.0:1787857844.753481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857844.753644:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171758976 00000100:00100000:3.0:1787857844.753653:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171758976 00000100:00100000:3.0:1787857844.753751:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1281 00000100:00100000:3.0:1787857844.753762:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+99:30815:x1874704171758976:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857844.753782:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857844.753802:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d39c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f63 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.753903:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.753918:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.753939:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857844.754122:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:3.0:1787857844.754127:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857844.754205:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.754244:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d39c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 101 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.754264:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 100 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857844.754272:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:3.0:1787857844.754275:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857844.754279:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72800, rc 0) 00000100:00100000:3.0:1787857844.754345:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+100:30815:x1874704171758976:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 585us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857844.754353:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1281 00000100:00100000:2.0:1787857844.757613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857844.758013:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171759104 00000100:00100000:1.0:1787857844.758023:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171759104 00000100:00100000:1.0:1787857844.758109:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 351 00000100:00100000:1.0:1787857844.758118:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171759104:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857844.758135:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857844.758151:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7d3aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f6a expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857844.758207:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188272768:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857844.758315:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857844.760349:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188272768:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857844.760386:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7d3aa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f6a expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.760414:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061222e9c/0xd3f183cab4a7d3aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f6a expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857844.760433:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:2.0:1787857844.760568:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171759104:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2450us (2962us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857844.760577:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 351 00000100:00100000:2.0:1787857844.766450:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857844.766615:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171759360 00000100:00100000:0.0:1787857844.766625:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171759360 00000100:00100000:0.0:1787857844.766857:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1282 00000100:00100000:0.0:1787857844.766869:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:30815:x1874704171759360:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857844.767282:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].37, 136 off13224 00000100:00100000:0.0:1787857844.767369:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:30815:x1874704171759360:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 502us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857844.767376:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1282 00010000:00010000:0.0:1787857844.977421:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857845.104046:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188272896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857845.104168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857845.104332:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188272896 00000100:00100000:1.0:1787857845.104343:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188272896 00000100:00100000:1.0:1787857845.104425:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787857845.104436:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188272896:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787857845.104486:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787857845.104493:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1787857845.104562:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188272896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857845.104571:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787857845.104769:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188272896:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787857845.550546:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857845.550555:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857845.550598:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 38 count 4 00000040:00080000:2.0:1787857845.550604:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857845.550950:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188273024:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857845.551047:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0d18900 going to sleep for 11 seconds 00000100:00100000:1.0:1787857845.561603:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188273024:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857845.583950:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857845.585122:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171759488 00000100:00100000:0.0:1787857845.585136:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171759488 00000100:00100000:0.0:1787857845.585233:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:0.0:1787857845.585246:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fbe95d23-aca9-4437-bb82-726493375ab7+7:30825:x1874704171759488:12345-192.168.204.36@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787857845.585344:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fbe95d23-aca9-4437-bb82-726493375ab7+7:30825:x1874704171759488:12345-192.168.204.36@tcp:900:lhsmtool_posix.0 Request processed in 102us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857845.585353:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00080000:3.0:1787857845.588961:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857845.599671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.601033:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171759616 00000100:00100000:3.0:1787857845.601051:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171759616 00000100:00100000:3.0:1787857845.601178:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1283 00000100:00100000:3.0:1787857845.601190:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+7:30825:x1874704171759616:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857845.601236:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857845.601464:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+7:30825:x1874704171759616:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 216us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857845.601474:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1283 00000100:00100000:3.0:1787857845.615733:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857845.615878:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171759872 00000100:00100000:1.0:1787857845.615889:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171759872 00000100:00100000:1.0:1787857845.615944:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1284 00000100:00100000:1.0:1787857845.615954:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+7:30825:x1874704171759872:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857845.615976:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857845.615997:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d3b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f71 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857845.616117:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857845.616132:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857845.616143:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857845.616154:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:1.0:1787857845.616291:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5052200/0xd3f183cab4a7d3b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857845.616307:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857845.616316:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:1.0:1787857845.616319:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857845.616323:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:1.0:1787857845.618961:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+9:30825:x1874704171759872:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3001us (3230us total) trans 4294968147 rc 0/0 00000100:00100000:1.0:1787857845.618971:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1284 00000100:00100000:3.0:1787857845.634953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.635065:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171760000 00000100:00100000:3.0:1787857845.635073:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171760000 00000100:00100000:3.0:1787857845.635132:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 352 00000100:00100000:3.0:1787857845.635142:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbe95d23-aca9-4437-bb82-726493375ab7+5:2349:x1874704171760000:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857845.635187:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.635230:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.635240:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857845.635244:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857845.635249:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.635286:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 8 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.635307:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 8 pid: 8490 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857845.635321:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188273152:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857845.635400:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c788f3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787857845.635419:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857845.638268:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188273152:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857845.638301:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857845.638876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.638942:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171760128 00000100:00100000:3.0:1787857845.638948:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171760128 00010000:00010000:3.0:1787857845.638995:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 9 pid: 8490 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857845.639029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 381 00000100:00100000:3.0:1787857845.639039:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171760128:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857845.639055:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857845.639082:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 9 pid: 8490 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639097:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 9 pid: 8490 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639129:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4642b4/0xd3f183cab4a7d325 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f32 expref: 9 pid: 8490 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639145:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857845.639150:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857845.639155:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639166:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639188:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857845.639248:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171760128:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 209us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857845.639256:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 381 00000100:00080000:3.0:1787857845.639278:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787857845.639288:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639297:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639321:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639334:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639342:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639350:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857845.639355:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639363:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639374:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.639380:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857845.639416:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbe95d23-aca9-4437-bb82-726493375ab7+5:2349:x1874704171760000:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 4277us (4475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857845.639421:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 352 00000100:00100000:3.0:1787857845.646101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.646145:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171760384 00000100:00100000:3.0:1787857845.646155:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171760384 00000100:00100000:3.0:1787857845.646222:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1285 00000100:00100000:3.0:1787857845.646233:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+9:30825:x1874704171760384:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857845.647514:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+9:30825:x1874704171760384:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 1277us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857845.647526:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1285 00000100:00100000:3.0:1787857845.656713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.656753:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171760512 00000100:00100000:3.0:1787857845.656764:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171760512 00000100:00100000:3.0:1787857845.656846:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 353 00000100:00100000:3.0:1787857845.656856:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171760512:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857845.656878:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857845.656901:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f78 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857845.656932:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 1048576, mtime: 0x6a908bb3, atime: 0x0, ctime: 0x6a908bb3, blocks: 0x803 00010000:00010000:3.0:1787857845.656956:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1787857845.656961:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857845.656972:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 6 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.656991:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 6 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.657007:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72c00, rc 0) 00000100:00100000:3.0:1787857845.657064:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fbe95d23-aca9-4437-bb82-726493375ab7+6:2350:x1874704171760512:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 209us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857845.657075:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 353 00000040:00080000:2.0:1787857845.657572:0:21534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857845.657579:0:21534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857845.660750:0:21534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 38 count 4 00000040:00080000:2.0:1787857845.660762:0:21534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857845.665077:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.665121:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171760768 00000100:00100000:3.0:1787857845.665134:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171760768 00000100:00100000:3.0:1787857845.665515:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1286 00000100:00100000:3.0:1787857845.665527:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+9:30825:x1874704171760768:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857845.665724:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+9:30825:x1874704171760768:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 200us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857845.665732:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1286 00000100:00100000:3.0:1787857845.694400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.694444:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171760896 00000100:00100000:3.0:1787857845.694457:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171760896 00002000:00100000:3.0:1787857845.694529:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff9998f7018780 x1874704171760896/t0(0) o3->fbe95d23-aca9-4437-bb82-726493375ab7@192.168.204.36@tcp:491/0 lens 488/0 e 0 to 0 dl 1787857856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857845.694542:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7018780 with x1874704171760896 ext(0->1048575) 00002000:00010000:3.0:1787857845.694548:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7018780 00000100:00100000:3.0:1787857845.694576:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 112 00000100:00100000:3.0:1787857845.694586:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fbe95d23-aca9-4437-bb82-726493375ab7+6:2350:x1874704171760896:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000001:00100000:0.0:1787857845.710582:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fbe95d23-aca9-4437-bb82-726493375ab7 00000100:00100000:3.0:1787857845.728092:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fbe95d23-aca9-4437-bb82-726493375ab7+6:2350:x1874704171760896:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 33492us (33689us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787857845.728107:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 112 00002000:00100000:3.0:1787857845.728123:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff9998f7018780 x1874704171760896/t0(0) o3->fbe95d23-aca9-4437-bb82-726493375ab7@192.168.204.36@tcp:491/0 lens 488/440 e 0 to 0 dl 1787857856 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857845.728142:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f7018780 with x1874704171760896 ext(0->1048575) 00002000:00010000:3.0:1787857845.728149:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f7018780 00000100:00100000:3.0:1787857845.762018:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857845.763048:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171761024 00000100:00100000:0.0:1787857845.763060:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171761024 00000100:00100000:0.0:1787857845.763121:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1287 00000100:00100000:0.0:1787857845.763131:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+9:30825:x1874704171761024:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857845.763153:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857845.763176:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7d3d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f7f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.763223:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.763237:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.763250:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.763352:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7d3d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 11 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.763371:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.763379:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:0.0:1787857845.763382:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857845.763385:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857845.763447:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+10:30825:x1874704171761024:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 318us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857845.763454:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1287 00000100:00100000:2.0:1787857845.772308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.772634:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171761152 00000100:00100000:3.0:1787857845.772643:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171761152 00000100:00100000:3.0:1787857845.772713:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1288 00000100:00100000:3.0:1787857845.772724:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:30825:x1874704171761152:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857845.772758:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857845.772924:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:30825:x1874704171761152:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 201us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857845.772932:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1288 00000100:00100000:0.0:1787857845.778556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857845.778682:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171761280 00000100:00100000:2.0:1787857845.778692:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171761280 00000100:00100000:2.0:1787857845.778754:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 354 00000100:00100000:2.0:1787857845.778765:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:2348:x1874704171761280:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857845.778843:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.778863:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857845.778869:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857845.778877:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.778904:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.778945:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.778954:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.778962:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.778970:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857845.778987:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.778996:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.779012:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857845.779019:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031454cc6/0xd3f183cab4a7d3e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857845.779102:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:2348:x1874704171761280:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 339us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857845.779110:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 354 00000100:00100000:0.0:1787857845.782989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.783158:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171761536 00000100:00100000:3.0:1787857845.783170:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171761536 00000100:00100000:3.0:1787857845.783247:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1289 00000100:00100000:3.0:1787857845.783260:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+10:30825:x1874704171761536:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857845.783348:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.783368:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.783377:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.783413:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.783430:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 10 pid: 5858 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857845.783443:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188273280:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857845.783536:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0d18900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857845.788506:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857845.788590:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188273280:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857845.788629:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857845.791081:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171761664 00000100:00100000:0.0:1787857845.791095:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171761664 00010000:00010000:0.0:1787857845.791141:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 11 pid: 5858 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857845.791250:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 382 00000100:00100000:0.0:1787857845.791262:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbe95d23-aca9-4437-bb82-726493375ab7+11:2349:x1874704171761664:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857845.791278:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857845.791285:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 11 pid: 5858 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.791298:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 11 pid: 5858 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.791319:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d3db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f7f expref: 11 pid: 5858 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.791335:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:0.0:1787857845.791340:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.791350:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.791357:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857845.791393:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857845.791455:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:2349:x1874704171761664:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 196us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857845.791463:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 382 00010000:00010000:3.0:1787857845.791533:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.791541:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.791734:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.791741:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.791748:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.791754:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857845.791758:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.791769:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.791779:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:3.0:1787857845.791781:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857845.791785:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857845.791790:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d3e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857845.791946:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+10:30825:x1874704171761536:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 8689us (8967us total) trans 4294968148 rc 0/0 00000100:00100000:3.0:1787857845.791955:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1289 00000040:00080000:3.0:1787857845.792063:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857845.792068:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857845.792579:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787857845.792587:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857845.809345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857845.810028:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171761920 00000100:00100000:1.0:1787857845.810039:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171761920 00000100:00100000:1.0:1787857845.810092:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 258 00000100:00100000:1.0:1787857845.810103:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:30825:x1874704171761920:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857845.810365:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fbe95d23-aca9-4437-bb82-726493375ab7+11:30825:x1874704171761920:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 263us (1029us total) trans 4294968149 rc 0/0 00000100:00100000:1.0:1787857845.810374:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 258 00010000:00010000:1.0:1787857845.998024:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857846.639458:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188273408:0@lo:400:kworker.0 00000100:00100000:1.0:1787857846.639538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857846.639843:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188273792:0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.639892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857846.639958:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188273792 00000100:00100000:3.0:1787857846.639966:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188273792 00000100:00100000:3.0:1787857846.640025:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1787857846.640035:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188273792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.640085:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188273792:12345-0@lo:400:kworker.0 Request processed in 52us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857846.640092:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1787857846.640136:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188273792:0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.640183:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188273536:0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.640227:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857846.640250:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857846.640256:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188273664:0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.640278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857846.640303:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188273536 00000100:00100000:3.0:1787857846.640306:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188273536 00000100:00100000:3.0:1787857846.640333:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188273664 00000100:00100000:3.0:1787857846.640336:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188273664 00000100:00100000:3.0:1787857846.640365:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1787857846.640372:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188273536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.640407:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188273536:12345-0@lo:400:kworker.0 Request processed in 35us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857846.640424:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1787857846.640437:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1787857846.640444:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188273664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.640473:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188273664:12345-0@lo:400:kworker.0 Request processed in 30us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857846.640479:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00080000:3.0:1787857846.640501:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857846.640520:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188273664:0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.640529:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188273536:0@lo:400:kworker.0 00000100:00100000:0.0:1787857846.644206:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188273408 00000100:00100000:0.0:1787857846.644227:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188273408 00000100:00100000:0.0:1787857846.644324:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1787857846.644335:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188273408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857846.645906:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857846.645937:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188274048:0@lo:400:kworker.0 00000100:00100000:2.0:1787857846.645996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857846.646054:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188274048 00000100:00100000:2.0:1787857846.646061:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188274048 00000100:00100000:2.0:1787857846.646118:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1787857846.646126:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188274048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857846.646173:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188274048:12345-0@lo:400:kworker.0 Request processed in 47us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857846.646180:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1787857846.646244:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188274048:0@lo:400:kworker.0 00000100:00080000:2.0:1787857846.646267:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857846.647310:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857846.647327:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188273920:0@lo:400:kworker.0 00000100:00100000:3.0:1787857846.647387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857846.649262:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188273920 00000100:00100000:2.0:1787857846.649277:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188273920 00000100:00100000:2.0:1787857846.649377:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1787857846.649387:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188273920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787857846.649472:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857846.649488:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188273920:12345-0@lo:400:kworker.0 Request processed in 103us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857846.649495:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1787857846.649513:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188273920:0@lo:400:kworker.0 00000100:00100000:0.0:1787857846.652232:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188273408:12345-0@lo:400:kworker.0 Request processed in 7892us (12687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857846.652247:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1787857846.653835:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188273408:0@lo:400:kworker.0 00010000:00010000:1.0:1787857847.022042:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857847.150254:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857847.150279:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188274176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857847.150356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857847.150457:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188274176 00000100:00100000:0.0:1787857847.150466:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188274176 00000100:00100000:3.0:1787857847.150809:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787857847.150845:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188274176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857847.151504:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857847.151573:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188274176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 733us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857847.151581:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787857847.151801:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188274176:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787857847.854143:0:21586:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857847.854945:0:21586:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857847.855018:0:21586:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 38 count 4 00000040:00080000:2.0:1787857847.855025:0:21586:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857847.965259:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857847.965329:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171762048 00000100:00100000:3.0:1787857847.965338:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171762048 00000100:00100000:3.0:1787857847.965404:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 355 00000100:00100000:3.0:1787857847.965414:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171762048:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857847.965432:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857847.965447:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f86 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857847.965473:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787857847.965478:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857847.965488:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 17 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857847.965508:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 17 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857847.965527:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857847.965576:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2348:x1874704171762048:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 164us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857847.965582:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 355 00000100:00080000:2.0:1787857847.965723:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857847.987687:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857847.988335:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171762304 00000100:00100000:3.0:1787857847.988347:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171762304 00000100:00100000:3.0:1787857847.988424:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1290 00000100:00100000:3.0:1787857847.988432:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:30834:x1874704171762304:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857847.988451:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857847.988471:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d3f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f8d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787857847.988477:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857847.988578:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d3fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857847.988594:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d3fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857847.988608:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d3fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857847.988620:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:3.0:1787857847.988754:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d3f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f8d expref: 103 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857847.988770:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d3fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f8d expref: 102 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857847.988784:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:3.0:1787857847.988787:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857847.988790:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72600, rc 0) 00000100:00100000:3.0:1787857847.988878:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+102:30834:x1874704171762304:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 446us (1203us total) trans 4294968150 rc 0/0 00000100:00100000:3.0:1787857847.988886:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1290 00000100:00100000:3.0:1787857847.996550:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857847.996655:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171762432 00000100:00100000:1.0:1787857847.996665:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171762432 00000100:00100000:1.0:1787857847.996726:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 356 00000100:00100000:1.0:1787857847.996738:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171762432:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:1.0:1787857847.996783:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857847.996806:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 5 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857847.996848:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 17 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857847.996857:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857847.996863:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857847.996868:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857847.996910:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 17 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857847.996925:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 17 pid: 6713 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857847.996941:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188274304:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857847.997055:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 5 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857847.997065:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 5 pid: 8490 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857847.997074:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7019a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188274432:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857847.997099:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857848.003453:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7019a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188274432:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857848.007730:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857848.007776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.008010:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b42d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188274304:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857848.008044:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857848.008078:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171762560 00000100:00100000:1.0:1787857848.008084:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171762560 00010000:00010000:1.0:1787857848.008132:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 6 pid: 8490 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857848.008171:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171762688 00000100:00100000:1.0:1787857848.008175:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171762688 00010000:00010000:1.0:1787857848.008189:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 18 pid: 6713 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857848.008211:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 383 00000100:00100000:1.0:1787857848.008220:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+6:2349:x1874704171762560:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857848.008235:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857848.008257:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 6 pid: 8490 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008269:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 6 pid: 8490 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008295:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be2a3fd4/0xd3f183cab4a7d3cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f78 expref: 6 pid: 8490 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008317:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857848.008369:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+5:2349:x1874704171762560:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 148us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857848.008377:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 383 00000100:00100000:1.0:1787857848.008426:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 384 00000100:00100000:1.0:1787857848.008433:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171762688:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857848.008441:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857848.008451:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 18 pid: 6713 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008463:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 18 pid: 6713 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008477:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7d3f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f86 expref: 18 pid: 6713 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008489:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857848.008494:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857848.008499:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008509:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008537:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857848.008558:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171762688:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 126us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857848.008566:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 384 00010000:00010000:1.0:1787857848.008594:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008603:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008628:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008637:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008645:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008652:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857848.008656:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008666:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008683:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.008692:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d40c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857848.008735:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171762432:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 12000us (12197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857848.008744:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 356 00000100:00080000:3.0:1787857848.009295:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857848.017344:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857848.017435:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171762944 00000100:00100000:2.0:1787857848.017444:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171762944 00000100:00100000:2.0:1787857848.017491:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 259 00000100:00100000:2.0:1787857848.017501:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6009450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+102:30834:x1874704171762944:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:2.0:1787857848.017566:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x27:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d3fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f8d expref: 102 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857848.017797:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968151 00000001:00080000:2.0:1787857848.018540:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968152 00010000:00010000:2.0:1787857848.018604:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.018623:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.018632:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 105 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.018640:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.018648:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.018683:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.018698:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 10 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857848.018713:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188274560:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857848.018912:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 105 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.018922:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 105 pid: 19301 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857848.018931:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188274688:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857848.018964:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 47 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.018972:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 47 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857848.018980:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188274816:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857848.019000:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857848.032724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.032750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.032774:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171763072 00000100:00100000:1.0:1787857848.032782:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171763072 00010000:00010000:1.0:1787857848.032847:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 11 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857848.032889:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171763200 00000100:00100000:1.0:1787857848.032893:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171763200 00010000:00010000:1.0:1787857848.032907:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 106 pid: 19301 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857848.032928:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 385 00000100:00100000:1.0:1787857848.032937:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+11:2349:x1874704171763072:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857848.032953:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857848.032961:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 11 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.032973:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 11 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.032996:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:1.0:1787857848.033001:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.033009:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.033016:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857848.033065:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+11:2349:x1874704171763072:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 130us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857848.033073:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 385 00000100:00100000:1.0:1787857848.033089:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 386 00000100:00100000:1.0:1787857848.033096:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+106:2350:x1874704171763200:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857848.033104:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857848.033109:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 106 pid: 19301 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.033118:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 106 pid: 19301 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.033130:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:1.0:1787857848.033134:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.033140:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857848.033145:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857848.033176:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+106:2350:x1874704171763200:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 67us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857848.033183:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 386 00000100:00080000:1.0:1787857848.033202:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857848.033240:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857848.036376:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171763328 00000100:00100000:2.0:1787857848.036398:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171763328 00010000:00010000:0.0:1787857848.036495:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d3b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f71 expref: 10 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857848.036517:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188274560:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857848.036533:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d387 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f4e expref: 105 pid: 19301 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857848.036545:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188274688:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857848.036555:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188274816:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857848.036581:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.037562:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 48 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857848.037610:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 387 00000100:00100000:2.0:1787857848.037624:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171763328:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857848.037641:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857848.037649:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 48 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.037663:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 48 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.037686:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f2b expref: 48 pid: 5858 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.037701:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:2.0:1787857848.037707:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.037717:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.037724:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.037745:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857848.037806:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2349:x1874704171763328:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 186us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857848.037829:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 387 00000100:00080000:2.0:1787857848.038953:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857848.039632:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857848.039646:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857848.039782:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968153 00000001:00080000:0.0:1787857848.040084:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968154 00000001:00080000:0.0:1787857848.040139:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968155 00000100:00100000:0.0:1787857848.042750:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188274944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787857848.042846:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857848.042941:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857848.044002:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188274944 00000100:00100000:2.0:1787857848.044014:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188274944 00000100:00100000:2.0:1787857848.044084:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787857848.044094:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188274944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787857848.044220:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188274944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857848.044229:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787857848.044263:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857848.047888:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188274944:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:1.0:1787857848.049914:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787857848.052125:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968156 00000100:00100000:0.0:1787857848.052254:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c31a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188275072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787857848.052329:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857848.052416:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857848.055803:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188275072 00000100:00100000:2.0:1787857848.055832:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188275072 00000100:00100000:2.0:1787857848.055895:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787857848.055906:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188275072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787857848.056274:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1874704188275072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 369us (3944us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787857848.056283:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787857848.056450:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c31a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188275072:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:2.0:1787857848.056488:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.056498:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.056506:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.056517:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857848.056522:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.056530:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.056549:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:2.0:1787857848.056551:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787857848.056557:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.056565:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d413 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857848.056761:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x4c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787857848.056932:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off8920 00000004:00080000:2.0:1787857848.056944:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 672107126188ns, next at 673107123662ns, rc = 0 00000001:00080000:2.0:1787857848.056951:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968157 00010000:00010000:2.0:1787857848.056990:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12ef300) 00010000:00010000:2.0:1787857848.056993:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787857848.057000:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d3fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f8d expref: 109 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857848.057097:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6009450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:30834:x1874704171762944:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 39597us (39762us total) trans 4294968158 rc 0/0 00000100:00100000:2.0:1787857848.057106:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 259 00000020:00080000:2.0:1787857848.057110:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1787857848.086235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857848.086301:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171763584 00000100:00100000:3.0:1787857848.086310:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171763584 00000100:00100000:3.0:1787857848.086374:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1291 00000100:00100000:3.0:1787857848.086384:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:30837:x1874704171763584:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857848.086407:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857848.086428:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d41a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f94 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857848.086503:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857848.086518:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857848.086529:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857848.086544:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857848.086551:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857848.086557:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087058:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d42f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087081:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d42f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087091:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d42f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857848.087103:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:2.0:1787857848.087215:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087223:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087231:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087238:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857848.087242:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087250:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087263:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:2.0:1787857848.087266:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857848.087271:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087278:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087296:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087302:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087308:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087313:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857848.087315:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087321:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087327:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9998d12ef500) 00010000:00010000:2.0:1787857848.087330:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857848.087333:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087338:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087398:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d41a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f94 expref: 111 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087414:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d42f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f94 expref: 110 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.087426:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:2.0:1787857848.087428:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857848.087430:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75c00, rc 0) 00000100:00100000:2.0:1787857848.087501:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+110:30837:x1874704171763584:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1118us (1276us total) trans 4294968159 rc 0/0 00000100:00100000:2.0:1787857848.087509:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1291 00000100:00100000:1.0:1787857848.095786:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857848.096360:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171763712 00000100:00100000:2.0:1787857848.096372:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171763712 00000100:00100000:2.0:1787857848.096452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1292 00000100:00100000:2.0:1787857848.096464:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+110:30837:x1874704171763712:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:2.0:1787857848.096540:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096559:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096572:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096601:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096608:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096615:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096621:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857848.096627:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096634:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096646:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:2.0:1787857848.096649:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857848.096654:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.096660:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d43d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857848.096745:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+110:30837:x1874704171763712:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 283us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857848.096752:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1292 00000100:00100000:1.0:1787857848.104626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857848.104683:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171763968 00000100:00100000:3.0:1787857848.104695:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171763968 00000100:00100000:3.0:1787857848.104809:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00100000:3.0:1787857848.104860:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+110:30837:x1874704171763968:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1787857848.105154:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+111:30837:x1874704171763968:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 328us (535us total) trans 4294968160 rc 0/0 00000100:00100000:3.0:1787857848.105175:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00100000:2.0:1787857848.294534:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857848.311209:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171764096 00000100:00100000:3.0:1787857848.311226:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171764096 00000100:00100000:3.0:1787857848.317453:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1293 00000100:00100000:3.0:1787857848.317465:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:30804:x1874704171764096:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787857848.317593:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:30804:x1874704171764096:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 130us (23069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857848.317601:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1293 00000100:00100000:1.0:1787857848.334446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857848.334659:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171764352 00000100:00100000:2.0:1787857848.334672:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171764352 00000100:00100000:2.0:1787857848.334754:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 261 00000100:00100000:2.0:1787857848.334766:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:30804:x1874704171764352:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857848.335417:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fbe95d23-aca9-4437-bb82-726493375ab7+11:30804:x1874704171764352:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 651us (985us total) trans 4294968161 rc 0/0 00000100:00100000:2.0:1787857848.335427:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 261 00000100:00100000:1.0:1787857848.555927:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857848.556330:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171764608 00000100:00100000:2.0:1787857848.556348:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171764608 00000100:00100000:2.0:1787857848.556453:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1294 00000100:00100000:2.0:1787857848.556467:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+111:30859:x1874704171764608:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857848.556507:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857848.556602:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d444 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3f9b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857848.557113:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d44b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857848.557136:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d44b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857848.557165:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d44b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857848.557182:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:0.0:1787857848.557462:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f9b expref: 114 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857848.557493:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d44b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f9b expref: 113 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857848.557503:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:0.0:1787857848.557508:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857848.557511:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71e00, rc 0) 00000100:00100000:0.0:1787857848.558358:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:30859:x1874704171764608:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1886us (2441us total) trans 4294968162 rc 0/0 00000100:00100000:0.0:1787857848.558372:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1294 00000100:00100000:1.0:1787857848.570370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.570459:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857848.570895:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171764736 00000100:00100000:2.0:1787857848.570910:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171764736 00000100:00100000:2.0:1787857848.571002:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171764992 00000100:00100000:2.0:1787857848.571005:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171764992 00000100:00100000:2.0:1787857848.571047:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:2.0:1787857848.571061:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+114:2348:x1874704171764736:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857848.571086:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857848.571125:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d44b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f9b expref: 114 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.571164:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:2.0:1787857848.571170:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857848.571250:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+113:2348:x1874704171764736:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 193us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857848.571262:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:0.0:1787857848.571277:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+113:30859:x1874704171764992:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:0.0:1787857848.571289:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857848.571302:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d42f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f94 expref: 113 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857848.571317:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998c3379a00) 00010000:00010000:0.0:1787857848.571327:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857848.571351:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+112:30859:x1874704171764992:12345-192.168.204.36@tcp:103:cat.0 Request processed in 80us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857848.571513:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:0.0:1787857848.571521:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:1.0:1787857848.579364:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857848.585711:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171765120 00000100:00100000:3.0:1787857848.585733:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171765120 00000100:00100000:3.0:1787857848.585937:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1295 00000100:00100000:3.0:1787857848.585952:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:30859:x1874704171765120:12345-192.168.204.36@tcp:58:cat.0 00010000:00010000:3.0:1787857848.586133:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857848.586174:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857848.586190:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857848.586593:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 136 off13360 00000100:00100000:3.0:1787857848.586737:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:30859:x1874704171765120:12345-192.168.204.36@tcp:58:cat.0 Request processed in 785us (7386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857848.586747:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1295 00000100:00100000:3.0:1787857848.594664:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857848.594900:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171765248 00000100:00100000:2.0:1787857848.594915:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171765248 00000100:00100000:2.0:1787857848.595024:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1296 00000100:00100000:2.0:1787857848.595047:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+111:30859:x1874704171765248:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857848.595075:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857848.595114:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d460 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fa2 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.595217:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.595232:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d460 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa2 expref: 112 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.595469:0:19301:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.595487:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d460 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa2 expref: 112 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.595505:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:2.0:1787857848.595509:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857848.595513:0:19301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d460 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa2 expref: 112 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857848.595522:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75000, rc 0) 00000100:00100000:2.0:1787857848.595607:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+112:30859:x1874704171765248:12345-192.168.204.36@tcp:101:cat.0 Request processed in 564us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857848.595753:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1296 00000040:00080000:3.0:1787857848.879575:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857848.879587:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857848.879634:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 5 00000040:00080000:3.0:1787857848.879643:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857848.918013:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.918078:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.918189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.918222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857848.918235:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171765376 00000100:00100000:2.0:1787857848.918249:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171765376 00000100:00100000:0.0:1787857848.918300:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171765888 00000100:00100000:0.0:1787857848.918308:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171765888 00000100:00100000:2.0:1787857848.918331:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 605 00000100:00100000:2.0:1787857848.918347:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:2350:x1874704171765376:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857848.918369:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 469 00000100:00100000:0.0:1787857848.918380:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171765888:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857848.918460:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:2350:x1874704171765376:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 117us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857848.918470:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 605 00000100:00100000:0.0:1787857848.922440:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171765888:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 4040us (4227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857848.922462:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 469 00000100:00100000:3.0:1787857848.922797:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171765632 00000100:00100000:3.0:1787857848.922812:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171765632 00000100:00100000:3.0:1787857848.922903:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171766144 00000100:00100000:3.0:1787857848.922908:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171766144 00000100:00100000:3.0:1787857848.922953:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 479 00000100:00100000:3.0:1787857848.922964:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171765632:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857848.923045:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171765632:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 83us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857848.923053:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 479 00000100:00100000:3.0:1787857848.923071:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00100000:3.0:1787857848.923078:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171766144:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857848.923109:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171766144:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857848.923116:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00080000:3.0:1787857848.923169:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857848.924297:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.924339:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.924364:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857848.924407:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171766400 00000100:00100000:1.0:1787857848.924417:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171766400 00000100:00100000:1.0:1787857848.924470:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171765760 00000100:00100000:1.0:1787857848.924474:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171765760 00000100:00100000:1.0:1787857848.924511:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:1.0:1787857848.924521:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171766400:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857848.924595:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171766400:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 75us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857848.924604:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:0.0:1787857848.924765:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:0.0:1787857848.924779:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171765760:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857848.924827:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171765760:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857848.924836:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:0.0:1787857848.924893:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857848.924910:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171766016 00000100:00100000:0.0:1787857848.924914:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171766016 00000100:00100000:0.0:1787857848.924939:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 483 00000100:00100000:0.0:1787857848.924946:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171766016:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857848.924974:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171766016:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857848.924982:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 483 00000100:00100000:0.0:1787857848.925022:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857848.925054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857848.925068:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171766528 00000100:00100000:0.0:1787857848.925071:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171766528 00000100:00100000:0.0:1787857848.925091:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 484 00000100:00100000:0.0:1787857848.925097:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171766528:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857848.925124:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171766528:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857848.925135:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 484 00000100:00080000:3.0:1787857848.925282:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857848.925289:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857848.925308:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171765504 00000100:00100000:3.0:1787857848.925312:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171765504 00000100:00100000:3.0:1787857848.925360:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171766272 00000100:00100000:3.0:1787857848.925363:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171766272 00000100:00100000:3.0:1787857848.925389:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 470 00000100:00100000:3.0:1787857848.925397:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+112:2350:x1874704171765504:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857848.925430:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+112:2350:x1874704171765504:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857848.925438:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 470 00000100:00100000:3.0:1787857848.925452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 471 00000100:00100000:3.0:1787857848.925459:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+11:2350:x1874704171766272:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857848.925490:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+11:2350:x1874704171766272:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857848.925497:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 471 00010000:00010000:0.0:1787857849.072588:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857849.811905:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968162 is committed 00000020:00080000:1.0:1787857849.811930:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff999900d59cc0 refcount 2 committed 0 result 0 batchid 29 00000020:00080000:1.0:1787857849.811936:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f0ce5000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998db9f1c00 00000020:00080000:1.0:1787857849.811940:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f0ce5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c51ef400 00000001:00080000:1.0:1787857849.811963:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968149 is committed 00000001:00080000:1.0:1787857849.811978:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968161 is committed 00000004:00080000:1.0:1787857849.811987:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000001:00080000:1.0:1787857849.812033:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968146 is committed 00000020:00080000:1.0:1787857849.812048:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 29 committed batchid 28 00000020:00080000:1.0:1787857849.812300:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00000100:00100000:1.0:1787857849.812598:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188275200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787857849.812689:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857849.812785:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188275200 00000100:00100000:1.0:1787857849.812794:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188275200 00000100:00100000:1.0:1787857849.812881:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787857849.812891:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188275200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787857849.812925:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:25 count 1 00002000:00010000:1.0:1787857849.812968:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 1048576, mtime: 0x6a908bb3, atime: 0x0, ctime: 0x6a908bb3, blocks: 0x803 00010000:00010000:1.0:1787857849.812979:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857849.813001:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1787857849.813006:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857849.813015:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857849.813032:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857849.813042:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857849.813050:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857849.813070:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1787857849.822388:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00010000:00010000:2.0:1787857849.822422:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857849.822435:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857849.822452:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857849.822458:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857849.822474:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857849.822516:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857849.822527:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d467 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857849.822560:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857849.822563:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857849.822566:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857849.823350:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188275200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10445us (10646us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1787857849.823366:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787857849.824659:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967366 gen 2 00000004:00080000:3.0:1787857849.824671:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967366 committed transno 4294967366 00000100:00100000:3.0:1787857849.824705:0:3304:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9997c3a230c0 x1874704188275200/t4294967367(4294967367) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787857865 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787857849.824722:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c3a230c0/2, rc 0, transno 4294967367 00000100:00100000:3.0:1787857849.824729:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188275200:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787857850.094096:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857850.229394:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857850.229460:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188275328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857850.229652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857850.230043:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188275328 00000100:00100000:0.0:1787857850.230055:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188275328 00000100:00100000:0.0:1787857850.230176:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787857850.230202:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188275328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857850.230277:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1787857850.230382:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188275328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857850.230391:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787857850.230508:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188275328:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787857850.232572:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787857851.118049:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857851.759346:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188275584:0@lo:400:kworker.0 00000100:00100000:1.0:1787857851.759346:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188275840:0@lo:400:kworker.0 00000100:00100000:3.0:1787857851.759425:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188275456:0@lo:400:kworker.0 00000100:00100000:0.0:1787857851.759443:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188275712:0@lo:400:kworker.0 00000100:00100000:2.0:1787857851.764799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857851.764925:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188276096:0@lo:400:kworker.0 00000100:00100000:2.0:1787857851.764979:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857851.765058:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188275584 00000100:00100000:2.0:1787857851.765067:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188275584 00000100:00100000:2.0:1787857851.765698:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1787857851.765709:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188275584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857851.765779:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188275584:12345-0@lo:400:kworker.0 Request processed in 72us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857851.765787:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1787857851.765868:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188275584:0@lo:400:kworker.0 00000100:00100000:2.0:1787857851.765929:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188276096 00000100:00100000:2.0:1787857851.765933:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188276096 00000100:00100000:2.0:1787857851.765973:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1787857851.765979:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188276096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857851.766017:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188276096:12345-0@lo:400:kworker.0 Request processed in 38us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857851.766024:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00080000:2.0:1787857851.766039:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857851.766061:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188276096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857851.766525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857851.766581:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188275840 00000100:00100000:1.0:1787857851.766586:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188275840 00000100:00100000:3.0:1787857851.766969:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857851.767003:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188275968:0@lo:400:kworker.0 00000100:00100000:3.0:1787857851.767036:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857851.767052:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1787857851.767062:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188275968 00000100:00100000:1.0:1787857851.767065:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188275840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857851.767067:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188275968 00000100:00100000:1.0:1787857851.767136:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188275840:12345-0@lo:400:kworker.0 Request processed in 75us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857851.767145:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1787857851.767186:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188275840:0@lo:400:kworker.0 00000100:00100000:3.0:1787857851.767219:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1787857851.767227:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188275968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857851.767320:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188275968:12345-0@lo:400:kworker.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857851.767327:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1787857851.767337:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188275456 00000100:00100000:1.0:1787857851.767343:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188275456 00000100:00100000:3.0:1787857851.767363:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188275968:0@lo:400:kworker.0 00000100:00100000:1.0:1787857851.767383:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1787857851.767392:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188275456:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787857851.767396:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857851.767437:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188275456:12345-0@lo:400:kworker.0 Request processed in 46us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857851.767445:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1787857851.767458:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188275456:0@lo:400:kworker.0 00000100:00100000:0.0:1787857851.768929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857851.770772:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188275712 00000100:00100000:2.0:1787857851.770789:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188275712 00000100:00100000:2.0:1787857851.770938:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1787857851.770951:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188275712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857851.771104:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188275712:12345-0@lo:400:kworker.0 Request processed in 155us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857851.771112:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00080000:3.0:1787857851.773702:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857851.775346:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188275712:0@lo:400:kworker.0 00010000:00010000:0.0:1787857852.142145:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857852.270642:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857852.270682:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188276224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857852.270856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857852.272530:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188276224 00000100:00100000:3.0:1787857852.272552:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188276224 00000100:00100000:3.0:1787857852.272667:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787857852.272679:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188276224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857852.272747:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857852.275603:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188276224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2902us (4723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857852.275625:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787857852.276277:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188276224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857853.167768:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857853.592798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857853.593000:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171766656 00000100:00100000:2.0:1787857853.593014:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171766656 00000100:00100000:2.0:1787857853.593118:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1297 00000100:00100000:2.0:1787857853.593131:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30861:x1874704171766656:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:2.0:1787857853.593160:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857853.593186:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d46e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fa9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.593283:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.593301:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.593315:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.593332:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.593339:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.593347:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.593738:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.593749:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787857853.593864:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857853.593977:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857853.594032:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:2.0:1787857853.594037:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857853.594072:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594084:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594093:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594101:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594108:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594115:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857853.594120:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594129:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594143:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:2.0:1787857853.594146:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857853.594152:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594159:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594585:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594592:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594598:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594605:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857853.594608:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594614:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594622:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9998c3379800) 00010000:00010000:2.0:1787857853.594625:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857853.594628:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594634:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d47c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594676:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d46e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594690:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.594704:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:2.0:1787857853.594707:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857853.594710:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75600, rc 0) 00000100:00100000:3.0:1787857853.598078:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30861:x1874704171766656:12345-192.168.204.36@tcp:101:stat.0 Request processed in 4922us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857853.598094:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1297 00000100:00100000:2.0:1787857853.929556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857853.929916:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171766784 00000100:00100000:3.0:1787857853.929930:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171766784 00000100:00100000:3.0:1787857853.930128:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1298 00000100:00100000:3.0:1787857853.930140:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+7:30885:x1874704171766784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857853.930170:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857853.930199:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d48a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fb0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857853.930290:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d491 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857853.930308:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857853.930323:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787857853.933783:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787857853.938344:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857853.938358:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857853.938523:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857853.938580:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72000/0xd3f183cab4a7d48a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fb0 expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857853.938628:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fb0 expref: 8 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857853.938640:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:3.0:1787857853.938643:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857853.938649:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73200, rc 0) 00000100:00100000:3.0:1787857853.943465:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+8:30885:x1874704171766784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 13306us (13904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857853.943482:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1298 00000100:00100000:0.0:1787857853.981157:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857853.981345:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171767040 00000100:00100000:2.0:1787857853.981358:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171767040 00000100:00100000:2.0:1787857853.981441:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1299 00000100:00100000:2.0:1787857853.981454:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+8:30886:x1874704171767040:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857853.981483:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857853.981511:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d498 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fb7 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.981631:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.981649:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.981664:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.981683:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.981692:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.981699:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982285:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d4ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982299:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982307:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857853.982319:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787857853.982527:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982536:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982544:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982551:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857853.982556:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982566:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982581:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:2.0:1787857853.982584:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857853.982589:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982601:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d49f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982617:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982624:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982629:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982635:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857853.982638:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982643:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982649:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9998c3379800) 00010000:00010000:2.0:1787857853.982651:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857853.982655:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.982661:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d4a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.983239:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d498 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fb7 expref: 11 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.983259:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fb7 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857853.983268:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857853.983271:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857853.983274:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857853.983357:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+10:30886:x1874704171767040:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1906us (2216us total) trans 4294968163 rc 0/0 00000100:00100000:2.0:1787857853.983367:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1299 00000100:00100000:1.0:1787857853.997418:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857853.997477:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857853.997535:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171767296 00000100:00100000:1.0:1787857853.997547:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171767296 00000100:00100000:1.0:1787857853.997644:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:1.0:1787857853.997657:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+10:2350:x1874704171767296:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857853.997679:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857853.997715:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d4ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fb7 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857853.997739:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857853.997745:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857853.997810:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+9:2350:x1874704171767296:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 156us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857853.997844:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:0.0:1787857853.998795:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171767168 00000100:00100000:0.0:1787857853.998806:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171767168 00000100:00100000:0.0:1787857853.998895:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1300 00000100:00100000:0.0:1787857853.998905:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+9:30886:x1874704171767168:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857853.999037:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+9:30886:x1874704171767168:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 134us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857853.999057:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1300 00000040:00080000:1.0:1787857853.999992:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857854.000001:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857854.004543:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 3 00000040:00080000:0.0:1787857854.004578:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857854.011527:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa82940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188276352:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857854.011953:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857854.023111:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.024703:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa82940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188276352:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857854.029636:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171767424 00000100:00100000:1.0:1787857854.029740:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171767424 00000100:00100000:2.0:1787857854.030273:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1301 00000100:00100000:2.0:1787857854.030287:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+9:30887:x1874704171767424:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857854.030342:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857854.030522:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+9:30887:x1874704171767424:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 237us (7425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.030531:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1301 00000100:00100000:1.0:1787857854.041436:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.041518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.041545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.041565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.041595:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.041612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.041630:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.041677:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171767936 00000100:00100000:2.0:1787857854.041689:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171767936 00000100:00100000:2.0:1787857854.041766:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171768192 00000100:00100000:2.0:1787857854.041769:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171768192 00000100:00100000:2.0:1787857854.041785:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171768448 00000100:00100000:2.0:1787857854.041787:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171768448 00000100:00100000:2.0:1787857854.041801:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171767808 00000100:00100000:2.0:1787857854.041804:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171767808 00000100:00100000:2.0:1787857854.041852:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00100000:2.0:1787857854.041863:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171767936:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857854.041968:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+13:2350:x1874704171767936:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 94us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.041978:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00100000:2.0:1787857854.042013:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 488 00000100:00100000:2.0:1787857854.042022:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171768192:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857854.042061:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171768192:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.042068:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 488 00000100:00100000:2.0:1787857854.042080:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 489 00000100:00100000:2.0:1787857854.042087:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171768448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857854.042112:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171768448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.042118:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 489 00000100:00100000:2.0:1787857854.042129:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 490 00000100:00100000:2.0:1787857854.042135:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171767808:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857854.042155:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171767808:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.042162:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 490 00000100:00080000:2.0:1787857854.042184:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857854.042189:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857854.047282:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.047318:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.047382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.047432:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171768320 00000100:00100000:2.0:1787857854.047445:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171768320 00000100:00100000:2.0:1787857854.047530:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171768576 00000100:00100000:2.0:1787857854.047534:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171768576 00000100:00100000:2.0:1787857854.047559:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 491 00000100:00100000:2.0:1787857854.047570:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171768320:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857854.047687:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171768320:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 118us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.047699:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 491 00000100:00100000:2.0:1787857854.047724:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 492 00000100:00100000:2.0:1787857854.047730:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171768576:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857854.047769:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+5:2350:x1874704171768576:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.047776:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 492 00000100:00080000:2.0:1787857854.047796:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857854.048549:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171767680 00000100:00100000:0.0:1787857854.048557:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171767680 00000100:00100000:0.0:1787857854.048638:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171767552 00000100:00100000:0.0:1787857854.048643:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171767552 00000100:00100000:0.0:1787857854.048689:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 607 00000100:00100000:0.0:1787857854.048698:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:2350:x1874704171767552:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857854.048742:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:2350:x1874704171767552:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 46us (7146us total) trans 0 rc 0/0 00000100:00080000:2.0:1787857854.048920:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857854.048965:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171768064 00000100:00100000:2.0:1787857854.048970:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171768064 00000100:00100000:2.0:1787857854.048998:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 475 00000100:00100000:2.0:1787857854.049016:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+100:2350:x1874704171767680:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857854.049062:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+100:2350:x1874704171767680:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 57us (7640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.049069:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 475 00000100:00100000:2.0:1787857854.049086:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 476 00000100:00100000:2.0:1787857854.049093:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171768064:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857854.049125:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171768064:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (7494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.049131:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 476 00000100:00100000:0.0:1787857854.050256:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 607 00000100:00100000:0.0:1787857854.050715:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171768704 00000100:00100000:0.0:1787857854.050724:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171768704 00000100:00100000:3.0:1787857854.051355:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1302 00000100:00100000:3.0:1787857854.051370:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+9:30887:x1874704171768704:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857854.051465:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.051499:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.051515:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.051536:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.051544:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.051551:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.051578:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.051587:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.051912:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857854.052105:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:3.0:1787857854.052110:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857854.052129:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052143:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052150:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052158:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052166:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.052171:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052180:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052195:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857854.052199:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857854.052205:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052212:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d4bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052229:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052236:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052243:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052248:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.052251:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052258:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052265:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4e3552f8 (ffff9998d12eff00) 00010000:00010000:3.0:1787857854.052268:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857854.052270:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052275:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052292:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052300:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052306:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052312:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.052315:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052320:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.052328:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:3.0:1787857854.052330:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857854.052333:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.053214:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.053353:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+9:30887:x1874704171768704:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 1971us (5955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857854.053364:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1302 00000100:00100000:3.0:1787857854.061907:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.061974:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171768960 00000100:00100000:3.0:1787857854.061987:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171768960 00000100:00100000:3.0:1787857854.062496:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1303 00000100:00100000:3.0:1787857854.062513:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+9:30887:x1874704171768960:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857854.062547:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857854.062572:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d4d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fbe expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.062718:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.062738:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.062753:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857854.062767:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:3.0:1787857854.062952:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.062961:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.062970:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.062977:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.062982:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.062991:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.063006:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:3.0:1787857854.063010:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857854.063017:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.063038:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.063105:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d4d0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fbe expref: 11 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.063117:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857854.063119:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857854.063124:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d4d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fbe expref: 11 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.063136:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857854.063256:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+10:30887:x1874704171768960:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 748us (1364us total) trans 4294968164 rc 301/301 00000100:00100000:3.0:1787857854.063265:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1303 00000100:00100000:3.0:1787857854.072918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.073028:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171769088 00000100:00100000:2.0:1787857854.073042:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171769088 00000100:00100000:2.0:1787857854.073127:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1304 00000100:00100000:2.0:1787857854.073138:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+10:30887:x1874704171769088:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857854.073213:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857854.073351:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+10:30887:x1874704171769088:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 214us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.073359:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1304 00000100:00100000:0.0:1787857854.094854:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.096014:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171769216 00000100:00100000:3.0:1787857854.096030:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171769216 00000100:00100000:3.0:1787857854.096136:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1305 00000100:00100000:3.0:1787857854.096149:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+10:30887:x1874704171769216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857854.096178:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857854.096207:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d4e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fc5 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096334:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096363:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096376:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096396:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096405:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096412:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096977:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096989:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.096998:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857854.097103:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:3.0:1787857854.097109:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857854.097191:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097208:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097220:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097228:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097236:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.097241:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097250:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097265:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:3.0:1787857854.097269:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857854.097275:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097281:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d4ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097296:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097301:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097307:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097313:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.097317:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097324:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097331:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff9998d12eff00) 00010000:00010000:3.0:1787857854.097333:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857854.097336:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097341:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d4f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097382:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d4e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fc5 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097400:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fc5 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.097409:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:3.0:1787857854.097412:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857854.097414:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72600, rc 0) 00000100:00100000:3.0:1787857854.097522:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171769216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1374us (2717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857854.097533:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1305 00000100:00100000:0.0:1787857854.102603:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.102941:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171769344 00000100:00100000:2.0:1787857854.102955:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171769344 00000100:00100000:2.0:1787857854.103057:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:2.0:1787857854.103070:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171769344:12345-192.168.204.36@tcp:700:lhsmtool_posix.0 00000100:00100000:2.0:1787857854.103200:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171769344:12345-192.168.204.36@tcp:700:lhsmtool_posix.0 Request processed in 132us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.103209:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:0.0:1787857854.116950:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.117099:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171769600 00000100:00100000:3.0:1787857854.117112:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171769600 00000100:00100000:3.0:1787857854.117200:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1306 00000100:00100000:3.0:1787857854.117210:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171769600:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857854.117240:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857854.117244:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787857854.117281:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d4fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fc5 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.117306:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:3.0:1787857854.117311:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857854.117327:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d501 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fcc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.125723:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d508 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.125748:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d508 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.125763:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d508 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857854.125778:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00010000:00010000:2.0:1787857854.125929:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d501 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fcc expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.125955:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d508 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fcc expref: 12 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.125967:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.125972:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857854.125976:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74a00, rc 0) 00000100:00100000:2.0:1787857854.126151:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+12:30887:x1874704171769600:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 8940us (9216us total) trans 4294968165 rc 0/0 00000100:00100000:2.0:1787857854.126169:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1306 00000100:00100000:1.0:1787857854.134214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.134331:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171769728 00000100:00100000:2.0:1787857854.134344:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171769728 00000100:00100000:2.0:1787857854.134422:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1307 00000100:00100000:2.0:1787857854.134441:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+12:30887:x1874704171769728:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857854.134474:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857854.134500:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d516 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fd3 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.134600:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.134618:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.134632:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.134647:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.134654:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.134661:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135201:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d52b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135215:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d52b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135225:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d52b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857854.135318:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:2.0:1787857854.135323:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857854.135402:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d52b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135419:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135427:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135434:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135440:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.135446:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135456:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135473:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857854.135477:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857854.135484:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135490:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d51d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135507:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135514:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135521:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135526:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.135528:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135534:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135541:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff9998c3379000) 00010000:00010000:2.0:1787857854.135543:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857854.135546:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135552:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d524 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135604:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d516 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fd3 expref: 14 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135625:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d52b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fd3 expref: 13 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.135633:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:2.0:1787857854.135636:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857854.135639:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75200, rc 0) 00000100:00100000:2.0:1787857854.135729:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+13:30887:x1874704171769728:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1289us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.135739:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1307 00000100:00100000:0.0:1787857854.141332:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.141445:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171769984 00000100:00100000:2.0:1787857854.141458:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171769984 00000100:00100000:2.0:1787857854.141547:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1308 00000100:00100000:2.0:1787857854.141569:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+13:30887:x1874704171769984:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857854.141644:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787857854.141680:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d508 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fcc expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.141706:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.141726:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d52b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fd3 expref: 12 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.141737:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:2.0:1787857854.141741:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857854.141772:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.141794:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.141805:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.141886:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.141904:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 99 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.141921:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188276480:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857854.142053:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990155ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857854.153491:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188276480:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857854.153533:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.155485:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.155978:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171770112 00000100:00100000:3.0:1787857854.155990:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171770112 00010000:00010000:3.0:1787857854.156056:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 100 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.156107:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 388 00000100:00100000:3.0:1787857854.156119:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+100:2350:x1874704171770112:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857854.156140:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857854.156149:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 100 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.156173:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 100 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.156202:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d3a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f63 expref: 100 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.156229:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:3.0:1787857854.156235:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.156246:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.156256:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.156293:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857854.156370:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+99:2350:x1874704171770112:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 252us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857854.156378:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 388 00010000:00010000:0.0:1787857854.157262:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.157275:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.157306:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.157319:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.157329:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161761:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161787:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161797:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161804:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857854.161810:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161836:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161859:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:0.0:1787857854.161863:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857854.161868:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161877:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d532 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161897:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161903:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161909:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161914:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857854.161917:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161923:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161931:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xdf77aa17 (ffff9997c3d03000) 00010000:00010000:0.0:1787857854.161932:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857854.161935:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.161941:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d539 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0xdf77aa17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.162119:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171769984:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 20552us (20795us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857854.162131:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1308 00000100:00100000:0.0:1787857854.170063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.170179:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171770240 00000100:00100000:2.0:1787857854.170191:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171770240 00000100:00100000:2.0:1787857854.170270:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1309 00000100:00100000:2.0:1787857854.170282:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171770240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857854.170307:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857854.170337:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d540 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fda expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.170388:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.170406:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.170420:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.170557:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d540 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.170589:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 12 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.170600:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.170603:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857854.170607:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74a00, rc 0) 00000100:00100000:2.0:1787857854.170682:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+12:30887:x1874704171770240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 404us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.170695:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1309 00000100:00100000:3.0:1787857854.178515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.183646:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171770496 00000100:00100000:0.0:1787857854.183669:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171770496 00000100:00100000:1.0:1787857854.183979:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1310 00000100:00100000:1.0:1787857854.183994:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+12:30887:x1874704171770496:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857854.184124:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.184145:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.184167:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857854.184423:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000850abe99 reply state 000000004475ee30 transno 4294968166 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.184443:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857854.184748:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+14:30887:x1874704171770496:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 755us (6245us total) trans 4294968166 rc 0/0 00000100:00100000:1.0:1787857854.184758:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1310 00010000:00010000:1.0:1787857854.190928:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857854.200567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.200922:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171770624 00000100:00100000:0.0:1787857854.200935:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171770624 00000100:00100000:0.0:1787857854.201017:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1311 00000100:00100000:0.0:1787857854.201030:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+14:30887:x1874704171770624:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857854.201073:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857854.201101:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fe1 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.201193:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 15 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.201211:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 15 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.201222:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:0.0:1787857854.201226:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857854.201230:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70c00, rc 0) 00000100:00100000:0.0:1787857854.201320:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171770624:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 293us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.201328:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1311 00010000:00010000:3.0:1787857854.202174:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.202190:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.202199:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.202205:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5053400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.202211:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.202220:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.202236:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:3.0:1787857854.202239:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857854.202243:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.202250:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053400/0xd3f183cab4a7d54e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.212595:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.213279:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171770752 00000100:00100000:0.0:1787857854.213293:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171770752 00000100:00100000:1.0:1787857854.213642:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00100000:1.0:1787857854.213656:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fbe95d23-aca9-4437-bb82-726493375ab7+14:30887:x1874704171770752:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787857854.213869:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fbe95d23-aca9-4437-bb82-726493375ab7+14:30887:x1874704171770752:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 215us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857854.213878:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00100000:1.0:1787857854.223293:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.223411:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171771008 00000100:00100000:3.0:1787857854.223427:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171771008 00000100:00100000:3.0:1787857854.223531:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 263 00000100:00100000:3.0:1787857854.223547:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+14:30887:x1874704171771008:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857854.223977:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171771008:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 434us (702us total) trans 4294968167 rc 0/0 00000100:00100000:3.0:1787857854.224148:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 263 00000100:00100000:2.0:1787857854.247288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.248374:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171771264 00000100:00100000:0.0:1787857854.248391:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171771264 00000100:00100000:0.0:1787857854.248496:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1312 00000100:00100000:0.0:1787857854.248838:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171771264:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857854.249079:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171771264:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 571us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.249091:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1312 00000100:00100000:2.0:1787857854.256940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.257653:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171771520 00000100:00100000:1.0:1787857854.257668:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171771520 00000100:00100000:1.0:1787857854.257758:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1313 00000100:00100000:1.0:1787857854.257771:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171771520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857854.257798:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857854.257871:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d55c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fe8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.265410:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.265455:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 16 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.265467:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.265523:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 16 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.265546:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 16 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.265565:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188276608:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857854.267571:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990155ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857854.274729:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.274896:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171771648 00000100:00100000:0.0:1787857854.274909:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171771648 00010000:00010000:0.0:1787857854.274964:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 17 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.275147:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 389 00000100:00100000:0.0:1787857854.275257:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbe95d23-aca9-4437-bb82-726493375ab7+17:2350:x1874704171771648:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857854.275277:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857854.275287:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 17 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.275303:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 17 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.275333:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:0.0:1787857854.275339:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.275352:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.275361:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.275385:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857854.275461:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbe95d23-aca9-4437-bb82-726493375ab7+17:2350:x1874704171771648:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 303us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.275473:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 389 00010000:00010000:2.0:1787857854.280331:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d555 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe1 expref: 16 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.280369:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188276608:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857854.280411:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.280424:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.280432:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857854.280463:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00000004:00080000:2.0:1787857854.281032:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:2.0:1787857854.281223:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281233:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281241:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281249:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.281254:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281263:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281284:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.281288:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857854.281294:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281302:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d563 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281373:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d55c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe8 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281386:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:2.0:1787857854.281388:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857854.281392:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053600/0xd3f183cab4a7d55c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fe8 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.281403:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053600, rc 0) 00000100:00100000:2.0:1787857854.281507:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171771520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 23738us (24583us total) trans 4294968168 rc 301/301 00000100:00100000:2.0:1787857854.281518:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1313 00000100:00100000:1.0:1787857854.287686:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.287792:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171771904 00000100:00100000:0.0:1787857854.287807:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171771904 00000100:00100000:0.0:1787857854.287902:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 264 00000100:00100000:0.0:1787857854.287914:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171771904:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857854.288493:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+16:30887:x1874704171771904:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 578us (819us total) trans 4294968169 rc 0/0 00000100:00100000:0.0:1787857854.288503:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 264 00000100:00100000:0.0:1787857854.292107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.292247:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171772032 00000100:00100000:1.0:1787857854.292261:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171772032 00000100:00100000:1.0:1787857854.292361:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1314 00000100:00100000:1.0:1787857854.292374:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+16:30887:x1874704171772032:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857854.292408:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857854.292437:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d571 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3fef expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.292541:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d578 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.292560:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d578 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.292575:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d578 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857854.292999:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00000004:00200000:1.0:1787857854.293006:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857854.293035:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d578 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.293085:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053a00/0xd3f183cab4a7d571 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fef expref: 18 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.293109:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d578 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fef expref: 17 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.293119:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:1.0:1787857854.293122:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787857854.293128:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053000, rc 0) 00000100:00100000:1.0:1787857854.293220:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+17:30887:x1874704171772032:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 848us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857854.294472:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1314 00000100:00100000:0.0:1787857854.296991:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.297399:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171772160 00000100:00100000:1.0:1787857854.297412:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171772160 00000100:00100000:1.0:1787857854.297489:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 358 00000100:00100000:1.0:1787857854.297502:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+5:2349:x1874704171772160:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857854.297525:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857854.297553:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ff6 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857854.297687:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857854.297718:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=678s v=(0 0) 00010000:00010000:1.0:1787857854.297724:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857854.297737:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 6 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.297848:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 6 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.297866:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053400, rc 0) 00000100:00100000:1.0:1787857854.298069:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+6:2349:x1874704171772160:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 568us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857854.298077:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 358 00000100:00100000:3.0:1787857854.302249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.302563:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171772416 00000100:00100000:0.0:1787857854.302577:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171772416 00000100:00100000:0.0:1787857854.302669:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1315 00000100:00100000:0.0:1787857854.302682:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+17:30887:x1874704171772416:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857854.302874:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fbe95d23-aca9-4437-bb82-726493375ab7+17:30887:x1874704171772416:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 195us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.302882:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1315 00000100:00100000:0.0:1787857854.320719:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.320855:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171772544 00000100:00100000:1.0:1787857854.320868:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171772544 00000100:00100000:1.0:1787857854.320939:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 359 00000100:00100000:1.0:1787857854.320952:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:30887:x1874704171772544:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857854.320976:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857854.321000:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd3ffd expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.321055:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 7 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.321067:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857854.321072:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857854.321078:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.321133:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 7 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.321150:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 7 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.321174:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d49e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188276736:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857854.321294:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857854.326084:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.326203:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171772672 00000100:00100000:0.0:1787857854.326214:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171772672 00010000:00010000:0.0:1787857854.326285:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 8 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.326358:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 390 00000100:00100000:0.0:1787857854.326381:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fbe95d23-aca9-4437-bb82-726493375ab7+8:2349:x1874704171772672:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857854.326407:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857854.326438:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 8 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.326454:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 8 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.326489:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857854.326495:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857854.326505:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.326518:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.326571:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.326591:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70443c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188276864:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857854.326704:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857854.331800:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70443c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5841:1874704188276864:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857854.331872:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857854.331940:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fbe95d23-aca9-4437-bb82-726493375ab7+8:2349:x1874704171772672:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5571us (5871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.331955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 390 00010000:00010000:1.0:1787857854.334601:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a4642b4/0xd3f183cab4a7d57f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ff6 expref: 7 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.334646:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d49e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188276736:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857854.334689:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.334710:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c5053a00, rc 0) 00000100:00100000:1.0:1787857854.335021:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:30887:x1874704171772544:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 14069us (14317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857854.335032:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 359 00000100:00100000:3.0:1787857854.356975:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.357388:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171772800 00000100:00100000:2.0:1787857854.357404:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171772800 00002000:00100000:2.0:1787857854.357483:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff9998dacc12c0 x1874704171772800/t0(0) o4->fbe95d23-aca9-4437-bb82-726493375ab7@192.168.204.36@tcp:500/0 lens 488/0 e 0 to 0 dl 1787857865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857854.357497:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dacc12c0 with x1874704171772800 ext(0->1048575) 00002000:00010000:2.0:1787857854.357504:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998dacc12c0 00000100:00100000:2.0:1787857854.357543:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 113 00000100:00100000:2.0:1787857854.357555:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:2347:x1874704171772800:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787857854.422688:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fbe95d23-aca9-4437-bb82-726493375ab7+8:2347:x1874704171772800:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 65118us (65711us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787857854.422708:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 113 00002000:00100000:2.0:1787857854.422731:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff9998dacc12c0 x1874704171772800/t4294967376(0) o4->fbe95d23-aca9-4437-bb82-726493375ab7@192.168.204.36@tcp:500/0 lens 488/448 e 0 to 0 dl 1787857865 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857854.424177:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998dacc12c0 with x1874704171772800 ext(0->1048575) 00002000:00010000:2.0:1787857854.424187:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998dacc12c0 00000100:00100000:0.0:1787857854.427357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.427706:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171772928 00000100:00100000:2.0:1787857854.427720:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171772928 00000100:00100000:2.0:1787857854.427861:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1316 00000100:00100000:2.0:1787857854.427875:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+17:30887:x1874704171772928:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787857854.532009:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968169 is committed 00000020:00080000:0.0:1787857854.532063:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 29 batchid updated 00000020:00080000:1.0:1787857854.532215:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000020:00080000:1.0:1787857854.532231:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000100:00100000:3.0:1787857854.532529:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+10:30887:x1874704171772928:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 104649us (105190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857854.532543:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1316 00000100:00100000:0.0:1787857854.538793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.539464:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171773056 00000100:00100000:2.0:1787857854.539478:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171773056 00000100:00100000:2.0:1787857854.539558:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 360 00000100:00100000:2.0:1787857854.539569:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fbe95d23-aca9-4437-bb82-726493375ab7+8:2348:x1874704171773056:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787857854.612025:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967376 is committed 00000100:00100000:2.0:1787857854.612521:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fbe95d23-aca9-4437-bb82-726493375ab7+6:2348:x1874704171773056:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 72944us (73736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.612536:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 360 00000100:00100000:1.0:1787857854.616640:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.616783:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171773312 00000100:00100000:2.0:1787857854.616797:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171773312 00000100:00100000:2.0:1787857854.616899:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1317 00000100:00100000:2.0:1787857854.616910:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+10:30887:x1874704171773312:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857854.616987:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857854.617026:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c5053000/0xd3f183cab4a7d578 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fef expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.617065:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.617071:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857854.617112:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.617129:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.617139:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857854.617620:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082f0f86c reply state 0000000048b0780f transno 4294968170 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.617634:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857854.617788:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171773312:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 877us (1159us total) trans 4294968170 rc 0/0 00000100:00100000:2.0:1787857854.617797:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1317 00000100:00100000:3.0:1787857854.621441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.621491:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171773440 00000100:00100000:3.0:1787857854.621504:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171773440 00000100:00100000:3.0:1787857854.621581:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1318 00000100:00100000:3.0:1787857854.621594:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171773440:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857854.621631:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857854.621657:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4004 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.621746:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 12 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.621765:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 12 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.621790:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:3.0:1787857854.621794:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857854.621799:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72800, rc 0) 00000100:00100000:3.0:1787857854.621895:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbe95d23-aca9-4437-bb82-726493375ab7+12:30887:x1874704171773440:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 304us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857854.621903:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1318 00000100:00100000:3.0:1787857854.625471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.625653:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171773568 00000100:00100000:1.0:1787857854.625665:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171773568 00000100:00100000:1.0:1787857854.625751:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 361 00000100:00100000:1.0:1787857854.625763:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+6:2348:x1874704171773568:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787857854.626153:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1787857854.626157:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 0 -> 1787857843 00002000:00010000:1.0:1787857854.626160:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb atime from disk: 0 -> 1787857843 00002000:00010000:1.0:1787857854.626163:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 0 -> 1787857843 00002000:00010000:1.0:1787857854.626165:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:1.0:1787857854.626747:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+7:2348:x1874704171773568:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 982us (1286us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787857854.626758:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 361 00010000:00010000:2.0:1787857854.626995:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.627007:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.627015:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.627023:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.627028:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.627050:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.627072:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.627075:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857854.627082:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.627089:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d58d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.631286:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.631493:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171773824 00000100:00100000:3.0:1787857854.631506:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171773824 00000100:00100000:3.0:1787857854.631588:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1319 00000100:00100000:3.0:1787857854.631601:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+11:30887:x1874704171773824:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787857854.631690:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.631711:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 11 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.631727:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.631774:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 11 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.631791:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 11 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.631807:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188276992:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857854.632024:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998db9f1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857854.634670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.634760:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171773952 00000100:00100000:2.0:1787857854.634772:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171773952 00010000:00010000:2.0:1787857854.634860:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 12 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.634903:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 391 00000100:00100000:2.0:1787857854.634915:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fbe95d23-aca9-4437-bb82-726493375ab7+12:2349:x1874704171773952:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857854.634936:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857854.634945:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 12 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.634960:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 12 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.634988:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.634995:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.635006:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.635016:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.635052:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857854.635124:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fbe95d23-aca9-4437-bb82-726493375ab7+12:2349:x1874704171773952:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 211us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.635132:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 391 00010000:00010000:3.0:1787857854.636281:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d547 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fda expref: 11 pid: 5858 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.636307:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188276992:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857854.636334:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636453:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636462:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636503:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636511:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636520:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636527:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.636533:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636541:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636556:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.636560:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787857854.636565:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.636572:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d59b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.636653:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+10:30887:x1874704171773824:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 5053us (5380us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787857854.636665:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1319 00000100:00100000:0.0:1787857854.638230:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.638544:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171774080 00000100:00100000:1.0:1787857854.638556:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171774080 00000100:00100000:1.0:1787857854.638657:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 362 00000100:00100000:1.0:1787857854.638670:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+7:2347:x1874704171774080:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857854.638724:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.638759:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.638771:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857854.638776:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857854.638782:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.638849:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.638865:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 7 pid: 6711 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.638884:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188277120:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857854.638988:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2f509c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857854.641404:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188277120:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857854.641443:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.645377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.645531:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171774208 00000100:00100000:1.0:1787857854.645543:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171774208 00010000:00010000:1.0:1787857854.645610:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 8 pid: 6711 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.645659:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00100000:1.0:1787857854.645671:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+8:2350:x1874704171774208:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857854.645690:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857854.645719:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 8 pid: 6711 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.645741:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 8 pid: 6711 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.645770:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146f230d/0xd3f183cab4a7d586 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ffd expref: 8 pid: 6711 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.645793:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857854.645798:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857854.645806:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.645862:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.645900:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857854.645967:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fbe95d23-aca9-4437-bb82-726493375ab7+7:2350:x1874704171774208:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 298us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857854.645976:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 392 00010000:00010000:0.0:1787857854.647148:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.647166:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.647203:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.647212:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.647221:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.647229:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c5052200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857854.647234:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.647245:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.647265:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.647274:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f11f7c/0xd3f183cab4a7d5a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.647592:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+6:2347:x1874704171774080:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 8918us (9364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.647603:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 362 00000100:00100000:0.0:1787857854.651102:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.651201:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171774464 00000100:00100000:2.0:1787857854.651213:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171774464 00000100:00100000:2.0:1787857854.651289:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1320 00000100:00100000:2.0:1787857854.651311:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+10:30887:x1874704171774464:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857854.651429:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.651450:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.651464:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.651744:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.651757:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 11 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.651767:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.651811:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 11 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.651867:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 11 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.651884:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188277248:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857854.651987:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990155e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857854.656228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.656323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171774592 00000100:00100000:0.0:1787857854.656335:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171774592 00010000:00010000:0.0:1787857854.656402:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 12 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.656453:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00100000:0.0:1787857854.656465:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fbe95d23-aca9-4437-bb82-726493375ab7+12:2350:x1874704171774592:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857854.656486:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857854.656494:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 12 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.656510:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 12 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.656539:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:0.0:1787857854.656547:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.656558:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.656566:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.656589:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857854.656658:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fbe95d23-aca9-4437-bb82-726493375ab7+12:2350:x1874704171774592:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 195us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.656666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 393 00010000:00010000:2.0:1787857854.657564:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d594 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4004 expref: 11 pid: 7656 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.657594:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188277248:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857854.657622:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.657633:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.657640:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857854.658351:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968171 00000001:00080000:2.0:1787857854.658553:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968172 00000001:00080000:2.0:1787857854.658606:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968173 00000100:00100000:2.0:1787857854.658708:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188277376:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787857854.659185:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857854.659232:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990155e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857854.659634:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188277376 00000100:00100000:3.0:1787857854.659642:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188277376 00000100:00100000:3.0:1787857854.659721:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787857854.659740:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188277376:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787857854.659861:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188277376:12345-0@lo:1000:mdt00_002.0 Request processed in 131us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857854.659870:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787857854.660582:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857854.660625:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188277376:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787857854.661252:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968174 00000100:00100000:2.0:1787857854.661447:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188277504:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787857854.661503:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857854.661536:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998dbb7f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857854.661606:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188277504 00000100:00100000:3.0:1787857854.661613:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188277504 00000100:00100000:3.0:1787857854.661702:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787857854.661712:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c71a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188277504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787857854.661953:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c71a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5858:x1874704188277504:12345-0@lo:1000:mdt00_002.0 Request processed in 243us (449us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787857854.661960:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787857854.662495:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188277504:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787857854.662602:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968175 00010000:00010000:2.0:1787857854.662639:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662656:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662665:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662672:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.662678:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662687:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662707:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379800) 00010000:00010000:2.0:1787857854.662710:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857854.662715:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662722:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662758:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662765:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662771:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662776:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.662780:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662786:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662794:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:2.0:1787857854.662797:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857854.662805:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d460 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa2 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662839:0:5858:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d460 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa2 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662849:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d460 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa2 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.662885:0:5858:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75000/0xd3f183cab4a7d460 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa2 expref: 98 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.662900:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188277632:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857854.662987:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a96540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857854.672258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.672383:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188277632:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857854.672421:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.672434:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d459 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.672481:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.672498:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.672510:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.672557:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.672574:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 46 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.672591:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188277760:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857854.672693:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a96540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857854.672974:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171774720 00000100:00100000:0.0:1787857854.672983:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171774720 00000100:00100000:0.0:1787857854.673061:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:0.0:1787857854.673072:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6008050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+99:30859:x1874704171774720:12345-192.168.204.36@tcp:49:cat.0 00000100:00100000:0.0:1787857854.673199:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6008050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+99:30859:x1874704171774720:12345-192.168.204.36@tcp:49:cat.0 Request processed in 128us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.673208:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 265 00000100:00100000:1.0:1787857854.676483:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.676570:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171774848 00000100:00100000:2.0:1787857854.676581:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171774848 00000100:00100000:2.0:1787857854.676651:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 363 00000100:00100000:2.0:1787857854.676662:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+13:30859:x1874704171774848:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857854.676686:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857854.676712:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd400b expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857854.676758:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 1048576, mtime: 0x6a908bb3, atime: 0x6a908bb3, ctime: 0x6a908bb3, blocks: 0x803 00010000:00010000:2.0:1787857854.676785:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=678s v=(0 0) 00010000:00010000:2.0:1787857854.676792:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857854.676804:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 14 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.676869:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 14 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.676885:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857854.676952:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+14:30859:x1874704171774848:12345-192.168.204.36@tcp:101:cat.0 Request processed in 292us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.676960:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 363 00000100:00100000:2.0:1787857854.685972:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188277760:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857854.686017:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.692263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.692407:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.693021:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171774976 00000100:00100000:3.0:1787857854.693046:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171774976 00002000:00100000:3.0:1787857854.693119:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff999901453c00 x1874704171774976/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:500/0 lens 488/0 e 0 to 0 dl 1787857865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857854.693133:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901453c00 with x1874704171774976 ext(0->1048575) 00002000:00010000:3.0:1787857854.693140:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999901453c00 00000100:00100000:3.0:1787857854.693192:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 114 00000100:00100000:3.0:1787857854.693203:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+14:2350:x1874704171774976:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:0.0:1787857854.694043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171775104 00000100:00100000:0.0:1787857854.694052:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171775104 00010000:00010000:0.0:1787857854.694091:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 47 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.694140:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 394 00000100:00100000:0.0:1787857854.694149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d09d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2348:x1874704171775104:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857854.694166:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857854.694176:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 47 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.694192:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 47 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.694223:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fa9 expref: 47 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.694244:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:0.0:1787857854.694250:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.694261:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.694270:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.694312:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857854.694475:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694484:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694499:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694506:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694514:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694526:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.694531:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694540:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694550:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:2.0:1787857854.694553:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857854.694557:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694563:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694575:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694582:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694589:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694594:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.694598:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694603:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694615:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:2.0:1787857854.694618:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857854.694621:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.694627:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857854.695016:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857854.695022:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787857854.695615:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d09d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2348:x1874704171775104:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1460us (3200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.695627:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 394 00000040:00080000:2.0:1787857854.699836:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857854.699865:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857854.700071:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171774464:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 48753us (48974us total) trans 4294968176 rc 0/0 00000100:00100000:2.0:1787857854.700087:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1320 00000020:00080000:2.0:1787857854.700097:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:1.0:1787857854.709932:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.710625:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171775360 00000100:00100000:2.0:1787857854.710640:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171775360 00000100:00100000:2.0:1787857854.710743:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:2.0:1787857854.710754:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+15:30887:x1874704171775360:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787857854.711727:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787857854.711869:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968177 00010000:00010000:2.0:1787857854.711929:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.711950:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.711964:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.711975:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.711982:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.711989:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.712020:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857854.712073:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857854.712084:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.712093:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857854.712097:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.712107:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.712126:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9998c3379000) 00010000:00010000:1.0:1787857854.712131:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857854.712136:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.712142:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5c5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.712164:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857854.712167:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857854.712170:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+17:30887:x1874704171775360:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1413us (2247us total) trans 4294968178 rc 0/0 00010000:00010000:1.0:1787857854.712170:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857854.712183:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 266 00000020:00080000:2.0:1787857854.712190:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787857854.742759:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+14:2350:x1874704171774976:12345-192.168.204.36@tcp:3:cat.0 Request processed in 49530us (50484us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787857854.742776:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 114 00002000:00100000:2.0:1787857854.742794:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff999901453c00 x1874704171774976/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:500/0 lens 488/440 e 0 to 0 dl 1787857865 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857854.742807:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901453c00 with x1874704171774976 ext(0->1048575) 00002000:00010000:2.0:1787857854.742855:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999901453c00 00000100:00100000:0.0:1787857854.760204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.760649:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171775488 00000100:00100000:1.0:1787857854.760665:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171775488 00002000:00100000:1.0:1787857854.760742:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1c:0x0] (1048576->1052671) req@ffff9998f9d0bc00 x1874704171775488/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:500/0 lens 488/0 e 0 to 0 dl 1787857865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857854.760756:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d0bc00 with x1874704171775488 ext(1048576->1052671) 00002000:00010000:1.0:1787857854.760763:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f9d0bc00 00000100:00100000:1.0:1787857854.760802:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 115 00000100:00100000:1.0:1787857854.760812:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:365dae28-8203-4526-83a5-01baf5c55d8b+14:2347:x1874704171775488:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:1.0:1787857854.761736:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:365dae28-8203-4526-83a5-01baf5c55d8b+14:2347:x1874704171775488:12345-192.168.204.36@tcp:3:cat.0 Request processed in 918us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857854.761747:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 115 00002000:00100000:1.0:1787857854.761756:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1c:0x0] (1048576->1052671) req@ffff9998f9d0bc00 x1874704171775488/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:500/0 lens 488/440 e 0 to 0 dl 1787857865 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857854.761767:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d0bc00 with x1874704171775488 ext(1048576->1052671) 00002000:00010000:1.0:1787857854.761773:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f9d0bc00 00000100:00100000:1.0:1787857854.768244:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.768371:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171775744 00000100:00100000:2.0:1787857854.768384:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171775744 00000100:00100000:2.0:1787857854.768458:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 267 00000100:00100000:2.0:1787857854.768470:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+99:30859:x1874704171775744:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:2.0:1787857854.768812:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:30859:x1874704171775744:12345-192.168.204.36@tcp:35:cat.0 Request processed in 343us (582us total) trans 4294968179 rc 0/0 00000100:00100000:2.0:1787857854.768862:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 267 00000100:00100000:3.0:1787857854.789652:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.789885:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171775872 00000100:00100000:0.0:1787857854.789898:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171775872 00000100:00100000:0.0:1787857854.789978:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1321 00000100:00100000:0.0:1787857854.789990:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+100:30888:x1874704171775872:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:0.0:1787857854.790020:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857854.790061:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d5cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4012 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790150:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790166:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790181:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790202:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790210:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790218:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790650:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790661:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.790669:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857854.790713:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:0.0:1787857854.790718:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857854.791208:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.791226:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.791237:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.791244:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.791250:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.791256:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857854.791262:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.791271:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.791285:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:0.0:1787857854.791299:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857854.791306:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.791314:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d5d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792601:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792618:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792628:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792634:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857854.792637:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792645:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792661:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9997c3d03f00) 00010000:00010000:0.0:1787857854.792664:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857854.792669:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792677:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d5da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792952:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d5cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 102 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792974:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 101 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.792983:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:0.0:1787857854.792986:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857854.792989:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71e00, rc 0) 00000100:00100000:0.0:1787857854.793104:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+101:30888:x1874704171775872:12345-192.168.204.36@tcp:101:stat.0 Request processed in 3114us (3464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.793119:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1321 00000100:00100000:1.0:1787857854.810457:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.811028:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171776000 00000100:00100000:2.0:1787857854.811049:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171776000 00000100:00100000:2.0:1787857854.811129:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1322 00000100:00100000:2.0:1787857854.811141:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30889:x1874704171776000:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:2.0:1787857854.811169:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857854.811197:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4019 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811287:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811319:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811344:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811362:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811369:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811377:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811968:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811985:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.811993:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857854.812050:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:2.0:1787857854.812055:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857854.812091:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812106:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812115:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812122:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812130:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812136:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.812141:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812148:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812163:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:2.0:1787857854.812487:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857854.812495:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812502:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d5ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812521:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812528:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812535:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812541:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857854.812544:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812550:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812558:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9998c3379a00) 00010000:00010000:2.0:1787857854.812561:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857854.812565:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812570:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d5f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812617:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d5e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 48 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812633:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.812640:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:2.0:1787857854.812643:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857854.812646:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74600, rc 0) 00000100:00100000:2.0:1787857854.812907:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30889:x1874704171776000:12345-192.168.204.36@tcp:101:stat.0 Request processed in 1765us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.812917:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1322 00000100:00100000:3.0:1787857854.816906:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.817147:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171776128 00000100:00100000:2.0:1787857854.817160:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171776128 00000100:00100000:2.0:1787857854.817249:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 364 00000100:00100000:2.0:1787857854.817260:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171776128:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:2.0:1787857854.817285:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857854.817527:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4020 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.817563:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857854.817568:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857854.817579:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.817602:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.817625:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74a00, rc 0) 00000100:00100000:2.0:1787857854.817705:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171776128:12345-192.168.204.36@tcp:101:stat.0 Request processed in 447us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.817713:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 364 00000100:00100000:3.0:1787857854.835014:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.835088:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171776384 00000100:00100000:3.0:1787857854.835100:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171776384 00000100:00100000:3.0:1787857854.835190:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1323 00000100:00100000:3.0:1787857854.835203:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+101:30596:x1874704171776384:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857854.835232:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857854.835260:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d60b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4027 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.836040:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.836068:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 102 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.836078:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.836089:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.836139:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.836158:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 46 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.836187:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188277888:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857854.839750:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 102 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.839800:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 102 pid: 5857 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.839838:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188278016:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857854.839981:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857854.856767:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.856793:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.856854:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171776512 00000100:00100000:2.0:1787857854.856866:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171776512 00010000:00010000:2.0:1787857854.856926:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 47 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.856979:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171776640 00000100:00100000:2.0:1787857854.856983:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171776640 00010000:00010000:2.0:1787857854.856997:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 103 pid: 5857 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.857019:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 395 00000100:00100000:2.0:1787857854.857050:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171776512:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857854.857070:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857854.857078:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 47 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.858166:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 396 00000100:00100000:3.0:1787857854.858186:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+103:2350:x1874704171776640:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857854.858202:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857854.858212:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 103 pid: 5857 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.858789:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 47 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.860943:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 103 pid: 5857 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.860986:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:3.0:1787857854.860993:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.861003:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.861011:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857854.861480:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+103:2350:x1874704171776640:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3298us (4680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857854.861494:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 396 00000100:00100000:3.0:1787857854.861584:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188277888:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857854.861600:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d5e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4012 expref: 102 pid: 5857 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.861621:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188278016:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857854.861649:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.863801:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d5fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4019 expref: 47 pid: 5856 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.864305:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:2.0:1787857854.864313:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.864326:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.864336:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.864377:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857854.864461:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2350:x1874704171776512:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 7409us (7705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.864473:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 395 00010000:00010000:0.0:1787857854.865509:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.865523:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857854.865551:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:0.0:1787857854.865771:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d60b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 103 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.865794:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.865804:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:0.0:1787857854.865806:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787857854.865810:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72c00, rc 0) 00000100:00100000:0.0:1787857854.865880:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+102:30596:x1874704171776384:12345-192.168.204.36@tcp:101:bash.0 Request processed in 30679us (30883us total) trans 4294968180 rc 0/0 00000100:00100000:0.0:1787857854.865890:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1323 00000100:00100000:1.0:1787857854.879235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.879325:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171776896 00000100:00100000:3.0:1787857854.879401:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171776896 00000100:00100000:3.0:1787857854.879523:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1324 00000100:00100000:3.0:1787857854.879536:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+102:30596:x1874704171776896:12345-192.168.204.36@tcp:36:bash.0 00010000:00010000:3.0:1787857854.879934:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.879955:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.879971:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857854.880045:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968181 00000004:00010000:3.0:1787857854.880074:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037f92d60 reply state 00000000dcf18e33 transno 4294968182 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.880085:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787857854.880132:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968182 00000100:00100000:3.0:1787857854.880255:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:30596:x1874704171776896:12345-192.168.204.36@tcp:36:bash.0 Request processed in 721us (1032us total) trans 4294968183 rc 0/0 00000100:00100000:3.0:1787857854.880263:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1324 00000020:00080000:3.0:1787857854.880269:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787857854.884470:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857854.884532:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.884547:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.884561:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.884568:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.884575:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.884585:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.884607:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:3.0:1787857854.884611:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857854.884616:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.884622:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d620 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.884669:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171777024 00000100:00100000:3.0:1787857854.884680:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171777024 00000100:00100000:3.0:1787857854.885677:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 365 00000100:00100000:3.0:1787857854.885699:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+14:30596:x1874704171777024:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857854.885723:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857854.885919:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c7decbc/0xd3f183cab4a7d627 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd402e expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.885962:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.885980:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.885989:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857854.885995:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857854.886001:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c7decbc/0xd3f183cab4a7d627 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd402e expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.886062:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.886077:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 10 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.886094:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188278144:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857854.886223:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.886232:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 15 pid: 8490 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.886243:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188278272:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857854.886269:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857854.896552:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188278272:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857854.897419:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857854.897491:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171777280 00000100:00100000:1.0:1787857854.897500:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171777280 00010000:00010000:1.0:1787857854.897545:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 11 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.897597:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:1.0:1787857854.897616:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171777280:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857854.897637:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857854.897643:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 11 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.897657:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 11 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857854.897692:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857854.897762:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171777280:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 155us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857854.897770:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 397 00010000:00010000:0.0:1787857854.898062:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff94520/0xd3f183cab4a7d604 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4020 expref: 10 pid: 6713 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.898084:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188278144:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857854.898134:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c7decbc/0xd3f183cab4a7d627 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd402e expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.898158:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72000, rc 0) 00000100:00100000:0.0:1787857854.898580:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:30596:x1874704171777024:12345-192.168.204.36@tcp:101:bash.0 Request processed in 12889us (14124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.898590:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 365 00000100:00100000:3.0:1787857854.903162:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.904001:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171777152 00000100:00100000:0.0:1787857854.904017:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171777152 00010000:00010000:0.0:1787857854.904090:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 15 pid: 8490 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.904145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:0.0:1787857854.904158:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171777152:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857854.904178:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857854.904184:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 15 pid: 8490 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.904201:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 15 pid: 8490 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.904233:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000042fddd9/0xd3f183cab4a7d5be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd400b expref: 15 pid: 8490 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.904255:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857854.904261:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857854.904269:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c7decbc/0xd3f183cab4a7d627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd402e expref: 14 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.904283:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c7decbc/0xd3f183cab4a7d627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd402e expref: 14 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.904511:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006c7decbc/0xd3f183cab4a7d627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd402e expref: 14 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857854.904532:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d08f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874704188278400:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857854.904760:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857854.909727:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.909874:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d08f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5843:1874704188278400:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857854.909908:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857854.909978:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+14:2349:x1874704171777152:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5822us (6831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.909991:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:0.0:1787857854.913062:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171777408 00000100:00100000:0.0:1787857854.913083:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171777408 00002000:00010000:0.0:1787857854.913154:0:6717:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/28 (0->18446744073709551615) 00002000:00100000:0.0:1787857854.913160:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507c000 with x1874704171777408 ext(0->18446744073709551615) 00002000:00010000:0.0:1787857854.913177:0:6717:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c507c000. 00000100:00100000:0.0:1787857854.913228:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 116 00000100:00100000:0.0:1787857854.913239:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+14:2350:x1874704171777408:12345-192.168.204.36@tcp:10:bash.0 00002000:00010000:0.0:1787857854.915530:0:6717:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:0.0:1787857854.915542:0:6717:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 1787857843 -> 1787857854 00002000:00010000:0.0:1787857854.915544:0:6717:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb atime from disk: 1787857843 -> 1787857843 00002000:00010000:0.0:1787857854.915548:0:6717:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 1787857843 -> 1787857854 00002000:00010000:0.0:1787857854.915550:0:6717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:0.0:1787857854.915656:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:2350:x1874704171777408:12345-192.168.204.36@tcp:10:bash.0 Request processed in 2412us (5937us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787857854.915669:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 116 00002000:00010000:0.0:1787857854.915676:0:6717:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/28 (0->18446744073709551615) 00002000:00100000:0.0:1787857854.915679:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507c000 with x1874704171777408 ext(0->18446744073709551615) 00002000:00010000:0.0:1787857854.915690:0:6717:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c507c000. 00000001:00080000:1.0:1787857854.922317:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00000100:00100000:1.0:1787857854.939335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.939432:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171777536 00000100:00100000:3.0:1787857854.939445:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171777536 00000100:00100000:3.0:1787857854.939528:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1325 00000100:00100000:3.0:1787857854.939540:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+105:30890:x1874704171777536:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:3.0:1787857854.939572:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857854.939602:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d62e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4035 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.939773:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.939793:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.940275:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.940372:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.940381:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.940391:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.940982:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.940999:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.941013:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.941144:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.941163:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 106 pid: 19301 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.941181:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188278528:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857854.941360:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857854.951453:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188278528:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857854.951496:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857854.955193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.956179:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171777792 00000100:00100000:2.0:1787857854.956197:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171777792 00000100:00100000:2.0:1787857854.956278:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 268 00000100:00100000:2.0:1787857854.956289:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+107:5603:x1874704171777792:12345-192.168.204.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787857854.957002:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:5603:x1874704171777792:12345-192.168.204.36@tcp:35:ldlm_bl.0 Request processed in 711us (1831us total) trans 4294968184 rc 0/0 00000100:00100000:2.0:1787857854.957011:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 268 00000100:00100000:1.0:1787857854.961207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857854.961944:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171777920 00000100:00100000:2.0:1787857854.961958:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171777920 00010000:00010000:2.0:1787857854.962020:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 108 pid: 19301 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857854.962088:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 399 00000100:00100000:2.0:1787857854.962101:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171777920:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857854.962121:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857854.962129:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 108 pid: 19301 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.962144:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 108 pid: 19301 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.962814:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d612 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4027 expref: 108 pid: 19301 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.962899:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:2.0:1787857854.962906:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.962919:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.962928:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857854.962975:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857854.963067:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+107:2350:x1874704171777920:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 969us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857854.963077:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 399 00010000:00010000:3.0:1787857854.964075:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964090:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857854.964148:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 0 00000004:00200000:3.0:1787857854.964154:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857854.964196:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964223:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964237:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964244:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964252:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964259:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.964264:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964273:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964287:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:3.0:1787857854.964300:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857854.964305:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964312:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d635 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964327:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964333:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964338:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964345:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857854.964348:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964354:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964362:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9998c3379a00) 00010000:00010000:3.0:1787857854.964365:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857854.964368:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964374:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d63c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964422:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d62e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4035 expref: 107 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964439:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75600/0xd3f183cab4a7d643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4035 expref: 106 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857854.964447:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:3.0:1787857854.964450:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857854.964452:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75600, rc 0) 00000100:00100000:3.0:1787857854.964525:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+106:30890:x1874704171777536:12345-192.168.204.36@tcp:101:stat.0 Request processed in 24986us (25206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857854.964534:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1325 00000100:00100000:1.0:1787857854.985796:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857854.985984:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171778048 00000100:00100000:0.0:1787857854.985998:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171778048 00000100:00100000:0.0:1787857854.986097:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1326 00000100:00100000:0.0:1787857854.986108:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:30891:x1874704171778048:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:0.0:1787857854.986135:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857854.986164:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7d64a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd403c expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986253:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986270:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986284:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986316:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986332:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986340:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986763:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7d65f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986774:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7d65f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986782:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7d65f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857854.986860:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 0 00000004:00200000:0.0:1787857854.986865:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857854.986891:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7d65f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986905:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7d65f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986913:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986921:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986928:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986934:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857854.986940:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986950:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986964:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9998e1a0c300) 00010000:00010000:0.0:1787857854.986967:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857854.986973:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986980:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.986996:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987003:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987009:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987014:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857854.987018:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987024:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987046:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff9997c3d03f00) 00010000:00010000:0.0:1787857854.987048:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857854.987051:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987058:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987103:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7d64a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd403c expref: 48 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987118:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70000/0xd3f183cab4a7d65f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd403c expref: 47 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857854.987125:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff9998d12efa00) 00010000:00010000:0.0:1787857854.987127:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857854.987130:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70000, rc 0) 00000100:00100000:0.0:1787857854.987225:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:30891:x1874704171778048:12345-192.168.204.36@tcp:101:stat.0 Request processed in 1117us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857854.987234:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1326 00000100:00100000:1.0:1787857854.992541:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857854.993078:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171778176 00000100:00100000:3.0:1787857854.993092:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171778176 00000100:00100000:3.0:1787857854.993170:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 366 00000100:00100000:3.0:1787857854.993181:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171778176:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:3.0:1787857854.993205:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857854.993239:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7d666 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4043 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857854.993606:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188278656:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857854.993718:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998efae5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857855.013562:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188278656:192.168.204.36@tcp:106: 00010000:00010000:3.0:1787857855.013616:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7d666 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4043 expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857855.013647:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef8a56dd/0xd3f183cab4a7d666 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4043 expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857855.013666:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73e00, rc 0) 00000100:00100000:3.0:1787857855.013766:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171778176:12345-192.168.204.36@tcp:101:stat.0 Request processed in 20586us (21239us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857855.013777:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 366 00010000:00010000:0.0:1787857855.214130:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857855.343489:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857855.343524:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188278784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857855.343630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857855.343803:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188278784 00000100:00100000:3.0:1787857855.343814:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188278784 00000100:00100000:3.0:1787857855.343929:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787857855.343941:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ef917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188278784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857855.343991:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857855.344066:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ef917050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188278784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857855.344075:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:2.0:1787857855.345339:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857855.345539:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:1.0:1787857855.345547:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c3a230c0, transno 4294967367 00000100:00100000:1.0:1787857855.345592:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188278784:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857856.239186:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857856.879087:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188278912:0@lo:400:kworker.0 00000100:00100000:2.0:1787857856.879094:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188279040:0@lo:400:kworker.0 00000100:00100000:3.0:1787857856.893018:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188279296:0@lo:400:kworker.0 00000100:00100000:3.0:1787857856.893129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857856.893234:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857856.893243:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188279168:0@lo:400:kworker.0 00000100:00100000:3.0:1787857856.893290:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188279296 00000100:00100000:3.0:1787857856.893299:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188279296 00000100:00100000:3.0:1787857856.893360:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1787857856.893371:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188279296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857856.893448:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188279296:12345-0@lo:400:kworker.0 Request processed in 79us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857856.893457:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1787857856.893679:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857856.893716:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188279552:0@lo:400:kworker.0 00000100:00100000:2.0:1787857856.893749:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857856.893777:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188279552 00000100:00100000:2.0:1787857856.893781:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188279552 00000100:00100000:2.0:1787857856.893864:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1787857856.893871:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188279552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857856.893908:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188279552:12345-0@lo:400:kworker.0 Request processed in 38us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857856.893915:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00080000:2.0:1787857856.893938:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857856.893985:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188279552:0@lo:400:kworker.0 00000100:00100000:1.0:1787857856.894332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857856.894378:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188279424:0@lo:400:kworker.0 00000100:00100000:1.0:1787857856.894411:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857856.894809:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188278912 00000100:00100000:2.0:1787857856.894849:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188278912 00000100:00100000:2.0:1787857856.894890:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1787857856.895030:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188279040 00000100:00100000:1.0:1787857856.895035:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188279040 00000100:00100000:1.0:1787857856.895074:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188279424 00000100:00100000:1.0:1787857856.895078:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188279424 00000100:00100000:2.0:1787857856.895384:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188278912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857856.895455:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188278912:12345-0@lo:400:kworker.0 Request processed in 556us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857856.895475:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1787857856.895526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857856.914008:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188279296:0@lo:400:kworker.0 00000100:00080000:2.0:1787857856.915032:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857856.916657:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188279168 00000100:00100000:1.0:1787857856.916675:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188279168 00000100:00100000:1.0:1787857856.916796:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1787857856.916809:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188279040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857856.917111:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188279040:12345-0@lo:400:kworker.0 Request processed in 304us (27280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857856.917119:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1787857856.917142:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1787857856.917150:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188279424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857856.917261:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188279424:12345-0@lo:400:kworker.0 Request processed in 111us (22847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857856.917268:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1787857856.917287:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1787857856.917296:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188279168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857856.917407:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188279168:12345-0@lo:400:kworker.0 Request processed in 113us (21881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857856.917414:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00080000:1.0:1787857856.917437:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857856.926085:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188278912:0@lo:400:kworker.0 00000100:00100000:0.0:1787857856.926119:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188279424:0@lo:400:kworker.0 00000100:00100000:3.0:1787857856.930432:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188279168:0@lo:400:kworker.0 00000100:00100000:2.0:1787857856.935516:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188279040:0@lo:400:kworker.0 00010000:00010000:1.0:1787857857.263237:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857857.393149:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188279680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857857.393262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857857.393854:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188279680 00000100:00100000:0.0:1787857857.393866:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188279680 00000100:00100000:0.0:1787857857.393949:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787857857.393961:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188279680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857857.394019:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1787857857.394093:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188279680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857857.394104:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787857857.394178:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188279680:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857858.293677:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857859.155778:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857859.155869:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857859.155903:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857859.155924:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857859.155968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857859.155991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857859.155994:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171778816 00000100:00100000:0.0:1787857859.156005:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171778816 00000100:00100000:1.0:1787857859.156018:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857859.156039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857859.156063:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857859.156075:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171778432 00000100:00100000:0.0:1787857859.156080:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171778432 00000100:00100000:1.0:1787857859.156097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857859.156109:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171779200 00000100:00100000:0.0:1787857859.156114:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171779200 00000100:00100000:1.0:1787857859.156125:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00100000:1.0:1787857859.156138:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2347:x1874704171778816:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857859.156177:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171778304 00000100:00100000:2.0:1787857859.156182:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171778304 00000100:00100000:2.0:1787857859.156215:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 609 00000100:00100000:2.0:1787857859.156223:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:2347:x1874704171778304:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857859.156232:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2347:x1874704171778816:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 95us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857859.156255:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:2347:x1874704171778304:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857859.156263:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 609 00000100:00100000:3.0:1787857859.156289:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171778560 00000100:00100000:3.0:1787857859.156294:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171778560 00000100:00100000:2.0:1787857859.156319:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171779072 00000100:00100000:2.0:1787857859.156325:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171779072 00000100:00100000:3.0:1787857859.156326:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171779328 00000100:00100000:3.0:1787857859.156331:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171779328 00000100:00100000:2.0:1787857859.156350:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171778688 00000100:00100000:3.0:1787857859.156355:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171778944 00000100:00100000:2.0:1787857859.156356:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171778688 00000100:00100000:3.0:1787857859.156361:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171778944 00000100:00100000:2.0:1787857859.156380:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171779456 00000100:00100000:2.0:1787857859.156384:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171779456 00000100:00100000:3.0:1787857859.156392:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 495 00000100:00100000:3.0:1787857859.156404:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171778560:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857859.156410:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 496 00000100:00100000:3.0:1787857859.156433:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171778560:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857859.156577:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171779072:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857859.156605:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171779072:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857859.156674:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:0.0:1787857859.156683:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:2347:x1874704171778432:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857859.156713:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:2347:x1874704171778432:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857859.156719:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:0.0:1787857859.156736:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:0.0:1787857859.156742:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+17:2347:x1874704171779200:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857859.156766:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+17:2347:x1874704171779200:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857859.156772:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00080000:0.0:1787857859.156808:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857859.156813:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857859.156836:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857859.157483:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 495 00000100:00100000:3.0:1787857859.157506:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 497 00000100:00100000:3.0:1787857859.157516:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbe95d23-aca9-4437-bb82-726493375ab7+5:2347:x1874704171779328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857859.157551:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbe95d23-aca9-4437-bb82-726493375ab7+5:2347:x1874704171779328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857859.157557:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 497 00000100:00100000:3.0:1787857859.157569:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 498 00000100:00100000:3.0:1787857859.157576:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171778688:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857859.157601:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171778688:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857859.157608:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 498 00000100:00100000:3.0:1787857859.157620:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 499 00000100:00100000:3.0:1787857859.157626:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171778944:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857859.157869:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00100000:1.0:1787857859.157932:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 500 00000100:00100000:3.0:1787857859.158355:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171778944:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857859.158364:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 499 00000100:00100000:1.0:1787857859.159509:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fbe95d23-aca9-4437-bb82-726493375ab7+6:2347:x1874704171779456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857859.160076:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fbe95d23-aca9-4437-bb82-726493375ab7+6:2347:x1874704171779456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 2136us (3977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857859.160086:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 500 00000100:00100000:2.0:1787857859.168569:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 496 00010000:00010000:0.0:1787857859.310063:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787857859.497136:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968180 is committed 00000001:00080000:3.0:1787857859.497156:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968184 is committed 00000001:00080000:3.0:1787857859.497163:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968178 is committed 00000020:00080000:3.0:1787857859.497175:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99990155e900 refcount 2 committed 0 result 0 batchid 30 00000020:00080000:3.0:1787857859.497181:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f728bc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99990155ec00 00000020:00080000:3.0:1787857859.497185:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998f728b700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998dadd6000 00000020:00080000:1.0:1787857859.497323:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30 committed batchid 29 00000020:00080000:1.0:1787857859.497573:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000001:00080000:0.0:1787857860.069488:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967379 is committed 00000001:00080000:0.0:1787857860.069556:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967377 is committed 00000001:00080000:0.0:1787857860.069567:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967378 is committed 00010000:00010000:2.0:1787857860.334360:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857860.463059:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188279808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857860.463136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857860.463232:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188279808 00000100:00100000:3.0:1787857860.463242:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188279808 00000100:00100000:3.0:1787857860.463309:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787857860.463320:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188279808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857860.463357:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857860.463402:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188279808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857860.463409:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1787857860.463431:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857860.463473:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188279808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857861.358030:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857861.402386:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857861.404600:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171779584 00000100:00100000:0.0:1787857861.404624:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171779584 00000100:00080000:3.0:1787857861.404850:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857861.405022:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1327 00000100:00100000:0.0:1787857861.405039:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+8:30886:x1874704171779584:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787857861.405191:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbe95d23-aca9-4437-bb82-726493375ab7+8:30886:x1874704171779584:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 160us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857861.405199:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1327 00000100:00100000:2.0:1787857861.430326:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857861.430544:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171779840 00000100:00100000:0.0:1787857861.430555:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171779840 00000100:00100000:0.0:1787857861.430617:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 269 00000100:00100000:0.0:1787857861.430627:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+8:30886:x1874704171779840:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857861.431612:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbe95d23-aca9-4437-bb82-726493375ab7+9:30886:x1874704171779840:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 981us (1292us total) trans 4294968185 rc 0/0 00000100:00100000:0.0:1787857861.431622:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 269 00000100:00100000:3.0:1787857862.001550:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188280320:0@lo:400:kworker.0 00000100:00100000:3.0:1787857862.001627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857862.001693:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857862.001699:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188280192:0@lo:400:kworker.0 00000100:00100000:2.0:1787857862.001738:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188280064:0@lo:400:kworker.0 00000100:00100000:3.0:1787857862.001748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857862.001770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857862.001785:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188280320 00000100:00100000:2.0:1787857862.001786:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188280576:0@lo:400:kworker.0 00000100:00100000:3.0:1787857862.001792:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188280320 00000100:00100000:2.0:1787857862.001835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857862.001854:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787857862.001859:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188279936:0@lo:400:kworker.0 00000100:00100000:3.0:1787857862.001863:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188280576 00000100:00100000:3.0:1787857862.001866:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188280576 00000100:00100000:2.0:1787857862.001890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857862.001902:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1787857862.001912:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188280320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857862.001922:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188280448:0@lo:400:kworker.0 00000100:00100000:2.0:1787857862.001943:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857862.001970:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188280320:12345-0@lo:400:kworker.0 Request processed in 60us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857862.001970:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1787857862.001977:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1787857862.001977:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188280576:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787857862.001998:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857862.002002:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857862.002028:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188280320:0@lo:400:kworker.0 00000100:00100000:2.0:1787857862.002028:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188280576:12345-0@lo:400:kworker.0 Request processed in 33us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857862.002035:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1787857862.002054:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188279936 00000100:00100000:3.0:1787857862.002070:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967378 gen 2 00000100:00100000:2.0:1787857862.002070:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188279936 00000004:00080000:3.0:1787857862.002075:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967378 committed transno 4294967378 00000100:00100000:3.0:1787857862.002090:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188280576:0@lo:400:kworker.0 00000100:00100000:2.0:1787857862.002094:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1787857862.002099:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188279936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857862.002135:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188279936:12345-0@lo:400:kworker.0 Request processed in 35us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857862.002141:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1787857862.002160:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188279936:0@lo:400:kworker.0 00000100:00100000:0.0:1787857862.002244:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188280192 00000100:00100000:0.0:1787857862.002249:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188280192 00000100:00100000:0.0:1787857862.002295:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188280064 00000100:00100000:0.0:1787857862.002299:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188280064 00000100:00100000:0.0:1787857862.002317:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188280448 00000100:00100000:0.0:1787857862.002320:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188280448 00000100:00100000:0.0:1787857862.002334:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1787857862.002340:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188280192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857862.002379:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188280192:12345-0@lo:400:kworker.0 Request processed in 38us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857862.002385:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1787857862.002400:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1787857862.002405:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188280064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857862.002436:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188280064:12345-0@lo:400:kworker.0 Request processed in 31us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857862.002442:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1787857862.002452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1787857862.002458:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188280448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857862.002482:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188280448:12345-0@lo:400:kworker.0 Request processed in 25us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857862.002488:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00080000:3.0:1787857862.005588:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857862.006013:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188280192:0@lo:400:kworker.0 00000100:00100000:3.0:1787857862.006066:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188280448:0@lo:400:kworker.0 00000100:00100000:3.0:1787857862.006080:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188280064:0@lo:400:kworker.0 00010000:00010000:2.0:1787857862.382760:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857862.511061:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188280704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857862.511164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857862.511471:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188280704 00000100:00100000:3.0:1787857862.511481:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188280704 00000100:00100000:3.0:1787857862.511536:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787857862.511546:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188280704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857862.511584:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857862.511643:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188280704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857862.511650:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787857862.511801:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188280704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857863.407970:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857863.713366:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857863.713512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857863.713569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857863.713632:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171779968 00000100:00100000:1.0:1787857863.713653:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171779968 00000100:00100000:1.0:1787857863.713749:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 367 00000100:00100000:1.0:1787857863.713761:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+5:2346:x1874704171779968:12345-192.168.204.36@tcp:9:umount.0 00000020:00000080:1.0:1787857863.713796:0:6713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd3f183cab4a7d23e 00000100:00080000:1.0:1787857863.713836:0:6713:0:(import.c:65:import_set_state_nolock()) ffff9998ffab5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787857863.713892:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967379 00000100:00100000:1.0:1787857863.714234:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbe95d23-aca9-4437-bb82-726493375ab7+2:2346:x1874704171779968:12345-192.168.204.36@tcp:9:umount.0 Request processed in 475us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857863.714244:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 367 00010000:00010000:1.0:1787857863.714285:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787857863.716691:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857863.718889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857863.719274:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171780224 00000100:00100000:0.0:1787857863.719285:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171780224 00000100:00100000:0.0:1787857863.719358:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171780352 00000100:00100000:0.0:1787857863.719361:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171780352 00000100:00100000:0.0:1787857863.719388:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:0.0:1787857863.719400:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+17:2350:x1874704171780224:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857863.719427:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857863.719449:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998efa71600/0xd3f183cab4a7d222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ec2 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857863.719469:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857863.719525:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:2350:x1874704171780224:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 128us (6169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857863.719533:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:1.0:1787857863.719757:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:1.0:1787857863.719770:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a844d87e-58d2-455f-ad2c-5bf80fe2767e+16:2348:x1874704171780352:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857863.719779:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857863.719791:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9998efa75e00/0xd3f183cab4a7d229 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3ec9 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857863.719802:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857863.719877:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a844d87e-58d2-455f-ad2c-5bf80fe2767e+15:2348:x1874704171780352:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 112us (6306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857863.719884:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:3.0:1787857863.721394:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171780096 00000100:00100000:3.0:1787857863.721419:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171780096 00000100:00100000:0.0:1787857863.721541:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:0.0:1787857863.722035:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a844d87e-58d2-455f-ad2c-5bf80fe2767e+14:2347:x1874704171780096:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857863.722055:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857863.722076:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9997c5052000/0xd3f183cab4a7d21b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3e98 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857863.722093:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857863.722205:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171780096:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 653us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857863.722213:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:1.0:1787857863.739027:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857863.742795:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171780480 00000100:00100000:2.0:1787857863.742813:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171780480 00000100:00100000:2.0:1787857863.742930:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 368 00000100:00100000:2.0:1787857863.742943:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+5:2346:x1874704171780480:12345-192.168.204.36@tcp:9:umount.0 00000100:00080000:3.0:1787857863.742969:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1787857863.742973:0:6711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd3f183cab4a7d237 00000100:00080000:2.0:1787857863.742983:0:6711:0:(import.c:65:import_set_state_nolock()) ffff9997c5a63800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787857863.743066:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787857863.743104:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967367 00000100:00100000:2.0:1787857863.743593:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbe95d23-aca9-4437-bb82-726493375ab7+2:2346:x1874704171780480:12345-192.168.204.36@tcp:9:umount.0 Request processed in 652us (4575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857863.743602:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 368 00000100:00100000:2.0:1787857863.755364:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857863.755475:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171780992 00000100:00100000:0.0:1787857863.755485:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171780992 00000100:00100000:0.0:1787857863.755576:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1328 00000100:00100000:0.0:1787857863.755587:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+9:2346:x1874704171780992:12345-192.168.204.36@tcp:39:umount.0 00000020:00000080:0.0:1787857863.755621:0:5856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd3f183cab4a7d230 00000020:00010000:0.0:1787857863.755649:0:5856:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9998ffab0000: total 0 00000100:00080000:0.0:1787857863.755655:0:5856:0:(import.c:65:import_set_state_nolock()) ffff9998ffab6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787857863.755685:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968185 00000100:00100000:0.0:1787857863.756071:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbe95d23-aca9-4437-bb82-726493375ab7+8:2346:x1874704171780992:12345-192.168.204.36@tcp:39:umount.0 Request processed in 485us (716us total) trans 4294968186 rc 0/0 00000100:00100000:0.0:1787857863.756080:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1328 00000100:00080000:3.0:1787857863.756714:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1787857863.757364:0:5844:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9998ffab0000: total 0 00010000:00010000:2.0:1787857863.757431:0:5844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9998ffab0000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1787857863.757467:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857863.757472:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857863.757483:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d284 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f01 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857863.757506:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857863.757509:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857863.757513:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d491 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3fb0 expref: 6 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857863.757529:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:2.0:1787857863.757531:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857863.757535:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d268 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3efa expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857863.757547:0:5844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9998ffab0000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1787857863.757558:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857863.757560:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857863.757562:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857863.918217:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857863.918227:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857863.918580:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 2 00000040:00080000:0.0:1787857863.918588:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857864.276929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857864.276985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857864.277016:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857864.277051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857864.277076:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857864.277103:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857864.277133:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171781248 00000100:00100000:1.0:1787857864.277144:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171781248 00000100:00100000:2.0:1787857864.277284:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171781760 00000100:00100000:2.0:1787857864.277288:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171781760 00000100:00100000:2.0:1787857864.277327:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171781376 00000100:00100000:2.0:1787857864.277330:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171781376 00000100:00100000:2.0:1787857864.277345:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171781632 00000100:00100000:2.0:1787857864.277348:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171781632 00000100:00100000:2.0:1787857864.277373:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 503 00000100:00100000:2.0:1787857864.277383:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171781760:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857864.277463:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171781760:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 80us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857864.277470:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 503 00000100:00100000:2.0:1787857864.277489:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 504 00000100:00100000:2.0:1787857864.277496:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171781376:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857864.277522:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+14:2348:x1874704171781376:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857864.277528:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 504 00000100:00100000:2.0:1787857864.277539:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 505 00000100:00100000:2.0:1787857864.277545:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171781632:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857864.277585:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171781632:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857864.277592:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 505 00000100:00100000:2.0:1787857864.277612:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171781504 00000100:00100000:2.0:1787857864.277615:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171781504 00000100:00100000:2.0:1787857864.277644:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171781120 00000100:00100000:2.0:1787857864.277647:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171781120 00000100:00100000:2.0:1787857864.277666:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 486 00000100:00100000:2.0:1787857864.277672:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2348:x1874704171781504:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857864.277703:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2348:x1874704171781504:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857864.277709:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 486 00000100:00100000:2.0:1787857864.277720:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00100000:2.0:1787857864.277725:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+100:2348:x1874704171781120:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857864.277747:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+100:2348:x1874704171781120:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857864.277753:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00080000:3.0:1787857864.278331:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857864.278337:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857864.278339:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857864.278486:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 506 00000100:00100000:1.0:1787857864.278496:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171781248:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857864.278537:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171781248:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 45us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857864.278543:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 506 00010000:00010000:0.0:1787857864.430298:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787857864.674290:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fbe95d23-aca9-4437-bb82-726493375ab7 00000001:00080000:3.0:1787857864.674305:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968186 is committed 00000020:00000080:3.0:1787857864.674315:0:5879:0:(genops.c:885:class_export_put()) final put ffff9998ffab0000/fbe95d23-aca9-4437-bb82-726493375ab7 00000020:00080000:3.0:1787857864.674340:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30 batchid updated 00000020:00000080:0.0:1787857864.674405:0:472:0:(genops.c:844:class_export_destroy()) destroying export ffff9998ffab0000/fbe95d23-aca9-4437-bb82-726493375ab7 for lustre-MDT0000 00000020:00000080:0.0:1787857864.674486:0:472:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9998ffab6000 for lustre-MDT0000 00000020:00080000:2.0:1787857864.675783:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000020:00080000:2.0:1787857864.675800:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000001:00100000:0.0:1787857865.129847:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fbe95d23-aca9-4437-bb82-726493375ab7 00000020:00000080:0.0:1787857865.129857:0:6737:0:(genops.c:885:class_export_put()) final put ffff9997c5a63000/fbe95d23-aca9-4437-bb82-726493375ab7 00000020:00000080:0.0:1787857865.129887:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9997c5a63000/fbe95d23-aca9-4437-bb82-726493375ab7 for lustre-OST0000 00000020:00000080:0.0:1787857865.129933:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9997c5a63800 for lustre-OST0000 00000001:00100000:0.0:1787857865.146314:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fbe95d23-aca9-4437-bb82-726493375ab7 00000020:00000080:0.0:1787857865.146324:0:7659:0:(genops.c:885:class_export_put()) final put ffff9998ffab7000/fbe95d23-aca9-4437-bb82-726493375ab7 00000020:00000080:0.0:1787857865.146359:0:472:0:(genops.c:844:class_export_destroy()) destroying export ffff9998ffab7000/fbe95d23-aca9-4437-bb82-726493375ab7 for lustre-OST0001 00000020:00000080:0.0:1787857865.146411:0:472:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9998ffab5800 for lustre-OST0001 00010000:00010000:1.0:1787857865.454925:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857865.523942:0:21795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12r: lseek restores released file ===== 15:11:03 (1787857863) 00000100:00100000:2.0:1787857865.583650:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188280832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857865.583748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857865.584131:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188280832 00000100:00100000:3.0:1787857865.584143:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188280832 00000100:00100000:3.0:1787857865.584218:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787857865.584229:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188280832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857865.584277:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857865.584339:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188280832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857865.584346:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787857865.584411:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188280832:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787857865.585118:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857866.075243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857866.075389:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171781888 00000100:00100000:1.0:1787857866.075399:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171781888 00000100:00100000:1.0:1787857866.075483:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1329 00000100:00100000:1.0:1787857866.075494:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:31523:x1874704171781888:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787857866.075610:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:31523:x1874704171781888:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 119us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857866.075618:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1329 00000100:00080000:2.0:1787857866.076955:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857866.095601:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857866.095858:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171782016 00000100:00100000:2.0:1787857866.095871:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171782016 00000100:00100000:2.0:1787857866.095966:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1330 00000100:00100000:2.0:1787857866.095978:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+100:31524:x1874704171782016:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857866.096004:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857866.096078:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d66d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd404a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.096166:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.096183:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.096866:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.096888:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.096897:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.096903:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097422:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097433:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097440:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097446:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.097451:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097459:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097471:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857866.097475:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.097480:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097487:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097501:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097518:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097525:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097530:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.097532:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097538:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097545:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff9998c3379d00) 00010000:00010000:2.0:1787857866.097548:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.097551:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.097556:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d67b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787857866.097870:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857866.098341:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d66d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd404a expref: 101 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.098359:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857866.098362:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.098366:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d66d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd404a expref: 101 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.098374:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75e00, rc 0) 00000100:00100000:2.0:1787857866.098451:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+100:31524:x1874704171782016:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2476us (2862us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857866.098460:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1330 00000100:00100000:0.0:1787857866.105556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857866.105659:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171782272 00000100:00100000:2.0:1787857866.105680:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171782272 00000100:00100000:2.0:1787857866.105751:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1331 00000100:00100000:2.0:1787857866.105761:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+100:31524:x1874704171782272:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:2.0:1787857866.105892:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857866.105930:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d34f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f40 expref: 100 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.105954:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857866.105959:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857866.107141:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.107164:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.107172:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.107363:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.107381:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 46 pid: 5858 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857866.107397:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188280960:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857866.107559:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998da1d0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857866.117860:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188280960:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857866.117898:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857866.126317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857866.126617:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171782400 00000100:00100000:1.0:1787857866.126627:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171782400 00010000:00010000:1.0:1787857866.126672:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 47 pid: 5858 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857866.126725:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 400 00000100:00100000:1.0:1787857866.126736:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171782400:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857866.126752:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857866.126759:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 47 pid: 5858 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.126778:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 47 pid: 5858 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.126857:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d2ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3f16 expref: 47 pid: 5858 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.126876:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:1.0:1787857866.126882:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.126891:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.126899:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.126922:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857866.126978:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:2350:x1874704171782400:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 244us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857866.126986:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 400 00010000:00010000:2.0:1787857866.127120:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.127129:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.127155:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.127166:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.127173:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857866.128465:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00010000:00010000:2.0:1787857866.128479:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.128489:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.128496:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.128502:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.128507:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.128514:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.128528:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857866.128531:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.128536:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.128542:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d682 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857866.128562:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe1cd3a9 reply state 00000000c405ec59 transno 4294968187 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857866.128570:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857866.128643:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+101:31524:x1874704171782272:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 22881us (23099us total) trans 4294968187 rc 0/0 00000100:00100000:2.0:1787857866.128650:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1331 00010000:00010000:2.0:1787857866.135002:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.135028:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.135036:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.135043:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.135049:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.135057:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.135075:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff9998c3379d00) 00010000:00010000:2.0:1787857866.135079:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.135084:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.135091:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d689 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857866.143579:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857866.146938:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171782528 00000100:00100000:3.0:1787857866.146955:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171782528 00000100:00100000:3.0:1787857866.147029:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1332 00000100:00100000:3.0:1787857866.147039:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+100:31525:x1874704171782528:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857866.147064:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857866.147089:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4051 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.147559:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d697 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.147577:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.147594:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857866.147659:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857866.147663:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857866.147692:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.147719:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4051 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.147741:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4051 expref: 101 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.147750:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:3.0:1787857866.147753:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857866.147757:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73e00, rc 0) 00000100:00100000:3.0:1787857866.148586:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+101:31525:x1874704171782528:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1543us (5013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857866.148595:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1332 00000100:00100000:3.0:1787857866.157283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857866.157469:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171782656 00000100:00100000:2.0:1787857866.157482:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171782656 00000100:00100000:2.0:1787857866.157565:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1333 00000100:00100000:2.0:1787857866.157575:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+101:31525:x1874704171782656:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857866.157598:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857866.157618:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d69e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4058 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157690:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157703:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157714:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157727:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157734:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157740:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157967:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d6b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157976:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.157982:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857866.158016:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:2.0:1787857866.158020:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857866.158042:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158058:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158063:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158069:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158074:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa75c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.158078:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158274:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158288:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857866.158291:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.158296:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158302:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158316:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158322:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158327:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158332:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.158335:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158340:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158347:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff9998c3379d00) 00010000:00010000:2.0:1787857866.158349:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.158351:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158357:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158392:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d69e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4058 expref: 103 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158405:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75e00/0xd3f183cab4a7d6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4058 expref: 102 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.158412:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857866.158414:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857866.158416:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75e00, rc 0) 00000100:00100000:2.0:1787857866.158487:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+102:31525:x1874704171782656:12345-192.168.204.36@tcp:101:bash.0 Request processed in 913us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857866.158495:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1333 00000100:00100000:2.0:1787857866.170899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857866.171326:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171782784 00000100:00100000:0.0:1787857866.171338:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171782784 00000100:00100000:0.0:1787857866.171404:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1334 00000100:00100000:0.0:1787857866.171416:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:31525:x1874704171782784:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857866.171440:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857866.171462:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d6ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd405f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171547:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171563:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171578:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171637:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171645:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171652:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171730:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171738:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171745:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171750:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857866.171754:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171761:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171784:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:0.0:1787857866.171788:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857866.171794:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.171800:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d6c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172224:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172232:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172238:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172243:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857866.172247:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172253:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172262:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff9997c3d03c00) 00010000:00010000:0.0:1787857866.172264:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857866.172267:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172273:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d6c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172314:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d6ba lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd405f expref: 103 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172324:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:0.0:1787857866.172326:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857866.172329:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d6ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd405f expref: 103 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.172344:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857866.172415:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:31525:x1874704171782784:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1001us (1525us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857866.172423:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1334 00000100:00100000:0.0:1787857866.192307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857866.192699:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171782912 00000100:00100000:2.0:1787857866.192712:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171782912 00000100:00100000:2.0:1787857866.192883:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1335 00000100:00100000:2.0:1787857866.192895:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+46:31526:x1874704171782912:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857866.192920:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857866.192941:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d6cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4066 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.193022:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.193036:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.193049:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857866.193130:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787857866.193134:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857866.193164:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.193192:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d6cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.193498:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.193508:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857866.193522:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857866.193527:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74a00, rc 0) 00000100:00100000:2.0:1787857866.193669:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:31526:x1874704171782912:12345-192.168.204.36@tcp:101:rm.0 Request processed in 776us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857866.193678:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1335 00000100:00100000:3.0:1787857866.197191:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857866.197750:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171783040 00000100:00100000:1.0:1787857866.197759:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171783040 00000100:00100000:2.0:1787857866.197902:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1336 00000100:00100000:2.0:1787857866.197914:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:31526:x1874704171783040:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857866.197935:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857866.197957:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd406d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198036:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198052:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198065:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198080:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198088:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198095:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198502:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d6f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198528:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198536:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857866.198571:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:2.0:1787857866.198576:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857866.198602:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198616:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198623:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198630:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198636:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.198641:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198649:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198660:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857866.198663:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.198668:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198679:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d6e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198693:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198699:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198704:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198709:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.198713:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198719:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198725:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff9998c3379d00) 00010000:00010000:2.0:1787857866.198728:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.198730:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198736:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d6eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198767:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d6dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd406d expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198780:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75200/0xd3f183cab4a7d6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd406d expref: 48 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.198788:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857866.198790:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857866.198793:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75200, rc 0) 00000100:00100000:2.0:1787857866.198903:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31526:x1874704171783040:12345-192.168.204.36@tcp:101:rm.0 Request processed in 991us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857866.198911:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1336 00000100:00100000:0.0:1787857866.202159:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857866.202436:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171783168 00000100:00100000:1.0:1787857866.202447:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171783168 00000100:00100000:1.0:1787857866.202502:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1337 00000100:00100000:1.0:1787857866.202625:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31526:x1874704171783168:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857866.202648:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857866.202672:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7d6f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4074 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202759:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202777:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202790:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202805:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202841:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202849:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202928:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202936:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202944:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202950:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857866.202955:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202968:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202982:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:1.0:1787857866.202985:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857866.202992:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.202999:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d700 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203012:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203018:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203023:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203027:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857866.203029:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203035:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203042:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff9998e1a0cc00) 00010000:00010000:1.0:1787857866.203045:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857866.203047:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203057:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203094:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7d6f9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4074 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203104:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:1.0:1787857866.203372:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857866.203378:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7d6f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4074 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.203389:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95c00, rc 0) 00000100:00100000:0.0:1787857866.203693:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31526:x1874704171783168:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1179us (1554us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857866.203703:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1337 00000100:00100000:3.0:1787857866.207371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857866.207511:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171783296 00000100:00100000:0.0:1787857866.207531:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171783296 00000100:00100000:0.0:1787857866.207592:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1338 00000100:00100000:0.0:1787857866.207603:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31526:x1874704171783296:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857866.207621:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857866.207640:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d70e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd407b expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207712:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207726:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207737:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207752:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207760:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207766:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207872:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207880:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207886:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207894:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857866.207898:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207904:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207916:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:0.0:1787857866.207919:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857866.207924:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207931:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d715 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207945:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207951:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207957:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207961:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857866.207964:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207969:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207975:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff9997c3d03c00) 00010000:00010000:0.0:1787857866.207978:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857866.207981:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.207987:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d71c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.208024:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d70e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd407b expref: 49 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.208034:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:0.0:1787857866.208036:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857866.208039:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d70e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd407b expref: 49 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.208054:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857866.208105:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31526:x1874704171783296:12345-192.168.204.36@tcp:101:rm.0 Request processed in 504us (742us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857866.208112:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1338 00000100:00100000:3.0:1787857866.229455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857866.229954:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171783424 00000100:00100000:2.0:1787857866.229966:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171783424 00000100:00100000:2.0:1787857866.230040:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1339 00000100:00100000:2.0:1787857866.230051:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31527:x1874704171783424:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857866.230076:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857866.230101:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d723 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4082 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.230198:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.230216:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.230230:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.230247:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.230255:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.230267:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231120:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231134:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231141:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231148:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857866.231152:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231159:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231173:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:3.0:1787857866.231176:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857866.231181:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231187:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74600/0xd3f183cab4a7d72a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231203:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231209:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231215:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231219:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857866.231221:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231230:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231237:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff9998c3379d00) 00010000:00010000:3.0:1787857866.231240:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857866.231242:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231247:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74400/0xd3f183cab4a7d731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231301:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d723 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4082 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231312:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:3.0:1787857866.231314:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857866.231318:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa75c00/0xd3f183cab4a7d723 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4082 expref: 49 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.231327:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa75c00, rc 0) 00000100:00100000:3.0:1787857866.231446:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31527:x1874704171783424:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1397us (2004us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857866.231455:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1339 00000100:00100000:0.0:1787857866.239349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857866.239457:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171783552 00000100:00100000:2.0:1787857866.239469:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171783552 00000100:00100000:2.0:1787857866.239637:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1340 00000100:00100000:2.0:1787857866.239649:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31527:x1874704171783552:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857866.239671:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857866.239691:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d738 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4089 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239760:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239774:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239786:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239847:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239856:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239863:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239932:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239940:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239947:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239953:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa74e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.239957:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239964:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239976:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857866.239979:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.239984:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.239990:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74e00/0xd3f183cab4a7d73f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240005:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240012:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240018:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240023:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857866.240026:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240033:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240039:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff9998c3379400) 00010000:00010000:2.0:1787857866.240042:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.240044:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240049:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240085:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d738 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4089 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240096:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857866.240098:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857866.240102:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74000/0xd3f183cab4a7d738 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4089 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.240400:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa74000, rc 0) 00000100:00100000:2.0:1787857866.240518:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31527:x1874704171783552:12345-192.168.204.36@tcp:101:cp.0 Request processed in 862us (1224us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857866.240525:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1340 00000100:00100000:3.0:1787857866.244406:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857866.244493:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171783808 00000100:00100000:0.0:1787857866.244505:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171783808 00000100:00100000:0.0:1787857866.244575:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1341 00000100:00100000:0.0:1787857866.244586:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31527:x1874704171783808:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857866.244607:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857866.244626:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d74d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4090 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.244766:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.244782:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.244794:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.244848:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.244856:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.244868:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857866.246096:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:0.0:1787857866.246552:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246570:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246581:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246619:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246626:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246633:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246639:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857866.246644:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246651:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246663:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:0.0:1787857866.246666:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857866.246671:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246677:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d754 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857866.246691:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6825f80 reply state 000000006f3c3aca transno 4294968188 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857866.246701:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857866.246739:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d74d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246754:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.246761:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857866.246763:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857866.246766:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71e00, rc 0) 00000100:00100000:0.0:1787857866.248505:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:31527:x1874704171783808:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3912us (4100us total) trans 4294968188 rc 0/0 00000100:00100000:0.0:1787857866.248527:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1341 00000100:00100000:3.0:1787857866.254733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857866.254857:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171783936 00000100:00100000:1.0:1787857866.254870:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171783936 00000100:00100000:1.0:1787857866.254946:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 369 00000100:00100000:1.0:1787857866.254958:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171783936:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857866.254978:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857866.255005:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4097 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857866.255039:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857866.255079:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=690s v=(0 0) 00010000:00010000:1.0:1787857866.255084:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857866.255094:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 9 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.255241:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 9 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.255257:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94c00, rc 0) 00000100:00100000:1.0:1787857866.255316:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171783936:12345-192.168.204.36@tcp:101:cp.0 Request processed in 361us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857866.255324:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 369 00000100:00080000:3.0:1787857866.255469:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857866.258744:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.258763:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.258771:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.258781:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857866.258786:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.258794:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.259020:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff9997c3d03c00) 00010000:00010000:0.0:1787857866.259023:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857866.259029:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.259036:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d75b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857866.259472:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857866.259623:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171784064 00000100:00100000:3.0:1787857866.259634:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171784064 00000100:00100000:3.0:1787857866.259732:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 370 00000100:00100000:3.0:1787857866.259744:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:31527:x1874704171784064:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857866.259764:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857866.259782:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd409e expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.259861:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 10 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.259871:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857866.259875:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857866.259881:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.259924:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 10 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.259938:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 10 pid: 6711 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857866.259956:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188281088:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857866.260052:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857866.264511:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188281088:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857866.264615:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.264645:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857866.264784:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:31527:x1874704171784064:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5041us (5314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857866.264801:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 370 00000100:00100000:0.0:1787857866.266249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857866.274978:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171784192 00000100:00100000:1.0:1787857866.274995:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171784192 00010000:00010000:1.0:1787857866.275054:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 10 pid: 6711 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857866.275116:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 401 00000100:00100000:0.0:1787857866.275407:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171784192:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857866.275427:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857866.275454:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 10 pid: 6711 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.275470:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 10 pid: 6711 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.275496:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007234cf17/0xd3f183cab4a7d770 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4097 expref: 10 pid: 6711 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.275535:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857866.275540:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857866.275549:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.275560:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.275603:0:17347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857866.275618:0:17347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17347:1874704188281216:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857866.275731:0:17347:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900d59540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857866.280480:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857866.280690:0:17347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17347:1874704188281216:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857866.280718:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857866.280785:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171784192:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5467us (14541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857866.280849:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 401 00000100:00100000:1.0:1787857866.281283:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171784448 00000100:00100000:1.0:1787857866.281292:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171784448 00000100:00100000:1.0:1787857866.281347:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:1.0:1787857866.281357:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:31527:x1874704171784448:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:1.0:1787857866.281701:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:31527:x1874704171784448:12345-192.168.204.36@tcp:35:cp.0 Request processed in 345us (1231us total) trans 4294968189 rc 0/0 00000100:00100000:1.0:1787857866.281709:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:2.0:1787857866.375616:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857866.375741:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171784576 00000100:00100000:3.0:1787857866.375751:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171784576 00000100:00100000:3.0:1787857866.375858:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1342 00000100:00100000:3.0:1787857866.375868:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+102:31530:x1874704171784576:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857866.375889:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857866.375911:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d77e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40a5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.375986:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376003:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376017:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376033:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376040:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376046:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376233:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376242:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376250:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857866.376290:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00000004:00200000:3.0:1787857866.376295:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857866.376314:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376326:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376335:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376342:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376349:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376355:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857866.376360:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376368:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376382:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:3.0:1787857866.376385:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857866.376390:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376397:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7d785 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376413:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376419:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376424:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376429:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857866.376431:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376436:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376443:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff9998d12eff00) 00010000:00010000:3.0:1787857866.376445:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857866.376448:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376453:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d78c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.376493:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d77e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 104 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.377000:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 103 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857866.377013:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857866.377015:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857866.377018:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:2.0:1787857866.377496:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+103:31530:x1874704171784576:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1624us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857866.377505:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1342 00000100:00100000:3.0:1787857866.382090:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857866.382266:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171784704 00000100:00100000:2.0:1787857866.382276:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171784704 00000100:00100000:2.0:1787857866.382442:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 371 00000100:00100000:2.0:1787857866.382455:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171784704:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857866.382476:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857866.382496:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3465082/0xd3f183cab4a7d79a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40ac expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857866.382577:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188281344:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857866.382675:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998da1d0d80 going to sleep for 11 seconds 00000100:00080000:3.0:1787857866.383204:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1787857866.386373:0:14028:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857866.386385:0:14028:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb mtime: 0 -> 1787857865 00002000:00010000:2.0:1787857866.386388:0:14028:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb atime: 0 -> 1787857865 00002000:00010000:2.0:1787857866.386390:0:14028:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb ctime: 0 -> 1787857865 00000100:00100000:2.0:1787857866.386417:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188281344:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857866.386461:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3465082/0xd3f183cab4a7d79a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40ac expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.386490:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3465082/0xd3f183cab4a7d79a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40ac expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857866.386666:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:2.0:1787857866.386734:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171784704:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4281us (4654us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857866.386745:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 371 00000100:00100000:3.0:1787857866.390679:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857866.391055:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171784832 00000100:00100000:1.0:1787857866.391066:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171784832 00000100:00100000:1.0:1787857866.391136:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1343 00000100:00100000:1.0:1787857866.391145:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+103:31530:x1874704171784832:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857866.391165:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857866.391187:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d7a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.391255:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.391270:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.391281:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857866.391356:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:1.0:1787857866.391360:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857866.391382:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.391409:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7d7a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 105 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.391429:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 104 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857866.391439:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:1.0:1787857866.391441:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857866.391902:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94800, rc 0) 00000100:00100000:1.0:1787857866.391973:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+104:31530:x1874704171784832:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 827us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857866.391982:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1343 00000100:00100000:2.0:1787857866.396501:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857866.396699:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171784960 00000100:00100000:1.0:1787857866.396709:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171784960 00000100:00100000:1.0:1787857866.397023:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 372 00000100:00100000:1.0:1787857866.397039:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171784960:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857866.397065:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857866.397088:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c56d48b0/0xd3f183cab4a7d7af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40ba expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857866.397379:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188281472:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857866.397478:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857866.400777:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188281472:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857866.400860:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c56d48b0/0xd3f183cab4a7d7af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40ba expref: 17 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.400886:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c56d48b0/0xd3f183cab4a7d7af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40ba expref: 17 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857866.400901:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95c00, rc 0) 00000100:00100000:0.0:1787857866.401710:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171784960:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4669us (5218us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857866.401722:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 372 00000100:00100000:2.0:1787857866.415011:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857866.420722:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171785216 00000100:00100000:0.0:1787857866.420741:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171785216 00000100:00100000:0.0:1787857866.420943:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1344 00000100:00100000:0.0:1787857866.420956:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:31530:x1874704171785216:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857866.421760:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].39, 136 off13496 00000100:00100000:0.0:1787857866.421953:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:31530:x1874704171785216:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 998us (6952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857866.421962:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1344 00010000:00010000:0.0:1787857866.478957:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857866.991683:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857866.991695:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857866.991742:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 40 count 3 00000040:00080000:2.0:1787857866.991752:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857866.992114:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188281600:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857866.992233:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857867.002907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.003087:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171785344 00000100:00100000:3.0:1787857867.003098:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171785344 00000100:00100000:3.0:1787857867.003171:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1345 00000100:00100000:3.0:1787857867.003183:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:31540:x1874704171785344:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857867.003226:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857867.003345:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:31540:x1874704171785344:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 163us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.003353:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1345 00000100:00100000:0.0:1787857867.005651:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188281600:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857867.016859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857867.017132:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171785600 00000100:00100000:2.0:1787857867.017143:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171785600 00000100:00100000:2.0:1787857867.017216:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1346 00000100:00100000:2.0:1787857867.017226:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:31540:x1874704171785600:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857867.017248:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857867.017271:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d7b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.017387:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d7bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.017401:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.017417:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857867.017430:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:2.0:1787857867.017566:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d7b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c1 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.017584:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d7bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c1 expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.017593:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857867.017596:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857867.017600:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:2.0:1787857867.017661:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31540:x1874704171785600:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 436us (847us total) trans 4294968190 rc 0/0 00000100:00100000:2.0:1787857867.017668:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1346 00000100:00100000:1.0:1787857867.031640:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857867.031683:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857867.031726:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171785856 00000100:00100000:1.0:1787857867.031736:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171785856 00000100:00100000:1.0:1787857867.031989:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:1.0:1787857867.032001:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2348:x1874704171785856:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857867.032018:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857867.032047:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d7bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c1 expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.032068:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857867.032075:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857867.032501:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171785728 00000100:00100000:3.0:1787857867.032509:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171785728 00000100:00100000:3.0:1787857867.032553:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 373 00000100:00100000:3.0:1787857867.032561:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171785728:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857867.032601:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.032621:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.032630:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857867.032635:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857867.032640:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.032678:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.032694:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 9 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857867.032723:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188281728:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857867.033024:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65240 going to sleep for 11 seconds 00000100:00100000:1.0:1787857867.033213:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171785856:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1213us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857867.033222:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:1.0:1787857867.037742:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857867.037772:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188281728:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857867.037839:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857867.038390:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171785984 00000100:00100000:1.0:1787857867.038399:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171785984 00002000:00100000:1.0:1787857867.038464:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1a:0x0] (0->157) req@ffff9997c26e5680 x1874704171785984/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:513/0 lens 648/0 e 0 to 0 dl 1787857878 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857867.038477:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c26e5680 with x1874704171785984 ext(0->157) 00010000:00010000:1.0:1787857867.038487:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 10 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.038516:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 10 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857867.038524:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9997c26e5680 00000100:00100000:1.0:1787857867.038567:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:1.0:1787857867.038578:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171785984:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857867.040395:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171785984:12345-192.168.204.36@tcp:4:cp.0 Request processed in 1808us (2650us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1787857867.040409:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00002000:00100000:1.0:1787857867.040431:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1a:0x0] (0->157) req@ffff9997c26e5680 x1874704171785984/t4294967368(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:513/0 lens 648/448 e 0 to 0 dl 1787857878 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857867.040442:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c26e5680 with x1874704171785984 ext(0->157) 00010000:00010000:1.0:1787857867.040452:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 12 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.040470:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 12 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857867.040483:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9997c26e5680 00000100:00100000:1.0:1787857867.047275:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.047597:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171786112 00000100:00100000:3.0:1787857867.047607:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171786112 00010000:00010000:3.0:1787857867.047649:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 12 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857867.047697:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00100000:3.0:1787857867.047717:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171786112:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857867.047733:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857867.047764:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 12 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.047780:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 12 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048027:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7d777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd409e expref: 12 pid: 6713 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048048:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857867.048052:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857867.048057:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048067:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048109:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857867.048168:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171786112:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 461us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.048176:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 402 00010000:00010000:3.0:1787857867.048212:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048221:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048251:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048259:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048268:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048276:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857867.048280:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048416:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048431:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.048439:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000519815eb/0xd3f183cab4a7d7cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857867.048491:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171785728:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 15931us (16866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.048503:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 373 00000100:00100000:1.0:1787857867.054914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857867.056555:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171786368 00000100:00100000:0.0:1787857867.056572:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171786368 00000100:00100000:1.0:1787857867.056773:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1347 00000100:00100000:1.0:1787857867.056783:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:31540:x1874704171786368:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857867.056949:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:31540:x1874704171786368:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 167us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857867.056957:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1347 00000100:00100000:1.0:1787857867.063280:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857867.064159:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171786496 00000100:00100000:2.0:1787857867.064173:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171786496 00000100:00100000:2.0:1787857867.064360:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 374 00000100:00100000:2.0:1787857867.064372:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171786496:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857867.064394:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857867.064432:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40c8 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857867.064467:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a908bc9, atime: 0x0, ctime: 0x6a908bc9, blocks: 0x1 00010000:00010000:2.0:1787857867.064504:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1787857867.064511:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857867.064526:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 11 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.064546:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 11 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.064561:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:2.0:1787857867.064649:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171786496:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 278us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857867.064657:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 374 00000100:00100000:3.0:1787857867.068743:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857867.069019:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171786752 00000100:00100000:2.0:1787857867.069033:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171786752 00000100:00100000:2.0:1787857867.069115:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1348 00000100:00100000:2.0:1787857867.069127:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:31540:x1874704171786752:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857867.069287:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:31540:x1874704171786752:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 161us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857867.069294:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1348 00000100:00100000:3.0:1787857867.073935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857867.074146:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171786880 00000100:00100000:1.0:1787857867.074158:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171786880 00002000:00100000:1.0:1787857867.074210:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (0->4095) req@ffff9998ffa821c0 x1874704171786880/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:513/0 lens 488/0 e 0 to 0 dl 1787857878 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857867.074222:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa821c0 with x1874704171786880 ext(0->4095) 00002000:00010000:1.0:1787857867.074228:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998ffa821c0 00000100:00100000:1.0:1787857867.074269:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 117 00000100:00100000:1.0:1787857867.074280:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171786880:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857867.074541:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171786880:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 261us (615us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857867.074549:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 117 00002000:00100000:1.0:1787857867.074556:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (0->4095) req@ffff9998ffa821c0 x1874704171786880/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:513/0 lens 488/4536 e 0 to 0 dl 1787857878 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857867.074580:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa821c0 with x1874704171786880 ext(0->4095) 00002000:00010000:1.0:1787857867.074585:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998ffa821c0 00000100:00100000:3.0:1787857867.085059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857867.085221:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171787008 00000100:00100000:0.0:1787857867.085232:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171787008 00000100:00100000:0.0:1787857867.085300:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1349 00000100:00100000:0.0:1787857867.085312:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:31540:x1874704171787008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857867.085336:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857867.085362:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d7d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40cf expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.085404:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.085421:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.085438:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.085540:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d7d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 54 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.085558:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 53 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.085567:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857867.085570:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857867.085574:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857867.085633:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31540:x1874704171787008:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 324us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857867.085641:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1349 00000100:00100000:2.0:1787857867.115606:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.115714:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171787136 00000100:00100000:3.0:1787857867.115725:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171787136 00000100:00100000:2.0:1787857867.116041:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1350 00000100:00100000:2.0:1787857867.116055:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31540:x1874704171787136:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857867.116105:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857867.116238:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31540:x1874704171787136:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 186us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857867.116246:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1350 00000100:00100000:3.0:1787857867.119046:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188281856:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.119149:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857867.119204:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188282368:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.119230:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857867.119259:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787857867.119264:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7047840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188281984:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.119283:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857867.119298:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188282496:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.119319:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857867.119344:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188282240:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.119365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857867.119381:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857867.119386:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188282112:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.119403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857867.119433:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188282368 00000100:00100000:3.0:1787857867.119440:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188282368 00000100:00100000:3.0:1787857867.119622:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188281984 00000100:00100000:3.0:1787857867.119626:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188281984 00000100:00100000:3.0:1787857867.119647:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188282112 00000100:00100000:3.0:1787857867.119650:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188282112 00000100:00100000:3.0:1787857867.119671:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1787857867.119681:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188282368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.119898:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188282368:12345-0@lo:400:kworker.0 Request processed in 218us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.119906:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1787857867.119927:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1787857867.119933:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188281984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.119958:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188281984:12345-0@lo:400:kworker.0 Request processed in 26us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.119964:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1787857867.119974:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1787857867.119980:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188282112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.120008:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188282112:12345-0@lo:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.120013:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00080000:3.0:1787857867.120031:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857867.120062:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7047840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188281984:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.120072:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188282368:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.120249:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188282112:0@lo:400:kworker.0 00000100:00100000:2.0:1787857867.122062:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188282496 00000100:00100000:2.0:1787857867.122076:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188282496 00000100:00100000:2.0:1787857867.122147:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188282240 00000100:00100000:2.0:1787857867.122151:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188282240 00000100:00100000:2.0:1787857867.122178:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1787857867.122189:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188282496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857867.122280:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188282496:12345-0@lo:400:kworker.0 Request processed in 93us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857867.122287:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1787857867.122307:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1787857867.122314:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188282240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857867.122347:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188282240:12345-0@lo:400:kworker.0 Request processed in 33us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857867.122353:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1787857867.122371:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188281856 00000100:00100000:2.0:1787857867.122375:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188281856 00000100:00100000:2.0:1787857867.122399:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1787857867.122406:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188281856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857867.122437:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188281856:12345-0@lo:400:kworker.0 Request processed in 32us (3290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857867.122443:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00080000:3.0:1787857867.123553:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857867.123558:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857867.123599:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188282496:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.123612:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188281856:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.123651:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188282240:0@lo:400:kworker.0 00000100:00100000:3.0:1787857867.132620:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857867.133958:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171787264 00000100:00100000:0.0:1787857867.133971:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171787264 00000100:00100000:0.0:1787857867.134049:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 375 00000100:00100000:0.0:1787857867.134060:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171787264:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857867.134206:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134225:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857867.134230:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857867.134235:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134255:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134287:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134296:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134305:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134312:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857867.134317:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134325:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134340:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.134348:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955e947f/0xd3f183cab4a7d7e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857867.134469:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171787264:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 411us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857867.134477:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 375 00000100:00100000:3.0:1787857867.145153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857867.145529:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171787520 00000100:00100000:2.0:1787857867.145539:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171787520 00000100:00100000:2.0:1787857867.145595:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1351 00000100:00100000:2.0:1787857867.145606:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31540:x1874704171787520:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857867.145690:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.145722:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 53 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.145732:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 4/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.145780:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 53 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.145805:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 53 pid: 7656 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857867.146064:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188282624:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857867.146458:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4df9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857867.150448:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857867.150581:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188282624:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857867.150614:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857867.150730:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171787648 00000100:00100000:2.0:1787857867.150737:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171787648 00010000:00010000:2.0:1787857867.150785:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 54 pid: 7656 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857867.150863:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:2.0:1787857867.150873:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171787648:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857867.150889:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857867.150897:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 54 pid: 7656 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.150909:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 54 pid: 7656 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.150933:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7d7e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40cf expref: 54 pid: 7656 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.150949:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857867.150955:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.150965:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.150973:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.150992:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857867.151047:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2349:x1874704171787648:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 175us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857867.151055:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 403 00010000:00010000:3.0:1787857867.152037:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.152051:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.152293:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.152301:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.152308:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.152314:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857867.152318:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.152325:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.152337:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857867.152340:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857867.152344:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 2/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.152350:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7d7ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857867.152681:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31540:x1874704171787520:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 7073us (7534us total) trans 4294968191 rc 0/0 00000100:00100000:3.0:1787857867.152691:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1351 00000040:00080000:2.0:1787857867.153675:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857867.153682:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857867.154385:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857867.154397:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857867.176926:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857867.177190:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171787904 00000100:00100000:0.0:1787857867.177203:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171787904 00000100:00100000:0.0:1787857867.177893:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 271 00000100:00100000:0.0:1787857867.177907:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c600b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31540:x1874704171787904:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857867.178184:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c600b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:31540:x1874704171787904:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 280us (1269us total) trans 4294968192 rc 0/0 00000100:00100000:0.0:1787857867.178193:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 271 00000040:00080000:3.0:1787857867.313552:0:21845:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857867.313565:0:21845:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857867.315774:0:21845:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 40 count 3 00000040:00080000:3.0:1787857867.315785:0:21845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857867.417150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.417279:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171788032 00000100:00100000:3.0:1787857867.417290:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171788032 00000100:00100000:3.0:1787857867.417351:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 376 00000100:00100000:3.0:1787857867.417362:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171788032:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857867.417392:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857867.417410:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40d6 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.417436:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857867.417442:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857867.417451:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.417468:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.417482:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72800, rc 0) 00000100:00100000:3.0:1787857867.417550:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+17:2347:x1874704171788032:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 190us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.417558:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 376 00000100:00100000:3.0:1787857867.447314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.451976:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171788288 00000100:00100000:3.0:1787857867.451993:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171788288 00000100:00100000:3.0:1787857867.452074:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1352 00000100:00100000:3.0:1787857867.452094:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+104:31541:x1874704171788288:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857867.452116:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857867.452137:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d7fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40dd expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.452393:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d803 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.452409:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.452421:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857867.452443:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:3.0:1787857867.452696:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d7fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40dd expref: 107 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.452726:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d803 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40dd expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.452735:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857867.452738:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857867.452742:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857867.452954:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+106:31541:x1874704171788288:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 870us (5649us total) trans 4294968193 rc 0/0 00000100:00100000:3.0:1787857867.452962:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1352 00000100:00100000:1.0:1787857867.468592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.468649:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171788416 00000100:00100000:3.0:1787857867.468661:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171788416 00000100:00100000:3.0:1787857867.468740:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 377 00000100:00100000:3.0:1787857867.468761:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2350:x1874704171788416:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:3.0:1787857867.468838:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.468861:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.468870:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.468878:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857867.468883:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857867.468888:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.468922:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.468936:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 17 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857867.468968:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188282752:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857867.469081:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 10 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.469091:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 10 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857867.469101:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188282880:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857867.469124:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857867.474128:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188282752:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857867.474146:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188282880:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857867.474184:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857867.477321:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.480686:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171788544 00000100:00100000:3.0:1787857867.480707:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171788544 00010000:00010000:3.0:1787857867.480760:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 18 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857867.480843:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 404 00000100:00100000:3.0:1787857867.480854:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171788544:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857867.480871:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857867.480896:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 18 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.480912:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 18 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.480937:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e797f6e5/0xd3f183cab4a7d7f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40d6 expref: 18 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.480955:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857867.481023:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171788544:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 171us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.481031:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 404 00000100:00100000:1.0:1787857867.484135:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.485863:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171788672 00000100:00100000:3.0:1787857867.485878:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171788672 00010000:00010000:3.0:1787857867.485927:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 11 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857867.485973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 405 00000100:00100000:3.0:1787857867.485983:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171788672:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857867.485998:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857867.486022:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 11 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.486037:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 11 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.486071:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7d7d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40c8 expref: 11 pid: 14028 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.486090:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857867.486095:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857867.486101:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.487711:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.487770:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857867.487871:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171788672:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1884us (3740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.487882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 405 00010000:00010000:1.0:1787857867.488848:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.488863:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.488913:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.488922:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.488930:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.488938:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857867.488942:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.488950:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.488969:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.488978:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b3fcbca/0xd3f183cab4a7d811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857867.489058:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171788416:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 20298us (20475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857867.489066:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 377 00000100:00100000:3.0:1787857867.499634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857867.499961:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171788928 00000100:00100000:0.0:1787857867.499972:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171788928 00000100:00100000:0.0:1787857867.500028:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 272 00000100:00100000:0.0:1787857867.500039:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:31541:x1874704171788928:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:0.0:1787857867.500112:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x28:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d803 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40dd expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857867.500358:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968194 00000001:00080000:0.0:1787857867.500945:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968195 00010000:00010000:0.0:1787857867.501004:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.501022:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.501038:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 109 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.501046:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.501082:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 109 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.501099:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 109 pid: 5857 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857867.501114:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188283008:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857867.501214:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.501224:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 53 pid: 5856 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857867.501233:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188283136:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857867.501259:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c1254000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857867.506688:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188283008:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857867.506705:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188283136:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857867.506736:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.509035:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857867.512162:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857867.512206:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857867.512252:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171789056 00000100:00100000:1.0:1787857867.512264:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171789056 00010000:00010000:1.0:1787857867.512310:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 110 pid: 5857 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857867.512340:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171789184 00000100:00100000:1.0:1787857867.512343:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171789184 00010000:00010000:1.0:1787857867.512355:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 54 pid: 5856 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857867.512373:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 406 00000100:00100000:1.0:1787857867.512381:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+110:2350:x1874704171789056:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857867.512395:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857867.512402:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 110 pid: 5857 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.512414:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 110 pid: 5857 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.512451:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7d793 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40a5 expref: 110 pid: 5857 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.512469:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857867.512475:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.512484:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.512499:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857867.512548:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+109:2350:x1874704171789056:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 167us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857867.512556:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 406 00000100:00100000:1.0:1787857867.512571:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 407 00000100:00100000:1.0:1787857867.512945:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2350:x1874704171789184:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857867.512959:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857867.512964:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 54 pid: 5856 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.512975:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 54 pid: 5856 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.512988:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71e00/0xd3f183cab4a7d762 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4090 expref: 54 pid: 5856 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.512999:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857867.513003:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.513011:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.513019:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.513044:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857867.513066:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2350:x1874704171789184:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 125us (859us total) trans 0 rc 0/0 00010000:00010000:0.0:1787857867.516238:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.516257:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857867.516394:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968196 00000001:00080000:0.0:1787857867.517063:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968197 00000001:00080000:0.0:1787857867.517200:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968198 00000100:00100000:0.0:1787857867.517365:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188283264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857867.517689:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 407 00000100:00100000:0.0:1787857867.520199:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857867.520267:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2a8bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857867.520354:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188283264 00000100:00100000:1.0:1787857867.520363:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188283264 00000100:00100000:1.0:1787857867.520420:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787857867.520440:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188283264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857867.520559:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188283264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 130us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857867.520566:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787857867.521174:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188283264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787857867.527461:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968199 00000100:00100000:1.0:1787857867.527777:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c27161c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188283392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857867.527887:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857867.527923:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f7540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857867.528075:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188283392 00000100:00100000:3.0:1787857867.528094:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188283392 00000100:00100000:3.0:1787857867.528157:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787857867.528167:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188283392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787857867.528752:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5860:x1874704188283392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 585us (862us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787857867.528760:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787857867.531304:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c27161c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188283392:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:2.0:1787857867.531337:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.531353:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.531361:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.531367:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857867.531371:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.531378:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.531395:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857867.531398:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787857867.531403:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857867.531410:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d818 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857867.531922:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x4e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787857867.535479:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8984 00000004:00080000:0.0:1787857867.535516:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691585698236ns, next at 692585693271ns, rc = 0 00000001:00080000:0.0:1787857867.535535:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968200 00010000:00010000:0.0:1787857867.535771:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857867.535776:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787857867.535801:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7d803 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40dd expref: 113 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857867.535991:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+112:31541:x1874704171788928:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 35951us (36365us total) trans 4294968201 rc 0/0 00000100:00100000:0.0:1787857867.536002:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 272 00000020:00080000:0.0:1787857867.536008:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1787857867.607016:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857867.607099:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171789440 00000100:00100000:0.0:1787857867.607110:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171789440 00000100:00100000:0.0:1787857867.607176:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1353 00000100:00100000:0.0:1787857867.607187:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+112:31542:x1874704171789440:12345-192.168.204.36@tcp:101:lseek_test.0 00010000:00010000:0.0:1787857867.607225:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857867.607248:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d81f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40e4 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607344:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607358:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607370:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607386:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607393:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607400:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607565:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d834 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607573:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607580:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857867.607590:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:0.0:1787857867.607683:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607691:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607706:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607712:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857867.607716:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607723:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607734:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:0.0:1787857867.607737:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857867.607741:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607748:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d826 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607763:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607768:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607776:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607781:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857867.607783:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607797:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607804:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff9997c3d03000) 00010000:00010000:0.0:1787857867.607806:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857867.607808:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607846:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d82d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607915:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d81f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40e4 expref: 115 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607938:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d834 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40e4 expref: 114 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857867.607946:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03c00) 00010000:00010000:0.0:1787857867.607948:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857867.607951:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:0.0:1787857867.608006:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+114:31542:x1874704171789440:12345-192.168.204.36@tcp:101:lseek_test.0 Request processed in 822us (1001us total) trans 4294968202 rc 0/0 00000100:00100000:0.0:1787857867.608018:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1353 00000100:00100000:3.0:1787857867.612228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857867.612398:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171789696 00000100:00100000:1.0:1787857867.612407:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171789696 00000100:00100000:1.0:1787857867.612497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:1.0:1787857867.612509:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+114:31542:x1874704171789696:12345-192.168.204.36@tcp:103:lseek_test.0 00010000:00010000:1.0:1787857867.612525:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857867.612552:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7d834 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40e4 expref: 114 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.612574:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9997c3d03c00) 00010000:00010000:1.0:1787857867.612588:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857867.612653:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:31542:x1874704171789696:12345-192.168.204.36@tcp:103:lseek_test.0 Request processed in 147us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857867.612661:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:1.0:1787857867.616105:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857867.616370:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171789824 00000100:00100000:3.0:1787857867.616380:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171789824 00000100:00100000:3.0:1787857867.616636:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1354 00000100:00100000:3.0:1787857867.616649:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+113:31542:x1874704171789824:12345-192.168.204.36@tcp:58:lseek_test.0 00010000:00010000:3.0:1787857867.616775:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.616804:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857867.616848:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857867.617040:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].40, 136 off13632 00000100:00100000:3.0:1787857867.617146:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+113:31542:x1874704171789824:12345-192.168.204.36@tcp:58:lseek_test.0 Request processed in 499us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.617154:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1354 00000100:00100000:1.0:1787857867.623882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857867.623923:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171789952 00000100:00100000:1.0:1787857867.623933:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171789952 00000100:00100000:1.0:1787857867.623989:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1355 00000100:00100000:1.0:1787857867.624000:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:31542:x1874704171789952:12345-192.168.204.36@tcp:101:lseek_test.0 00010000:00010000:1.0:1787857867.624022:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857867.624044:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494c00/0xd3f183cab4a7d849 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40eb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.624129:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.624141:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494c00/0xd3f183cab4a7d849 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40eb expref: 114 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.624160:0:5858:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.624174:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494c00/0xd3f183cab4a7d849 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40eb expref: 114 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.624187:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9998d12eff00) 00010000:00010000:1.0:1787857867.624190:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857867.624195:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494c00/0xd3f183cab4a7d849 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40eb expref: 114 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857867.624204:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1494c00, rc 0) 00000100:00100000:1.0:1787857867.624270:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+114:31542:x1874704171789952:12345-192.168.204.36@tcp:101:lseek_test.0 Request processed in 271us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857867.624277:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1355 00000100:00100000:0.0:1787857867.631592:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857867.631617:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188283520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857867.631689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857867.631961:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188283520 00000100:00100000:3.0:1787857867.631970:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188283520 00000100:00100000:3.0:1787857867.632023:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787857867.632033:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188283520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857867.632074:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857867.632140:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188283520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857867.632147:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787857867.632209:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188283520:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787857868.207497:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857868.207508:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857868.207550:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 4 00000040:00080000:2.0:1787857868.207559:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857868.207701:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188283648:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857868.207841:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9997c27f79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857868.220496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.221403:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188283648:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857868.223535:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171790080 00000100:00100000:3.0:1787857868.223549:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171790080 00000100:00100000:3.0:1787857868.223647:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1356 00000100:00100000:3.0:1787857868.223659:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31544:x1874704171790080:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857868.223693:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1787857868.223878:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857868.224404:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31544:x1874704171790080:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 746us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857868.224414:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1356 00000100:00100000:1.0:1787857868.235678:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857868.236420:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171790208 00000100:00100000:3.0:1787857868.236430:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171790208 00000100:00100000:3.0:1787857868.236540:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1357 00000100:00100000:3.0:1787857868.236552:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31544:x1874704171790208:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857868.236629:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.236647:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.236661:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.236677:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.236683:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.236691:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237038:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237048:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237057:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857868.237447:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00000004:00200000:3.0:1787857868.237452:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857868.237466:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237477:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237483:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237490:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237495:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857868.237500:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237507:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237519:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857868.237522:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857868.237526:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237533:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d850 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237553:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237559:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237566:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237571:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857868.237574:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237580:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237587:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xefe2aa85 (ffff9998d12efc00) 00010000:00010000:3.0:1787857868.237590:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857868.237593:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237599:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d857 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237617:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237624:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237630:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237635:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857868.237637:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237644:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237651:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9998d12eff00) 00010000:00010000:3.0:1787857868.237653:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857868.237656:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.237661:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d85e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857868.238595:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31544:x1874704171790208:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 2037us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857868.238606:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1357 00000100:00100000:0.0:1787857868.255739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.257041:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171790464 00000100:00100000:2.0:1787857868.257055:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171790464 00000100:00100000:2.0:1787857868.257144:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1358 00000100:00100000:2.0:1787857868.257155:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:31544:x1874704171790464:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857868.257178:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857868.257205:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d865 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40f2 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.257332:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.257996:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.258012:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857868.258026:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:2.0:1787857868.258146:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.258153:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.258160:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.258165:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857868.258169:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.258179:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.258191:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9998d12eff00) 00010000:00010000:2.0:1787857868.258194:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857868.258200:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.258205:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d86c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.259209:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d865 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40f2 expref: 55 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.259225:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857868.259228:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857868.259233:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d865 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40f2 expref: 55 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.259693:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:2.0:1787857868.259787:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:31544:x1874704171790464:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2632us (4060us total) trans 4294968203 rc 301/301 00000100:00100000:2.0:1787857868.259796:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1358 00000100:00100000:0.0:1787857868.269661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857868.269808:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171790592 00000100:00100000:3.0:1787857868.269861:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171790592 00000100:00100000:3.0:1787857868.269924:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1359 00000100:00100000:3.0:1787857868.269934:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:31544:x1874704171790592:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857868.269973:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857868.270089:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:31544:x1874704171790592:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 156us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857868.270097:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1359 00000100:00100000:1.0:1787857868.283219:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857868.283324:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171790848 00000100:00100000:3.0:1787857868.283334:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171790848 00000100:00100000:3.0:1787857868.283404:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1360 00000100:00100000:3.0:1787857868.283416:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:31544:x1874704171790848:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857868.283438:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857868.283458:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d87a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd40f9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.284020:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d881 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.284036:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.284047:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857868.284059:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00010000:00010000:3.0:1787857868.284103:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d87a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40f9 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.284122:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d881 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40f9 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.284132:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9998d12efe00) 00010000:00010000:3.0:1787857868.284135:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857868.284138:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73200, rc 0) 00000100:00100000:3.0:1787857868.284203:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:31544:x1874704171790848:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 789us (994us total) trans 4294968204 rc 0/0 00000100:00100000:3.0:1787857868.284211:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1360 00000100:00100000:2.0:1787857868.293682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.293923:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171791104 00000100:00100000:1.0:1787857868.293943:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171791104 00000100:00100000:1.0:1787857868.294005:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1361 00000100:00100000:1.0:1787857868.294016:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:31544:x1874704171791104:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857868.294079:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857868.294108:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d881 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40f9 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.294129:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9998d12efe00) 00010000:00010000:1.0:1787857868.294140:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857868.294165:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.294180:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 113 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.294190:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.294224:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 113 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.294238:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 113 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857868.294253:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2715e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188283776:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857868.294334:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c1254e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857868.299711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857868.299809:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171791232 00000100:00100000:0.0:1787857868.299853:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171791232 00010000:00010000:0.0:1787857868.299921:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 114 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857868.299964:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:0.0:1787857868.299976:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+114:2350:x1874704171791232:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857868.299990:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857868.299997:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 114 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.300011:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 114 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.300035:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:0.0:1787857868.300041:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.300052:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.300077:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.300102:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857868.300159:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+114:2350:x1874704171791232:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 185us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857868.300166:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00080000:1.0:1787857868.300585:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857868.301455:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7d7a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40b3 expref: 113 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.301487:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2715e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188283776:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857868.301509:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301518:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301522:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301556:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301568:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301578:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301665:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301673:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301680:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301687:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857868.301692:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301699:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301711:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857868.301714:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857868.301718:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301725:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d88f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301734:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301741:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301747:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301752:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857868.301755:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301760:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301768:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x1a12d59 (ffff9998c3379300) 00010000:00010000:2.0:1787857868.301780:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857868.301784:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.301790:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d896 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x1a12d59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.301937:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:31544:x1874704171791104:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 7921us (8264us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857868.301946:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1361 00000100:00100000:1.0:1787857868.319727:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857868.319870:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171791360 00000100:00100000:0.0:1787857868.319880:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171791360 00000100:00100000:0.0:1787857868.319948:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1362 00000100:00100000:0.0:1787857868.319958:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:31544:x1874704171791360:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857868.319978:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857868.320001:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d89d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4100 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.320040:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.320054:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.320077:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.320178:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d89d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.320199:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.320209:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857868.320212:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857868.320215:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857868.320352:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:31544:x1874704171791360:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 394us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857868.320359:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1362 00000100:00100000:3.0:1787857868.325223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857868.325309:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171791616 00000100:00100000:0.0:1787857868.325331:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171791616 00000100:00100000:0.0:1787857868.325405:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1363 00000100:00100000:0.0:1787857868.325417:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:31544:x1874704171791616:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857868.325506:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.325523:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.325536:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857868.325735:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057b2a182 reply state 00000000a16062b4 transno 4294968205 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857868.325744:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857868.325876:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:31544:x1874704171791616:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 460us (661us total) trans 4294968205 rc 0/0 00000100:00100000:0.0:1787857868.325884:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1363 00000100:00100000:2.0:1787857868.334335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857868.335405:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.335419:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.335427:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.335434:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857868.335440:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.335448:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.335475:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857868.335479:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857868.335486:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.335492:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d8ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857868.339917:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171791744 00000100:00100000:1.0:1787857868.339934:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171791744 00000100:00100000:1.0:1787857868.340016:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1364 00000100:00100000:1.0:1787857868.343588:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:31544:x1874704171791744:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857868.343621:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857868.343651:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4107 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.343730:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 58 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.343753:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 58 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.343765:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857868.343768:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857868.343786:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1494000, rc 0) 00000100:00100000:1.0:1787857868.343882:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:31544:x1874704171791744:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 322us (9557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857868.343891:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1364 00000100:00100000:0.0:1787857868.355012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.355093:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171791872 00000100:00100000:2.0:1787857868.355103:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171791872 00000100:00100000:2.0:1787857868.355167:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 273 00000100:00100000:2.0:1787857868.355177:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:31544:x1874704171791872:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787857868.355334:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:31544:x1874704171791872:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 159us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857868.355353:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 273 00000100:00100000:3.0:1787857868.362044:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.363261:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171792128 00000100:00100000:2.0:1787857868.363277:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171792128 00000100:00100000:0.0:1787857868.363458:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 274 00000100:00100000:0.0:1787857868.363472:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:31544:x1874704171792128:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857868.363934:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:31544:x1874704171792128:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 463us (1909us total) trans 4294968206 rc 0/0 00000100:00100000:0.0:1787857868.363943:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 274 00000100:00100000:3.0:1787857868.367594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.367742:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171792384 00000100:00100000:1.0:1787857868.367754:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171792384 00000100:00100000:1.0:1787857868.367918:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1365 00000100:00100000:1.0:1787857868.367930:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:31544:x1874704171792384:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857868.368065:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:31544:x1874704171792384:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 137us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857868.368073:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1365 00000100:00100000:2.0:1787857868.373078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857868.373581:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171792640 00000100:00100000:3.0:1787857868.373593:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171792640 00000100:00100000:3.0:1787857868.373675:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1366 00000100:00100000:3.0:1787857868.373686:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:31544:x1874704171792640:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857868.373712:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857868.373737:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d8b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd410e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.373896:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.373913:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 60 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.373922:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.373957:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 60 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.373970:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 60 pid: 7656 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857868.373984:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188283904:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857868.374072:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857868.382120:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.382245:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171792768 00000100:00100000:1.0:1787857868.382252:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171792768 00010000:00010000:1.0:1787857868.382301:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 61 pid: 7656 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857868.382332:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:1.0:1787857868.382345:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:2350:x1874704171792768:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857868.382358:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857868.382362:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 61 pid: 7656 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.382372:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 61 pid: 7656 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.382392:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857868.382396:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.382403:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.382408:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.382422:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857868.382465:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:2350:x1874704171792768:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857868.382473:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 409 00010000:00010000:2.0:1787857868.383250:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4107 expref: 60 pid: 7656 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.383271:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188283904:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857868.383292:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383301:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383307:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857868.383331:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00000004:00080000:2.0:1787857868.383556:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:2.0:1787857868.383719:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383726:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383731:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383735:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857868.383738:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383743:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383752:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857868.383754:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857868.383757:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383760:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d8c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383857:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d8b9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd410e expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383868:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9998c3379700) 00010000:00010000:2.0:1787857868.383871:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857868.383875:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d8b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd410e expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.383885:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72a00, rc 0) 00000100:00100000:2.0:1787857868.383938:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:31544:x1874704171792640:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 10254us (10869us total) trans 4294968207 rc 301/301 00000100:00100000:2.0:1787857868.383946:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1366 00000100:00100000:3.0:1787857868.386957:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.387039:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171793024 00000100:00100000:2.0:1787857868.387051:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171793024 00000100:00100000:2.0:1787857868.387147:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 275 00000100:00100000:2.0:1787857868.387158:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:31544:x1874704171793024:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857868.387764:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:31544:x1874704171793024:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 606us (817us total) trans 4294968208 rc 0/0 00000100:00100000:2.0:1787857868.387784:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 275 00000100:00100000:3.0:1787857868.391007:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.391154:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171793152 00000100:00100000:1.0:1787857868.391164:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171793152 00000100:00100000:1.0:1787857868.391230:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1367 00000100:00100000:1.0:1787857868.391242:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:31544:x1874704171793152:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857868.391268:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857868.391292:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7d8ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4115 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.391376:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.391390:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.391402:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857868.391446:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00000004:00200000:1.0:1787857868.391450:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857868.391473:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.391514:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7d8ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4115 expref: 62 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.391536:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4115 expref: 61 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.391551:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857868.391554:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787857868.391567:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1494000, rc 0) 00000100:00100000:1.0:1787857868.391642:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:31544:x1874704171793152:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 395us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857868.391650:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1367 00000100:00100000:0.0:1787857868.400876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.401157:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171793280 00000100:00100000:1.0:1787857868.401167:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171793280 00000100:00100000:1.0:1787857868.401264:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 378 00000100:00100000:1.0:1787857868.401277:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171793280:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857868.401299:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857868.401322:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd411c expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857868.401351:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857868.401377:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=692s v=(0 0) 00010000:00010000:1.0:1787857868.401382:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857868.401392:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 11 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.401413:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 11 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.401429:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1495400, rc 0) 00000100:00100000:1.0:1787857868.401496:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171793280:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 223us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857868.401504:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 378 00000100:00080000:0.0:1787857868.401583:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857868.405372:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.405698:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171793536 00000100:00100000:1.0:1787857868.405709:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171793536 00000100:00100000:1.0:1787857868.405785:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1368 00000100:00100000:1.0:1787857868.405796:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:31544:x1874704171793536:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857868.405943:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:31544:x1874704171793536:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 149us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857868.405950:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1368 00000100:00100000:3.0:1787857868.409457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.409545:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171793664 00000100:00100000:2.0:1787857868.409556:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171793664 00000100:00100000:2.0:1787857868.409617:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 379 00000100:00100000:2.0:1787857868.409629:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:31544:x1874704171793664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857868.409651:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857868.409675:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4123 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.409795:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.409811:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857868.409852:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857868.409860:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.409898:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.409913:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 12 pid: 8490 timeout: 792 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.409928:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188284032:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857868.410103:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7067300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857868.416216:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188284032:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857868.416255:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.416279:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52a00, rc 0) 00000100:00100000:3.0:1787857868.416358:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:31544:x1874704171793664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6730us (6910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857868.416366:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 379 00000100:00100000:3.0:1787857868.418958:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857868.419160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171793792 00000100:00100000:0.0:1787857868.419169:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171793792 00010000:00010000:0.0:1787857868.419212:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 12 pid: 8490 timeout: 792 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857868.419259:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 410 00000100:00100000:0.0:1787857868.419269:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171793792:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857868.419286:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857868.419317:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 12 pid: 8490 timeout: 792 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.419332:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 12 pid: 8490 timeout: 792 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.421435:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fac616e4/0xd3f183cab4a7d8dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd411c expref: 12 pid: 8490 timeout: 792 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.421459:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857868.421464:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857868.421474:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.421485:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.421539:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857868.421557:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188284160:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857868.421647:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4f55540 going to sleep for 11 seconds 00000100:00100000:1.0:1787857868.425753:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188284160:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857868.425794:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857868.426328:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171793792:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 7058us (7376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857868.426340:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 410 00000100:00100000:2.0:1787857868.427492:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857868.427576:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171793920 00000100:00100000:3.0:1787857868.427586:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171793920 00002000:00100000:3.0:1787857868.427642:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (0->157) req@ffff999900d4d2c0 x1874704171793920/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:514/0 lens 648/0 e 0 to 0 dl 1787857879 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857868.427653:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999900d4d2c0 with x1874704171793920 ext(0->157) 00002000:00010000:3.0:1787857868.427659:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999900d4d2c0 00000100:00100000:3.0:1787857868.427737:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 118 00000100:00100000:3.0:1787857868.427749:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171793920:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787857868.429230:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171793920:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 1476us (1734us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1787857868.429241:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 118 00002000:00100000:3.0:1787857868.429250:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (0->157) req@ffff999900d4d2c0 x1874704171793920/t4294967380(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:514/0 lens 648/448 e 0 to 0 dl 1787857879 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857868.429260:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999900d4d2c0 with x1874704171793920 ext(0->157) 00002000:00010000:3.0:1787857868.429265:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff999900d4d2c0 00000100:00100000:3.0:1787857868.432587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.432654:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171794048 00000100:00100000:2.0:1787857868.432664:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171794048 00000100:00100000:2.0:1787857868.432802:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1369 00000100:00100000:2.0:1787857868.432863:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:31544:x1874704171794048:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787857868.513645:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:31544:x1874704171794048:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 80820us (81054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857868.513659:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1369 00000001:00080000:3.0:1787857868.513760:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968206 is committed 00000001:00080000:3.0:1787857868.513803:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968202 is committed 00000020:00080000:3.0:1787857868.513855:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c2a8b180 refcount 2 committed 0 result 0 batchid 31 00000020:00080000:3.0:1787857868.513860:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998ffaec000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998c2a8bb40 00000020:00080000:3.0:1787857868.513863:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998ffaec300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c5c5d000 00000001:00080000:3.0:1787857868.513882:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968208 is committed 00000004:00080000:3.0:1787857868.513891:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000100:00100000:3.0:1787857868.514025:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188284288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787857868.514082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857868.514155:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188284288 00000100:00100000:3.0:1787857868.514163:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188284288 00000100:00100000:3.0:1787857868.514209:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787857868.514218:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188284288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787857868.514242:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:26 count 1 00002000:00010000:3.0:1787857868.514273:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a908bc9, atime: 0x0, ctime: 0x6a908bc9, blocks: 0x1 00010000:00010000:3.0:1787857868.514281:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.514298:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1787857868.514302:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857868.514307:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.514319:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.514327:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.514335:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.514351:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857868.514376:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857868.514384:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.514393:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857868.514397:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.514406:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.514423:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.514431:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b858a4/0xd3f183cab4a7d8ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.514452:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857868.514454:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857868.514456:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787857868.514617:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 31 committed batchid 30 00000020:00080000:2.0:1787857868.514843:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000100:00100000:3.0:1787857868.516337:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874704188284288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2114us (2248us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787857868.516349:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000004:00080000:0.0:1787857868.516521:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998e185da40/2, rc 0, transno 4294967370 00000100:00100000:0.0:1787857868.516528:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188284288:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787857868.519718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857868.520057:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171794176 00000100:00100000:0.0:1787857868.520077:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171794176 00000100:00100000:0.0:1787857868.520375:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 381 00000100:00100000:0.0:1787857868.520388:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171794176:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787857868.526359:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787857868.559707:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967380 is committed 00000100:00100000:0.0:1787857868.559975:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171794176:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 39584us (40261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857868.559987:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 381 00000100:00100000:1.0:1787857868.561865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.562084:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171794432 00000100:00100000:2.0:1787857868.562094:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171794432 00000100:00100000:2.0:1787857868.562161:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1370 00000100:00100000:2.0:1787857868.562171:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:31544:x1874704171794432:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857868.562228:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857868.562254:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d8d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4115 expref: 50 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.562274:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857868.562278:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857868.562306:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.562605:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.562617:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857868.563293:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049cb5dc4 reply state 000000000720599f transno 4294968209 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.563304:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857868.565309:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:31544:x1874704171794432:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 3126us (3438us total) trans 4294968209 rc 0/0 00000100:00100000:2.0:1787857868.565340:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1370 00010000:00010000:0.0:1787857868.568332:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.568354:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.568363:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.568369:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857868.568374:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.568382:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.568403:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857868.568410:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857868.568416:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.568423:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7d8f1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857868.569016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857868.569155:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171794560 00000100:00100000:0.0:1787857868.569167:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171794560 00000100:00100000:0.0:1787857868.569341:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1371 00000100:00100000:0.0:1787857868.569353:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:31544:x1874704171794560:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857868.569383:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857868.569403:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd412a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.569484:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.569500:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.569521:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857868.569525:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857868.569529:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857868.569668:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:31544:x1874704171794560:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 316us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857868.569680:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1371 00000100:00100000:3.0:1787857868.572184:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.572303:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171794688 00000100:00100000:2.0:1787857868.572312:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171794688 00000100:00100000:2.0:1787857868.572409:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 382 00000100:00100000:2.0:1787857868.572420:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171794688:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787857868.572687:0:14028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787857868.572690:0:14028:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb mtime from disk: 0 -> 1787857865 00002000:00010000:2.0:1787857868.572693:0:14028:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb atime from disk: 0 -> 1787857865 00002000:00010000:2.0:1787857868.572695:0:14028:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb ctime from disk: 0 -> 1787857865 00002000:00010000:2.0:1787857868.572697:0:14028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787857868.572761:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171794688:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 343us (585us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1787857868.572780:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 382 00000100:00100000:3.0:1787857868.574656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.574739:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171794944 00000100:00100000:2.0:1787857868.574746:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171794944 00000100:00100000:2.0:1787857868.574812:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1372 00000100:00100000:2.0:1787857868.575063:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:31544:x1874704171794944:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787857868.575125:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.575143:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.575157:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 4/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.575278:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.575295:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 51 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857868.575369:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188284416:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857868.575455:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857868.577384:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857868.577998:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188284416:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857868.578026:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.578286:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171795072 00000100:00100000:2.0:1787857868.578294:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171795072 00010000:00010000:2.0:1787857868.578330:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 52 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.578407:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 411 00000100:00100000:2.0:1787857868.578418:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171795072:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857868.578434:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857868.578441:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 52 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.578454:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 52 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.578477:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d8a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4100 expref: 52 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.578492:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857868.578497:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.578506:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.578514:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.578538:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857868.578597:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171795072:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 180us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857868.578605:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 411 00010000:00010000:3.0:1787857868.578951:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.578959:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.578987:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.578995:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.579001:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.579007:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857868.579012:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.579019:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.579029:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857868.579032:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787857868.579036:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.579042:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7d8ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857868.579100:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:31544:x1874704171794944:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 4040us (4448us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787857868.579109:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1372 00000100:00100000:1.0:1787857868.581402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857868.581482:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171795200 00000100:00100000:3.0:1787857868.581490:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171795200 00000100:00100000:3.0:1787857868.581546:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 383 00000100:00100000:3.0:1787857868.581556:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171795200:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857868.581596:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.581615:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.581625:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857868.581629:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857868.581634:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.581666:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 12 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.581680:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 12 pid: 14028 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857868.581694:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188284544:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857868.581812:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c1254e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857868.584748:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188284544:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857868.584788:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857868.585311:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857868.585920:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171795328 00000100:00100000:3.0:1787857868.585929:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171795328 00010000:00010000:3.0:1787857868.585961:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 13 pid: 14028 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857868.585999:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 412 00000100:00100000:3.0:1787857868.586008:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171795328:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857868.586023:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857868.586043:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 13 pid: 14028 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.586056:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 13 pid: 14028 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.586089:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f338a0b3/0xd3f183cab4a7d8e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4123 expref: 13 pid: 14028 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.586105:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857868.586109:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857868.586115:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.586125:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857868.586149:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857868.586202:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171795328:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 195us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857868.586212:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 412 00010000:00010000:0.0:1787857868.586615:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.586627:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.586652:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.586661:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.586668:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.586675:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857868.586679:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.586688:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.586700:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.586714:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d22b976/0xd3f183cab4a7d906 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857868.586761:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171795200:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 5206us (5366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857868.586780:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 383 00000100:00100000:0.0:1787857868.592641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.592724:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171795584 00000100:00100000:2.0:1787857868.592733:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171795584 00000100:00100000:2.0:1787857868.592802:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1373 00000100:00100000:2.0:1787857868.592812:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:31544:x1874704171795584:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857868.592935:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.592954:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.593037:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.593267:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.593278:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.593287:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.593327:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.593341:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 51 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.593356:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188284672:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857868.593468:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857868.596558:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.596639:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188284672:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857868.596663:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171795712 00010000:00010000:1.0:1787857868.596670:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857868.596671:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171795712 00010000:00010000:0.0:1787857868.596712:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 52 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857868.596743:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:0.0:1787857868.596753:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171795712:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857868.596780:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857868.596787:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 52 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.596799:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 52 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.596859:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d8f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd412a expref: 52 pid: 5858 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.596875:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857868.596881:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.596890:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.596898:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.596918:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857868.596980:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171795712:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 227us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857868.596988:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 413 00010000:00010000:2.0:1787857868.597721:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.597734:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857868.597957:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968210 00000001:00080000:2.0:1787857868.598114:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968211 00000001:00080000:2.0:1787857868.598158:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968212 00000100:00100000:2.0:1787857868.598249:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188284800:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787857868.598311:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857868.598346:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085600 going to sleep for 11 seconds 00000100:00100000:1.0:1787857868.598935:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188284800 00000100:00100000:1.0:1787857868.598942:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188284800 00000100:00100000:1.0:1787857868.598990:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787857868.598999:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188284800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787857868.599093:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188284800:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857868.599100:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787857868.599307:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188284800:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787857868.599941:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968213 00000100:00100000:2.0:1787857868.600008:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188284928:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787857868.600046:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857868.600175:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857868.600212:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188284928 00000100:00100000:1.0:1787857868.600217:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188284928 00000100:00100000:1.0:1787857868.600417:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787857868.600428:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7656:x1874704188284928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787857868.600634:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7656:x1874704188284928:12345-0@lo:1000:mdt00_003.0 Request processed in 208us (586us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1787857868.600640:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787857868.600703:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7656:1874704188284928:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787857868.600793:0:7656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968214 00010000:00010000:2.0:1787857868.600855:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600866:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600873:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600880:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857868.600885:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600897:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600913:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857868.600916:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857868.600921:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600926:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d914 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600962:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600968:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600974:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600979:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857868.600981:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600985:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.600990:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9998d12eff00) 00010000:00010000:2.0:1787857868.600992:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857868.601000:0:7656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494c00/0xd3f183cab4a7d849 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40eb expref: 101 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.601015:0:7656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494c00/0xd3f183cab4a7d849 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40eb expref: 101 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.601023:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494c00/0xd3f183cab4a7d849 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40eb expref: 101 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857868.601049:0:7656:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494c00/0xd3f183cab4a7d849 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd40eb expref: 101 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857868.601072:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188285056:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857868.601143:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857868.604662:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188285056:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857868.604692:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604703:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7d842 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604734:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604749:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604761:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604782:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604789:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604796:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604802:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857868.604806:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604813:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604861:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9998d12eff00) 00010000:00010000:1.0:1787857868.604865:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857868.604869:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604875:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d91b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604885:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604892:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604901:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604907:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857868.604909:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604915:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604923:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff9998d12eff00) 00010000:00010000:1.0:1787857868.604925:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857868.604928:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.604934:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7d90d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857868.605173:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:31544:x1874704171795584:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 12361us (12545us total) trans 4294968215 rc 0/0 00000100:00100000:1.0:1787857868.605184:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1373 00000020:00080000:1.0:1787857868.605190:0:7656:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787857868.605752:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857868.605758:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857868.606588:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787857868.606599:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857868.609628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.609943:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171795968 00000100:00100000:1.0:1787857868.609953:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171795968 00000100:00100000:1.0:1787857868.610007:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 276 00000100:00100000:1.0:1787857868.610017:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c600a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:31544:x1874704171795968:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787857868.610973:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x29:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787857868.611355:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968216 00010000:00010000:1.0:1787857868.611408:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.611426:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.611440:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.611450:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.611458:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.611882:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857868.611948:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857868.612057:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c600a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:31544:x1874704171795968:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 2039us (2436us total) trans 4294968217 rc 0/0 00000100:00100000:1.0:1787857868.612076:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 276 00000020:00080000:1.0:1787857868.612082:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857868.612799:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857868.612809:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.612842:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1495e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857868.612846:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.612854:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.612868:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff9998e1a0cf00) 00010000:00010000:0.0:1787857868.612871:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857868.612876:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.612881:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d922 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.612905:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857868.612907:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857868.612908:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857868.614556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.615058:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171796096 00000100:00100000:2.0:1787857868.615120:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171796096 00000100:00100000:3.0:1787857868.615362:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 277 00000100:00100000:3.0:1787857868.615373:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:31542:x1874704171796096:12345-192.168.204.36@tcp:49:lseek_test.0 00000100:00100000:3.0:1787857868.615518:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:31542:x1874704171796096:12345-192.168.204.36@tcp:49:lseek_test.0 Request processed in 148us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857868.615527:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 277 00000100:00100000:2.0:1787857868.618072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857868.618179:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171796224 00000100:00100000:0.0:1787857868.618187:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171796224 00000100:00100000:0.0:1787857868.618339:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 384 00000100:00100000:0.0:1787857868.618348:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+14:31542:x1874704171796224:12345-192.168.204.36@tcp:101:lseek_test.0 00010000:00010000:0.0:1787857868.618364:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857868.618384:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7d929 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4131 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857868.618409:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 158, mtime: 0x6a908bc9, atime: 0x6a908bc9, ctime: 0x6a908bc9, blocks: 0xb 00010000:00010000:0.0:1787857868.618431:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1787857868.618435:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857868.618443:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7d929 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4131 expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.618459:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097f87a68/0xd3f183cab4a7d929 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4131 expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857868.618576:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71e00, rc 0) 00000100:00100000:0.0:1787857868.618626:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:31542:x1874704171796224:12345-192.168.204.36@tcp:101:lseek_test.0 Request processed in 279us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857868.618633:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 384 00000100:00080000:1.0:1787857868.619140:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857868.621518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857868.621596:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171796352 00000100:00100000:2.0:1787857868.621606:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171796352 00000100:00100000:2.0:1787857868.621670:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 385 00000100:00100000:2.0:1787857868.621681:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171796352:12345-192.168.204.36@tcp:23:lseek_test.0 00000001:00080000:1.0:1787857868.649534:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967382 is committed 00000001:00080000:1.0:1787857868.649557:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967381 is committed 00000100:00100000:3.0:1787857868.653540:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:2349:x1874704171796352:12345-192.168.204.36@tcp:23:lseek_test.0 Request processed in 31848us (32018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857868.653624:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 385 00000100:00100000:3.0:1787857868.657445:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857868.658278:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171796608 00000100:00100000:1.0:1787857868.658290:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171796608 00000100:00100000:1.0:1787857868.658448:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 278 00000100:00100000:1.0:1787857868.658459:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+102:31542:x1874704171796608:12345-192.168.204.36@tcp:35:lseek_test.0 00000100:00100000:1.0:1787857868.658928:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+103:31542:x1874704171796608:12345-192.168.204.36@tcp:35:lseek_test.0 Request processed in 470us (1493us total) trans 4294968218 rc 0/0 00000100:00100000:1.0:1787857868.658936:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 278 00000040:00080000:2.0:1787857869.311639:0:21897:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857869.311649:0:21897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857869.311779:0:21897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 4 00000040:00080000:2.0:1787857869.311787:0:21897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857869.398314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857869.398368:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857869.398395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857869.398416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857869.398435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857869.398472:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857869.398511:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171796992 00000100:00100000:2.0:1787857869.398520:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171796992 00000100:00100000:2.0:1787857869.398563:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171797248 00000100:00100000:2.0:1787857869.398566:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171797248 00000100:00100000:2.0:1787857869.398590:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171796864 00000100:00100000:2.0:1787857869.398593:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171796864 00000100:00100000:2.0:1787857869.398607:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171797376 00000100:00100000:2.0:1787857869.398609:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171797376 00000100:00100000:2.0:1787857869.398625:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 509 00000100:00100000:2.0:1787857869.398635:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2350:x1874704171796992:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857869.398811:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171796736 00000100:00100000:3.0:1787857869.398833:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171796736 00000100:00100000:3.0:1787857869.398863:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 612 00000100:00100000:3.0:1787857869.398871:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171796736:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857869.398900:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171796736:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857869.398907:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 612 00000100:00100000:3.0:1787857869.398941:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 510 00000100:00100000:3.0:1787857869.398949:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171797248:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857869.398975:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171797248:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857869.398982:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 510 00000100:00100000:3.0:1787857869.399004:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 511 00000100:00100000:3.0:1787857869.399010:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171796864:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857869.399047:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171796864:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857869.399053:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 511 00000100:00100000:3.0:1787857869.399068:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 512 00000100:00100000:3.0:1787857869.399074:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171797376:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857869.399098:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171797376:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857869.399104:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 512 00000100:00100000:2.0:1787857869.399477:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2350:x1874704171796992:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 843us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857869.399589:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 509 00000100:00100000:2.0:1787857869.399615:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171797120 00000100:00100000:2.0:1787857869.399620:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171797120 00000100:00100000:2.0:1787857869.399708:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 491 00000100:00100000:2.0:1787857869.399927:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:2350:x1874704171797120:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857869.399966:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:2350:x1874704171797120:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 43us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857869.399973:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 491 00000100:00080000:2.0:1787857869.404873:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857869.550103:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857870.267555:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00000001:00080000:1.0:1787857870.267580:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00010000:00010000:0.0:1787857870.574406:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857870.708230:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857870.708255:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188285184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857870.708320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857870.708384:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188285184 00000100:00100000:3.0:1787857870.708392:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188285184 00000100:00100000:3.0:1787857870.708463:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787857870.708473:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188285184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857870.708508:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 90112000 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857870.709147:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188285184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 674us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857870.709155:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787857870.709196:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967370 gen 2 00000004:00080000:3.0:1787857870.709202:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967369 committed transno 4294967370 00000004:00080000:3.0:1787857870.709218:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9998e185da40, transno 4294967370 00000100:00100000:3.0:1787857870.709238:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188285184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787857870.710145:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787857871.598446:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857872.249843:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857872.249868:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188285312:0@lo:400:kworker.0 00000100:00100000:0.0:1787857872.249946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857872.250080:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188285440:0@lo:400:kworker.0 00000100:00100000:3.0:1787857872.250118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857872.250167:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188285312 00000100:00100000:3.0:1787857872.250176:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188285312 00000100:00100000:3.0:1787857872.250226:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1787857872.250238:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188285312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857872.250299:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188285312:12345-0@lo:400:kworker.0 Request processed in 62us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857872.250307:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1787857872.250343:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188285440 00000100:00100000:3.0:1787857872.250347:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188285440 00000100:00100000:3.0:1787857872.250382:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1787857872.250389:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188285440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857872.250438:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188285440:12345-0@lo:400:kworker.0 Request processed in 50us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857872.250445:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1787857872.250492:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188285440:0@lo:400:kworker.0 00000100:00100000:0.0:1787857872.261278:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188285312:0@lo:400:kworker.0 00000100:00100000:1.0:1787857872.264843:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188285696:0@lo:400:kworker.0 00000100:00100000:1.0:1787857872.264920:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857872.264980:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857872.264985:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188285824:0@lo:400:kworker.0 00000100:00100000:1.0:1787857872.265011:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857872.265043:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188285824 00000100:00100000:1.0:1787857872.265050:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188285824 00000100:00100000:0.0:1787857872.266247:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188285568:0@lo:400:kworker.0 00000100:00100000:0.0:1787857872.266305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857872.266398:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857872.266404:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188285952:0@lo:400:kworker.0 00000100:00100000:3.0:1787857872.266793:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188285696 00000100:00100000:3.0:1787857872.266802:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188285696 00000100:00100000:1.0:1787857872.269455:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188285568 00000100:00100000:1.0:1787857872.269469:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188285568 00000100:00100000:0.0:1787857872.269604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857872.269657:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188285952 00000100:00100000:0.0:1787857872.269661:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188285952 00000100:00100000:3.0:1787857872.275290:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1787857872.275290:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1787857872.275313:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188285824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857872.275314:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188285696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857872.277130:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1787857872.277146:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188285952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857872.294253:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188285696:12345-0@lo:400:kworker.0 Request processed in 18937us (29319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857872.294271:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1787857872.294313:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188285824:12345-0@lo:400:kworker.0 Request processed in 19007us (29297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857872.294325:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1787857872.294338:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1787857872.294356:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188285568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787857872.294356:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857872.294365:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857872.294370:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857872.294420:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188285824:0@lo:400:kworker.0 00000100:00100000:1.0:1787857872.294432:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188285696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857872.301337:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188285952:12345-0@lo:400:kworker.0 Request processed in 24187us (31729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857872.301354:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1787857872.301442:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967382 gen 2 00000004:00080000:0.0:1787857872.301448:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967382 committed transno 4294967382 00000100:00100000:0.0:1787857872.301469:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188285952:0@lo:400:kworker.0 00000100:00100000:3.0:1787857872.301642:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188285568:12345-0@lo:400:kworker.0 Request processed in 7293us (35335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857872.301651:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1787857872.302117:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188285568:0@lo:400:kworker.0 00010000:00010000:2.0:1787857872.624058:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857872.750037:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857872.750063:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188286080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857872.750137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857872.750384:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188286080 00000100:00100000:2.0:1787857872.750393:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188286080 00000100:00100000:2.0:1787857872.750697:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787857872.750710:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188286080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857872.750749:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857872.750804:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188286080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857872.750812:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787857872.751044:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188286080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857873.646701:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857873.710850:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857873.710859:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857873.711159:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 3 00000040:00080000:3.0:1787857873.711166:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787857873.849373:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968218 is committed 00000001:00080000:3.0:1787857873.849395:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968217 is committed 00000020:00080000:3.0:1787857873.849413:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c7085600 refcount 2 committed 0 result 0 batchid 32 00000020:00080000:3.0:1787857873.849419:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c6e0f000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998c70859c0 00000020:00080000:3.0:1787857873.849423:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c6e0fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9997c515e800 00000020:00080000:3.0:1787857873.849446:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 31 batchid updated 00000020:00080000:2.0:1787857873.849903:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 32 committed batchid 31 00000020:00080000:2.0:1787857873.850122:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 31 00000100:00100000:2.0:1787857874.529108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857874.529167:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857874.529192:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171797760 00000100:00100000:1.0:1787857874.529192:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171797504 00000100:00100000:2.0:1787857874.529200:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171797760 00000100:00100000:1.0:1787857874.529200:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171797504 00000100:00100000:1.0:1787857874.529247:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 614 00000100:00100000:2.0:1787857874.529249:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 515 00000100:00100000:2.0:1787857874.529257:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171797760:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857874.529257:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171797504:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857874.529326:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171797504:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857874.529335:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 614 00000100:00100000:2.0:1787857874.529407:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171797760:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 151us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857874.529415:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 515 00000100:00080000:2.0:1787857874.529438:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857874.529471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857874.529494:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171798016 00000100:00100000:2.0:1787857874.529498:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171798016 00000100:00100000:2.0:1787857874.529533:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 495 00000100:00100000:2.0:1787857874.529540:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2347:x1874704171798016:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857874.529567:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2347:x1874704171798016:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857874.529574:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 495 00000100:00080000:2.0:1787857874.529588:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857874.530883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857874.530926:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857874.530947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857874.530966:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857874.531000:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171797632 00000100:00100000:1.0:1787857874.531006:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171797632 00000100:00100000:1.0:1787857874.531049:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 496 00000100:00100000:1.0:1787857874.531057:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+102:2347:x1874704171797632:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857874.531115:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+102:2347:x1874704171797632:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 59us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857874.531122:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 496 00000100:00100000:1.0:1787857874.531141:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171798272 00000100:00100000:1.0:1787857874.531144:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171798272 00000100:00100000:1.0:1787857874.531175:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171797888 00000100:00100000:1.0:1787857874.531178:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171797888 00000100:00100000:1.0:1787857874.531193:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171798144 00000100:00100000:1.0:1787857874.531196:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171798144 00000100:00100000:1.0:1787857874.531213:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 516 00000100:00100000:1.0:1787857874.531219:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171798272:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857874.531243:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171798272:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857874.531251:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 516 00000100:00100000:1.0:1787857874.531262:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 517 00000100:00100000:1.0:1787857874.531267:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171797888:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857874.531287:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171797888:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857874.531293:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 517 00000100:00100000:1.0:1787857874.531303:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 518 00000100:00100000:1.0:1787857874.531309:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171798144:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857874.531329:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171798144:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857874.531335:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 518 00000100:00080000:1.0:1787857874.531441:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857874.531444:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857874.531447:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857874.681576:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857875.033019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857875.033261:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171798400 00000100:00100000:3.0:1787857875.033271:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171798400 00000100:00100000:3.0:1787857875.033335:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1374 00000100:00100000:3.0:1787857875.033345:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31523:x1874704171798400:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787857875.033455:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:31523:x1874704171798400:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 112us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857875.033464:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1374 00010000:00010000:1.0:1787857875.693980:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857875.822255:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857875.822283:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188286208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857875.822436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857875.822581:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188286208 00000100:00100000:2.0:1787857875.822590:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188286208 00000100:00100000:2.0:1787857875.822668:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787857875.822683:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188286208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857875.822728:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 90112000 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857875.822781:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188286208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857875.822790:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787857875.822911:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188286208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857875.823115:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787857876.725997:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787857877.165414:0:22099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12s: race between restore requests ==== 15:11:14 (1787857874) 00000100:00100000:3.0:1787857877.361980:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188286720:0@lo:400:kworker.0 00000100:00100000:0.0:1787857877.362151:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188286336:0@lo:400:kworker.0 00000100:00100000:0.0:1787857877.362644:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857877.362700:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188286848:0@lo:400:kworker.0 00000100:00100000:0.0:1787857877.362728:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857877.362806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857877.362872:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188286464:0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.362898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857877.362917:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188286976:0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.362943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857877.362963:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857877.362969:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188286592:0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.362991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857877.363126:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188286720 00000100:00100000:0.0:1787857877.363135:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188286720 00000100:00100000:0.0:1787857877.363332:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188286976 00000100:00100000:0.0:1787857877.363335:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188286976 00000100:00100000:0.0:1787857877.363369:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1787857877.363379:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188286720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857877.363518:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188286720:12345-0@lo:400:kworker.0 Request processed in 140us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857877.363525:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1787857877.363546:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1787857877.363553:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188286976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857877.363587:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188286976:12345-0@lo:400:kworker.0 Request processed in 34us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857877.363593:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1787857877.363645:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188286336 00000100:00100000:3.0:1787857877.363649:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188286336 00000100:00100000:3.0:1787857877.363684:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1787857877.363692:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188286336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.363730:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188286336:12345-0@lo:400:kworker.0 Request processed in 39us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857877.363736:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1787857877.363765:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188286848 00000100:00100000:3.0:1787857877.363769:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188286848 00000100:00100000:3.0:1787857877.363793:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188286464 00000100:00100000:3.0:1787857877.363796:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188286464 00000100:00100000:3.0:1787857877.363813:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188286592 00000100:00100000:3.0:1787857877.363841:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188286592 00000100:00100000:3.0:1787857877.363862:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1787857877.363868:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188286848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.363899:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188286848:12345-0@lo:400:kworker.0 Request processed in 32us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857877.363905:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1787857877.363916:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1787857877.363922:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188286464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.363947:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188286464:12345-0@lo:400:kworker.0 Request processed in 25us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857877.363956:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1787857877.363967:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1787857877.363972:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188286592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.363997:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188286592:12345-0@lo:400:kworker.0 Request processed in 26us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857877.364003:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1787857877.364240:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188286592:0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.364256:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188286464:0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.364266:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188286976:0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.364314:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188286336:0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.364326:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188286848:0@lo:400:kworker.0 00000100:00100000:3.0:1787857877.364350:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188286720:0@lo:400:kworker.0 00000100:00080000:0.0:1787857877.364870:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857877.364876:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857877.364879:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857877.651458:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.655977:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171798528 00000100:00100000:3.0:1787857877.656002:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171798528 00000100:00100000:3.0:1787857877.657316:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1375 00000100:00100000:3.0:1787857877.657337:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:32160:x1874704171798528:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787857877.658313:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:32160:x1874704171798528:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 974us (6863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857877.658327:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1375 00000100:00080000:0.0:1787857877.660976:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857877.691142:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857877.691334:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171798656 00000100:00100000:0.0:1787857877.691348:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171798656 00000100:00100000:0.0:1787857877.691457:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1376 00000100:00100000:0.0:1787857877.691469:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:32161:x1874704171798656:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857877.691502:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857877.691534:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4138 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.691643:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.691660:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.691676:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.691693:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.691713:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.691720:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692342:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692354:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692362:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692369:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.692375:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692384:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692399:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:0.0:1787857877.692402:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.692408:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692416:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692431:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692439:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692445:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692451:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.692454:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692461:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692472:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff9997c3d03c00) 00010000:00010000:0.0:1787857877.692475:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.692478:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692484:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d93e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692536:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d930 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4138 expref: 103 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692550:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:0.0:1787857877.692552:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.692556:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4138 expref: 103 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.692567:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:0.0:1787857877.692668:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:32161:x1874704171798656:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1200us (1541us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857877.692679:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1376 00000100:00080000:2.0:1787857877.692919:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857877.700130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857877.700327:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171798912 00000100:00100000:2.0:1787857877.700341:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171798912 00000100:00100000:2.0:1787857877.700421:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1377 00000100:00100000:2.0:1787857877.700434:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+102:32161:x1874704171798912:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:2.0:1787857877.700518:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857877.700558:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7d697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4051 expref: 102 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.700600:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857877.700607:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857877.707213:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.707252:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.707267:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.707323:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 47 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.707343:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 47 pid: 5857 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857877.707367:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188287104:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857877.707501:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857877.710535:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.711942:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188287104:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857877.711984:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857877.712163:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171799040 00000100:00100000:1.0:1787857877.712173:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171799040 00010000:00010000:1.0:1787857877.712238:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 48 pid: 5857 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857877.712369:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 414 00000100:00100000:1.0:1787857877.712382:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2350:x1874704171799040:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857877.712406:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857877.712414:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 48 pid: 5857 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.712436:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 48 pid: 5857 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.712469:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa74a00/0xd3f183cab4a7d6d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4066 expref: 48 pid: 5857 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.712492:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:1.0:1787857877.712497:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.712508:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.712518:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.712553:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857877.712643:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:2350:x1874704171799040:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 262us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857877.712652:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 414 00010000:00010000:3.0:1787857877.712719:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.712727:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.712769:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.712782:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.712790:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857877.714318:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00010000:00010000:3.0:1787857877.714338:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.714350:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.714359:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.714366:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857877.714371:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.714380:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.714399:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:3.0:1787857877.714402:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.714407:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.714413:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7d945 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857877.714439:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0ce38da reply state 000000002d33a344 transno 4294968219 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857877.714450:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857877.714562:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+103:32161:x1874704171798912:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 14126us (14443us total) trans 4294968219 rc 0/0 00000100:00100000:3.0:1787857877.714573:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1377 00010000:00010000:3.0:1787857877.721123:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.721148:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.721157:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.721165:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857877.721172:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.721181:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.721212:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff9998d12ef700) 00010000:00010000:3.0:1787857877.721216:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.721223:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.721230:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d94c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857877.722170:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.722443:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171799168 00000100:00100000:3.0:1787857877.722456:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171799168 00000100:00100000:3.0:1787857877.722544:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1378 00000100:00100000:3.0:1787857877.722556:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+102:32162:x1874704171799168:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857877.722603:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857877.722631:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d953 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd413f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.723045:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d95a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.723066:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.723084:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857877.723179:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857877.723184:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857877.723212:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.723249:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd413f expref: 104 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.723566:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d95a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd413f expref: 103 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.723576:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:3.0:1787857877.723579:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857877.723583:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72a00, rc 0) 00000100:00100000:3.0:1787857877.723761:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+103:32162:x1874704171799168:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1206us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857877.723771:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1378 00000100:00100000:1.0:1787857877.739728:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.739973:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171799296 00000100:00100000:3.0:1787857877.739991:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171799296 00000100:00100000:0.0:1787857877.740338:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1379 00000100:00100000:0.0:1787857877.740355:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+103:32162:x1874704171799296:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857877.740387:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857877.740415:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d961 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4146 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740513:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740532:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740547:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740565:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740573:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740580:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740981:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740991:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.740999:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857877.741117:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:0.0:1787857877.741122:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857877.741155:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741170:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741183:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741190:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741197:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.741201:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741209:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741225:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:0.0:1787857877.741228:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.741234:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741241:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d968 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741257:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741262:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741268:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741274:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.741277:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741284:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741291:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff9997c3d03c00) 00010000:00010000:0.0:1787857877.741294:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.741297:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741302:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d96f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741346:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7d961 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4146 expref: 105 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741361:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70600/0xd3f183cab4a7d976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4146 expref: 104 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.741367:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857877.741370:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857877.741372:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70600, rc 0) 00000100:00100000:0.0:1787857877.741619:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+104:32162:x1874704171799296:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1268us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857877.741629:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1379 00010000:00010000:3.0:1787857877.756380:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857877.756684:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.757266:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171799424 00000100:00100000:3.0:1787857877.757282:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171799424 00000100:00100000:3.0:1787857877.757368:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1380 00000100:00100000:3.0:1787857877.757381:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:32162:x1874704171799424:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857877.757413:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857877.757444:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d97d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd414d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757543:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757563:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757579:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757609:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757618:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757626:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757761:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757769:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757777:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757785:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857877.757790:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757800:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757864:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857877.757867:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.757874:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757883:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757901:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757908:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757915:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757920:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857877.757923:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757930:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757939:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9998d12ef700) 00010000:00010000:3.0:1787857877.757942:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.757944:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757951:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d98b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.757994:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d97d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd414d expref: 105 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.758015:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857877.758018:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.758021:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d97d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd414d expref: 105 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.758033:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857877.758712:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:32162:x1874704171799424:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1325us (2031us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857877.758722:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1380 00000100:00100000:0.0:1787857877.766587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.767329:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171799552 00000100:00100000:3.0:1787857877.767345:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171799552 00000100:00100000:3.0:1787857877.767443:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1381 00000100:00100000:3.0:1787857877.767456:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+47:32163:x1874704171799552:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857877.767486:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857877.767521:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4154 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.767634:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.767652:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.767667:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857877.767753:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787857877.767758:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857877.767789:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.767861:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.767897:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.767907:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:3.0:1787857877.767910:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857877.767915:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72c00, rc 0) 00000100:00100000:3.0:1787857877.768010:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:32163:x1874704171799552:12345-192.168.204.36@tcp:101:rm.0 Request processed in 556us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857877.768019:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1381 00000100:00100000:1.0:1787857877.771990:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857877.772363:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171799680 00000100:00100000:0.0:1787857877.772379:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171799680 00000100:00100000:0.0:1787857877.772470:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1382 00000100:00100000:0.0:1787857877.772484:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:32163:x1874704171799680:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857877.772513:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857877.772542:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d9a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd415b expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772657:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772676:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772690:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772708:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772716:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772724:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772949:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d9b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772959:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.772969:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857877.773016:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:0.0:1787857877.773021:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857877.773069:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773086:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773094:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773102:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773109:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.773114:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773122:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773137:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:0.0:1787857877.773141:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.773146:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773153:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773168:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773181:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773187:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773193:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.773196:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773202:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773210:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff9997c3d03c00) 00010000:00010000:0.0:1787857877.773213:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.773216:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773221:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773262:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7d9a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd415b expref: 50 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773280:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70c00/0xd3f183cab4a7d9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd415b expref: 49 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.773286:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857877.773288:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787857877.773292:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70c00, rc 0) 00000100:00100000:0.0:1787857877.773381:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32163:x1874704171799680:12345-192.168.204.36@tcp:101:rm.0 Request processed in 899us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857877.773391:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1382 00000100:00100000:0.0:1787857877.777304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.778873:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171799808 00000100:00100000:3.0:1787857877.778900:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171799808 00000100:00100000:3.0:1787857877.779002:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1383 00000100:00100000:3.0:1787857877.779016:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32163:x1874704171799808:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857877.779044:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857877.779074:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d9bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4162 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779176:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779196:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779215:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779235:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779243:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779250:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779348:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779355:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779362:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779367:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857877.779373:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779382:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779397:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857877.779400:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.779407:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779414:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7d9c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779431:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779437:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779442:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779448:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857877.779452:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779458:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779466:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9998d12ef700) 00010000:00010000:3.0:1787857877.779469:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.779472:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779477:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7d9ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779517:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d9bc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4162 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779534:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857877.779537:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.779540:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d9bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4162 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.779550:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857877.779653:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32163:x1874704171799808:12345-192.168.204.36@tcp:101:rm.0 Request processed in 639us (2373us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857877.779661:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1383 00000100:00100000:2.0:1787857877.789055:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857877.789244:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171799936 00000100:00100000:1.0:1787857877.789258:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171799936 00000100:00100000:1.0:1787857877.789636:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1384 00000100:00100000:1.0:1787857877.789652:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32163:x1874704171799936:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857877.789684:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857877.789716:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d9d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4169 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.789887:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.789905:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.789918:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.789936:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.789943:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.789950:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790047:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790055:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790061:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790068:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1495e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857877.790072:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790266:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790282:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857877.790419:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857877.790429:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790436:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7d9d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790457:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790463:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790468:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790473:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857877.790476:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790482:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790490:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9998e1a0cc00) 00010000:00010000:1.0:1787857877.790493:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857877.790496:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790507:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7d9df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790558:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d9d1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4169 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790569:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857877.790571:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857877.790575:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7d9d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4169 expref: 50 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.790584:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1494e00, rc 0) 00000100:00100000:1.0:1787857877.791014:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32163:x1874704171799936:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1362us (1982us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857877.791025:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1384 00000100:00100000:1.0:1787857877.806202:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000040:00080000:2.0:1787857877.806491:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857877.806499:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857877.807039:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857877.807050:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857877.807499:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171800064 00000100:00100000:0.0:1787857877.807514:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171800064 00000100:00100000:0.0:1787857877.807604:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1385 00000100:00100000:0.0:1787857877.807617:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32164:x1874704171800064:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857877.807643:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857877.807674:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4170 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.807769:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.807788:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.807802:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.807848:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.807856:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.807863:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808268:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808279:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808286:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808307:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.808311:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808320:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808334:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857877.808338:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.808342:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808349:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7d9ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808366:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808371:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808378:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808384:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.808387:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808393:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808399:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9997c3d03c00) 00010000:00010000:0.0:1787857877.808401:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.808403:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808409:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7d9f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808453:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9e6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4170 expref: 50 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808463:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857877.808465:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.808469:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7d9e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4170 expref: 50 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.808477:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857877.808572:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32164:x1874704171800064:12345-192.168.204.36@tcp:101:cp.0 Request processed in 957us (2386us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857877.808581:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1385 00000100:00100000:0.0:1787857877.811423:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.811564:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171800192 00000100:00100000:3.0:1787857877.811577:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171800192 00000100:00100000:3.0:1787857877.811669:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1386 00000100:00100000:3.0:1787857877.811680:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32164:x1874704171800192:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857877.811706:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857877.811731:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d9fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4177 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.811847:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.811866:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.811879:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.811906:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.811914:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.811920:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812008:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812016:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812024:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812030:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857877.812034:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812042:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812055:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857877.812059:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.812065:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812071:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7da02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812086:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812092:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812097:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812101:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857877.812104:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812109:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812115:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9998d12ef700) 00010000:00010000:3.0:1787857877.812118:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.812120:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812125:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7da09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812162:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d9fb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4177 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812173:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:3.0:1787857877.812175:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857877.812179:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7d9fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4177 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.812193:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857877.812264:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32164:x1874704171800192:12345-192.168.204.36@tcp:101:cp.0 Request processed in 586us (857us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857877.812272:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1386 00000100:00100000:2.0:1787857877.816583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.816754:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171800448 00000100:00100000:3.0:1787857877.816768:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171800448 00000100:00100000:3.0:1787857877.816875:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1387 00000100:00100000:3.0:1787857877.816887:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32164:x1874704171800448:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857877.816916:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857877.816946:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7da10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd417e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.817139:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.817159:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.817175:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.817195:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.817203:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.817210:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857877.818254:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:2.0:1787857877.820268:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820443:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820460:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820517:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820525:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820533:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820541:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857877.820547:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820557:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820574:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857877.820577:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857877.820584:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820603:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7da17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857877.820626:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040bd4a52 reply state 000000006f6fff11 transno 4294968220 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857877.820638:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857877.820694:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7da10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 52 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820717:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.820725:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:2.0:1787857877.820728:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857877.820730:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091a00, rc 0) 00000100:00100000:2.0:1787857877.821140:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32164:x1874704171800448:12345-192.168.204.36@tcp:101:cp.0 Request processed in 4252us (4572us total) trans 4294968220 rc 0/0 00000100:00100000:2.0:1787857877.821152:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1387 00010000:00010000:0.0:1787857877.828183:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.828208:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.828216:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.828223:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.828229:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.828238:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.828264:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9998d12ef600) 00010000:00010000:0.0:1787857877.828268:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.828276:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.828284:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7da1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857877.828500:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857877.828689:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171800576 00000100:00100000:0.0:1787857877.828705:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171800576 00000100:00100000:0.0:1787857877.828813:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 386 00000100:00100000:0.0:1787857877.828851:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171800576:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857877.828876:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857877.828913:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4185 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857877.828952:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857877.828983:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=701s v=(0 0) 00010000:00010000:0.0:1787857877.828989:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857877.829002:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.829024:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.829038:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857877.829135:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171800576:12345-192.168.204.36@tcp:101:cp.0 Request processed in 286us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857877.829144:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 386 00000100:00080000:2.0:1787857877.829704:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857877.837332:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857877.837418:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171800704 00000100:00100000:3.0:1787857877.837432:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171800704 00000100:00100000:3.0:1787857877.837514:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 387 00000100:00100000:3.0:1787857877.837527:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:32164:x1874704171800704:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857877.837552:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857877.837577:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd418c expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.837630:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.837641:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857877.837646:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857877.837652:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.837695:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857877.837712:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 10 pid: 6713 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857877.837730:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188287232:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857877.837880:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fd0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857877.840652:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188287232:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857877.840706:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857877.840734:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:1.0:1787857877.840865:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:32164:x1874704171800704:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3339us (3549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857877.840878:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 387 00000100:00100000:1.0:1787857877.843328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857877.843422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171800832 00000100:00100000:0.0:1787857877.843433:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171800832 00010000:00010000:0.0:1787857877.843493:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 10 pid: 6713 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857877.843546:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 415 00000100:00100000:0.0:1787857877.843557:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171800832:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857877.843578:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857877.843622:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 10 pid: 6713 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.843645:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 10 pid: 6713 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.843677:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7da33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4185 expref: 10 pid: 6713 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.843699:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857877.843704:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857877.843714:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.843726:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.843775:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857877.843793:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa883c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874704188287360:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857877.843947:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4f55540 going to sleep for 11 seconds 00000100:00100000:1.0:1787857877.849141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857877.849258:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171801088 00000100:00100000:2.0:1787857877.849273:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171801088 00000100:00100000:2.0:1787857877.849360:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00100000:2.0:1787857877.849372:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32164:x1874704171801088:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:0.0:1787857877.850666:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa883c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874704188287360:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857877.850702:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857877.850854:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171800832:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 7297us (7539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857877.850868:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 415 00000100:00100000:1.0:1787857877.851048:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32164:x1874704171801088:12345-192.168.204.36@tcp:35:cp.0 Request processed in 1675us (1920us total) trans 4294968221 rc 0/0 00000100:00100000:1.0:1787857877.851058:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 279 00000100:00100000:0.0:1787857877.870585:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188287488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857877.870709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857877.871475:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188287488 00000100:00100000:2.0:1787857877.871487:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188287488 00000100:00100000:2.0:1787857877.871571:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787857877.871583:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188287488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857877.871653:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857877.877945:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188287488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6339us (7211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857877.877968:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787857877.880154:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188287488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857877.908952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857877.909342:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171801216 00000100:00100000:0.0:1787857877.909356:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171801216 00000100:00100000:0.0:1787857877.909442:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1388 00000100:00100000:0.0:1787857877.909454:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+104:32167:x1874704171801216:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857877.909484:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857877.909734:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7da41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4193 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.909876:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.909905:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.909921:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.909939:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.909947:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.909954:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910092:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910102:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910110:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857877.910153:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00000004:00200000:0.0:1787857877.910159:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857877.910182:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910195:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910204:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910211:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910218:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910224:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.910229:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910237:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910252:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857877.910257:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.910264:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910270:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910286:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910600:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910607:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910613:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857877.910616:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910623:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910632:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9997c3d03f00) 00010000:00010000:0.0:1787857877.910635:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857877.910639:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910654:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910707:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7da41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 106 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910723:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 105 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.910732:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:0.0:1787857877.910734:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857877.910737:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:0.0:1787857877.910999:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+105:32167:x1874704171801216:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1546us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857877.911010:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1388 00000100:00100000:2.0:1787857877.916444:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857877.916680:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171801344 00000100:00100000:1.0:1787857877.916695:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171801344 00000100:00100000:1.0:1787857877.916791:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 388 00000100:00100000:1.0:1787857877.916804:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171801344:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857877.916851:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857877.916877:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac616e4/0xd3f183cab4a7da5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd419a expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857877.916976:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188287616:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857877.917107:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998db9f1c00 going to sleep for 11 seconds 00000100:00080000:2.0:1787857877.918856:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1787857877.923452:0:6714:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857877.923477:0:6714:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb mtime: 0 -> 1787857877 00002000:00010000:2.0:1787857877.923481:0:6714:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb atime: 0 -> 1787857877 00002000:00010000:2.0:1787857877.923483:0:6714:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb ctime: 0 -> 1787857877 00000100:00100000:2.0:1787857877.923509:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188287616:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857877.923550:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fac616e4/0xd3f183cab4a7da5d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd419a expref: 17 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.923577:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac616e4/0xd3f183cab4a7da5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd419a expref: 17 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857877.923607:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1495400, rc 0) 00000100:00100000:2.0:1787857877.923689:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171801344:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 6888us (7261us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857877.923699:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 388 00000100:00100000:1.0:1787857877.930769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857877.931155:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171801472 00000100:00100000:0.0:1787857877.931169:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171801472 00000100:00100000:0.0:1787857877.931438:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1389 00000100:00100000:0.0:1787857877.931454:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+105:32167:x1874704171801472:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857877.931557:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857877.931581:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41a1 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.931681:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.931697:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.931709:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857877.931773:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:0.0:1787857877.931778:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857877.933740:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.933790:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7da64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 107 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.933814:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.933859:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857877.933862:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857877.933866:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:0.0:1787857877.933938:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+106:32167:x1874704171801472:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2487us (3184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857877.933947:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1389 00000100:00100000:0.0:1787857877.945134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857877.945867:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171801600 00000100:00100000:1.0:1787857877.945896:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171801600 00000100:00100000:1.0:1787857877.945993:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 389 00000100:00100000:1.0:1787857877.946007:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171801600:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857877.946035:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857877.946061:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f6dd454/0xd3f183cab4a7da72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41a8 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857877.946151:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7047840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188287744:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857877.946279:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998db9f1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857877.950415:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7047840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188287744:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857877.950473:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f6dd454/0xd3f183cab4a7da72 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a8 expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.950505:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f6dd454/0xd3f183cab4a7da72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a8 expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857877.950522:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1495e00, rc 0) 00000100:00100000:0.0:1787857877.950792:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171801600:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4786us (5672us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857877.950807:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 389 00000100:00100000:2.0:1787857877.956450:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857877.956760:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171801856 00000100:00100000:1.0:1787857877.956775:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171801856 00000100:00100000:1.0:1787857877.956919:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1390 00000100:00100000:1.0:1787857877.956933:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:32167:x1874704171801856:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1787857877.957346:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].41, 136 off13768 00000100:00100000:1.0:1787857877.957476:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:32167:x1874704171801856:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 545us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857877.957485:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1390 00010000:00010000:3.0:1787857878.772138:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857878.831364:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857878.831375:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857878.831419:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 4 00000040:00080000:3.0:1787857878.831426:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857878.831798:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d41680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188287872:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857878.833559:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857878.839675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857878.839731:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171801984 00000100:00100000:3.0:1787857878.839742:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171801984 00000100:00100000:3.0:1787857878.839808:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1391 00000100:00100000:3.0:1787857878.839840:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32178:x1874704171801984:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857878.839889:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857878.840018:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32178:x1874704171801984:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 201us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857878.840026:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1391 00000100:00100000:1.0:1787857878.840773:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d41680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188287872:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857878.847401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857878.847795:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171802240 00000100:00100000:0.0:1787857878.847808:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171802240 00000100:00100000:0.0:1787857878.847915:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1392 00000100:00100000:0.0:1787857878.847935:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32178:x1874704171802240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857878.847963:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857878.847991:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7da79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41af expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.848140:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7da80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.848158:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7da80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.848172:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7da80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857878.848187:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:0.0:1787857878.848379:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7da79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41af expref: 55 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.848402:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7da80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41af expref: 54 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.848412:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:0.0:1787857878.848415:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857878.848419:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71c00, rc 0) 00000100:00100000:0.0:1787857878.848494:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32178:x1874704171802240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 562us (1108us total) trans 4294968222 rc 0/0 00000100:00100000:0.0:1787857878.848503:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1392 00000100:00100000:3.0:1787857878.859921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857878.859973:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857878.860358:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171802496 00000100:00100000:0.0:1787857878.860370:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171802496 00000100:00100000:0.0:1787857878.860450:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:0.0:1787857878.860461:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2350:x1874704171802496:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857878.860483:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857878.860521:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7da80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41af expref: 54 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.860547:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:0.0:1787857878.860553:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857878.860636:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2350:x1874704171802496:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 176us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857878.860646:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:1.0:1787857878.862340:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171802368 00000100:00100000:1.0:1787857878.862357:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171802368 00000100:00100000:1.0:1787857878.862442:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 390 00000100:00100000:1.0:1787857878.862454:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171802368:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857878.862512:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.862540:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.862551:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787857878.862556:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857878.862561:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.862617:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.862640:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 9 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857878.862658:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188288000:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857878.862771:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857878.867165:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857878.867377:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188288000:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857878.867415:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857878.867551:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171802624 00000100:00100000:1.0:1787857878.867560:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171802624 00002000:00100000:1.0:1787857878.867640:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->157) req@ffff9998ffa843c0 x1874704171802624/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:524/0 lens 648/0 e 0 to 0 dl 1787857889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857878.867651:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa843c0 with x1874704171802624 ext(0->157) 00010000:00010000:1.0:1787857878.867660:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 10 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.867677:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 10 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857878.867686:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998ffa843c0 00000100:00100000:1.0:1787857878.867727:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:1.0:1787857878.867738:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171802624:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857878.869889:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171802624:12345-192.168.204.36@tcp:4:cp.0 Request processed in 2127us (2715us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787857878.869905:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00002000:00100000:1.0:1787857878.869928:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->157) req@ffff9998ffa843c0 x1874704171802624/t4294967371(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:524/0 lens 648/448 e 0 to 0 dl 1787857889 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857878.869941:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffa843c0 with x1874704171802624 ext(0->157) 00010000:00010000:1.0:1787857878.869951:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 12 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.869972:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 12 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857878.869981:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998ffa843c0 00000100:00100000:3.0:1787857878.885045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857878.885311:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171802752 00000100:00100000:0.0:1787857878.885326:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171802752 00010000:00010000:0.0:1787857878.885392:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 12 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857878.885441:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 416 00000100:00100000:0.0:1787857878.885452:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171802752:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857878.885474:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857878.885507:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 12 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.885526:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 12 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.885558:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d22b976/0xd3f183cab4a7da3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd418c expref: 12 pid: 6711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.885592:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857878.885597:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857878.885605:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.885616:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.885659:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857878.885733:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171802752:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 282us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857878.885742:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 416 00010000:00010000:3.0:1787857878.887385:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857878.887407:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857878.887452:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857878.887461:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857878.887470:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857878.887478:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857878.887482:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857878.887492:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857878.887515:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857878.887524:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7da8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857878.887663:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171802368:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 25205us (27751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857878.887675:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 390 00000100:00100000:0.0:1787857878.905050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857878.905117:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171803008 00000100:00100000:0.0:1787857878.905130:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171803008 00000100:00100000:0.0:1787857878.905203:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1393 00000100:00100000:0.0:1787857878.905216:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32178:x1874704171803008:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857878.905734:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32178:x1874704171803008:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 519us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857878.905749:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1393 00000100:00100000:3.0:1787857878.909452:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857878.910799:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171803136 00000100:00100000:0.0:1787857878.910853:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171803136 00000100:00100000:0.0:1787857878.911049:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 391 00000100:00100000:0.0:1787857878.911062:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171803136:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857878.911094:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857878.911199:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41b6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857878.911238:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a908bd5, atime: 0x0, ctime: 0x6a908bd5, blocks: 0x1 00010000:00010000:0.0:1787857878.911451:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=702s v=(0 0) 00010000:00010000:0.0:1787857878.911459:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857878.911472:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.911497:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857878.911517:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:0.0:1787857878.912609:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171803136:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1541us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857878.912621:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 391 00000100:00100000:0.0:1787857878.938465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857878.938511:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171803392 00000100:00100000:0.0:1787857878.938524:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171803392 00000100:00100000:0.0:1787857878.938608:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1394 00000100:00100000:0.0:1787857878.938621:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32178:x1874704171803392:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857878.938771:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32178:x1874704171803392:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 152us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857878.938778:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1394 00000100:00100000:2.0:1787857878.953389:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857878.953444:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171803520 00000100:00100000:2.0:1787857878.953456:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171803520 00002000:00100000:2.0:1787857878.953526:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1b:0x0] (0->4095) req@ffff999900b2a940 x1874704171803520/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:524/0 lens 488/0 e 0 to 0 dl 1787857889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857878.953539:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999900b2a940 with x1874704171803520 ext(0->4095) 00002000:00010000:2.0:1787857878.953547:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff999900b2a940 00000100:00100000:2.0:1787857878.953592:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 119 00000100:00100000:2.0:1787857878.953604:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171803520:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787857878.959626:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171803520:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 6013us (6362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857878.959640:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 119 00002000:00100000:2.0:1787857878.959649:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1b:0x0] (0->4095) req@ffff999900b2a940 x1874704171803520/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:524/0 lens 488/4536 e 0 to 0 dl 1787857889 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857878.959656:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999900b2a940 with x1874704171803520 ext(0->4095) 00002000:00010000:2.0:1787857878.959662:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff999900b2a940 00000100:00100000:0.0:1787857878.977706:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857878.978262:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171803648 00000100:00100000:1.0:1787857878.978278:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171803648 00000100:00100000:1.0:1787857878.978364:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1395 00000100:00100000:1.0:1787857878.978376:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32178:x1874704171803648:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857878.978408:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857878.978439:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7da9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41bd expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.978492:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.978511:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.978528:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.978672:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7da9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.978700:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 54 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857878.978710:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:1.0:1787857878.978714:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857878.978718:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1494000, rc 0) 00000100:00100000:1.0:1787857878.978798:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32178:x1874704171803648:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 425us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857878.978805:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1395 00000100:00100000:0.0:1787857878.992702:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857878.992756:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171803776 00000100:00100000:0.0:1787857878.992768:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171803776 00000100:00100000:0.0:1787857878.992860:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1396 00000100:00100000:0.0:1787857878.992872:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32178:x1874704171803776:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857878.992928:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857878.993057:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32178:x1874704171803776:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 187us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857878.993066:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1396 00000001:00080000:3.0:1787857879.005337:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968222 is committed 00000020:00080000:3.0:1787857879.005368:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 32 batchid updated 00000001:00080000:3.0:1787857879.005392:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968219 is committed 00000020:00080000:2.0:1787857879.005432:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 32 00000020:00080000:2.0:1787857879.005445:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 32 00000100:00100000:2.0:1787857879.006650:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857879.006882:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171803904 00000100:00100000:0.0:1787857879.006896:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171803904 00000100:00080000:2.0:1787857879.007236:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857879.007325:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00100000:0.0:1787857879.007339:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171803904:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857879.007400:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007423:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787857879.007429:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857879.007436:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007462:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007508:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007517:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007526:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007534:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857879.007539:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007548:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007577:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.007586:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdfc2381/0xd3f183cab4a7daaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.007800:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171803904:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 463us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857879.007809:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 392 00000100:00100000:0.0:1787857879.011192:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857879.011274:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171804160 00000100:00100000:2.0:1787857879.011288:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171804160 00000100:00080000:0.0:1787857879.011358:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857879.011399:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1397 00000100:00100000:2.0:1787857879.011413:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32178:x1874704171804160:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857879.011525:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857879.011546:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857879.011555:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857879.011614:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857879.011633:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 51 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857879.011657:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188288128:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857879.011895:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857879.014899:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188288128:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857879.015075:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.016483:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857879.017306:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171804288 00000100:00100000:1.0:1787857879.017319:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171804288 00010000:00010000:0.0:1787857879.017455:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 52 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.017678:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 417 00000100:00100000:0.0:1787857879.017690:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171804288:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857879.018022:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857879.018033:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 52 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.018051:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 52 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.018091:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7daa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41bd expref: 52 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.018119:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:0.0:1787857879.018126:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.018142:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.018152:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.018193:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857879.018216:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.018225:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.018278:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171804288:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 589us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857879.018288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 417 00010000:00010000:3.0:1787857879.020712:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.020743:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.020753:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.020760:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857879.020766:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.020776:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.020804:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:3.0:1787857879.020807:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857879.020848:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.020857:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dab1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857879.021292:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32178:x1874704171804160:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 9874us (10110us total) trans 4294968223 rc 0/0 00000100:00100000:2.0:1787857879.021306:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1397 00000040:00080000:2.0:1787857879.021457:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857879.021463:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857879.022008:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787857879.022019:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857879.025713:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857879.028249:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171804544 00000100:00100000:3.0:1787857879.028289:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171804544 00000100:00100000:3.0:1787857879.028411:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 280 00000100:00100000:3.0:1787857879.028424:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32178:x1874704171804544:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857879.028956:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32178:x1874704171804544:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 531us (3256us total) trans 4294968224 rc 0/0 00000100:00100000:3.0:1787857879.028967:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 280 00000040:00080000:0.0:1787857879.345408:0:22151:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857879.345425:0:22151:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857879.345488:0:22151:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 4 00000040:00080000:0.0:1787857879.345498:0:22151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857879.429647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857879.436243:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171804672 00000100:00100000:3.0:1787857879.436336:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171804672 00000100:00100000:3.0:1787857879.436503:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00100000:3.0:1787857879.436525:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171804672:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857879.436552:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857879.436589:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41c4 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.436625:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857879.436632:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857879.436643:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.436667:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.436685:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73200, rc 0) 00000100:00100000:3.0:1787857879.438434:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+17:2348:x1874704171804672:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1908us (8789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857879.438448:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 393 00000100:00080000:2.0:1787857879.446669:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857879.453787:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857879.454043:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171804928 00000100:00100000:1.0:1787857879.454055:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171804928 00000100:00080000:3.0:1787857879.454171:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857879.454266:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1398 00000100:00100000:1.0:1787857879.454279:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+105:32179:x1874704171804928:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857879.454318:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857879.454344:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dabf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41cb expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.454480:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7dac6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.454497:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7dac6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.454511:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7dac6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857879.454541:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:1.0:1787857879.454727:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dabf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41cb expref: 108 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.454748:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7dac6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41cb expref: 107 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.454758:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:1.0:1787857879.454762:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857879.454766:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1494e00, rc 0) 00000100:00100000:1.0:1787857879.454877:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+107:32179:x1874704171804928:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 601us (1105us total) trans 4294968225 rc 0/0 00000100:00100000:1.0:1787857879.454886:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1398 00000100:00100000:3.0:1787857879.459076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857879.459226:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171805056 00000100:00100000:0.0:1787857879.459241:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171805056 00000100:00100000:0.0:1787857879.459334:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 394 00000100:00100000:0.0:1787857879.459347:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171805056:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:0.0:1787857879.459404:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.459430:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.459441:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.459452:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857879.459457:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857879.459463:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.459509:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.459645:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 17 pid: 6711 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.459665:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901222940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188288256:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857879.459798:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 10 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.459809:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 10 pid: 6714 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.459848:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188288384:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857879.459876:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c1377c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857879.464803:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901222940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188288256:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857879.464842:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188288384:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857879.464897:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.484328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857879.484412:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857879.484463:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171805312 00000100:00100000:0.0:1787857879.484477:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171805312 00000100:00100000:2.0:1787857879.484955:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171805184 00000100:00100000:2.0:1787857879.484962:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171805184 00010000:00010000:2.0:1787857879.485007:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 18 pid: 6711 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857879.485057:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 418 00000100:00100000:2.0:1787857879.485070:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171805184:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857879.485106:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857879.485142:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 18 pid: 6711 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857879.485164:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 18 pid: 6711 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857879.485196:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ab8ed67/0xd3f183cab4a7dab8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41c4 expref: 18 pid: 6711 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857879.485221:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857879.485310:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171805184:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 241us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857879.485319:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 418 00010000:00010000:0.0:1787857879.485737:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 11 pid: 6714 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.485777:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 419 00000100:00100000:0.0:1787857879.485788:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171805312:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857879.485797:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857879.485810:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 11 pid: 6714 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.486786:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 11 pid: 6714 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.486814:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7da95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41b6 expref: 11 pid: 6714 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.486848:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857879.486855:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857879.486863:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.486876:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.486930:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857879.487700:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171805312:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1909us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857879.487716:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 419 00010000:00010000:0.0:1787857879.488234:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.488249:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.489240:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.489252:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.489603:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.489612:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857879.489617:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.489627:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.489651:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857879.489666:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7dad4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.489780:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171805056:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 30431us (30713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857879.489791:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 394 00000100:00100000:0.0:1787857879.494291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857879.494541:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171805568 00000100:00100000:1.0:1787857879.494563:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171805568 00000100:00100000:1.0:1787857879.494630:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 281 00000100:00100000:1.0:1787857879.494641:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6009c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+107:32179:x1874704171805568:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:1.0:1787857879.494732:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x2a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7dac6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41cb expref: 107 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857879.495081:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968226 00000001:00080000:1.0:1787857879.498444:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968227 00010000:00010000:1.0:1787857879.498571:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.498598:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.498608:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 110 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.498618:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 5/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.498668:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 110 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.498689:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 110 pid: 7656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857879.498708:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188288512:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857879.498860:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857879.498870:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 51 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857879.498884:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188288640:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857879.498911:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900e196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857879.502152:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188288512:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857879.502172:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5860:1874704188288640:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857879.502206:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857879.510982:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857879.511038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857879.511250:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171805824 00000100:00100000:3.0:1787857879.511275:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171805824 00010000:00010000:3.0:1787857879.511339:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 52 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857879.511386:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171805696 00000100:00100000:3.0:1787857879.511390:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171805696 00010000:00010000:3.0:1787857879.511407:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 111 pid: 7656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857879.511435:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 420 00000100:00100000:3.0:1787857879.511446:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171805824:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857879.511468:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857879.511477:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 52 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511497:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 52 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511539:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7da25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd417e expref: 52 pid: 5857 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511572:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:3.0:1787857879.511580:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511590:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511597:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857879.511670:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:2349:x1874704171805824:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 224us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857879.511678:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 420 00000100:00100000:3.0:1787857879.511699:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 421 00000100:00100000:3.0:1787857879.511705:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+111:2349:x1874704171805696:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857879.511715:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857879.511720:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 111 pid: 7656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511732:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 111 pid: 7656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511752:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7da56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4193 expref: 111 pid: 7656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511765:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:3.0:1787857879.511769:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511777:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511786:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.511868:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857879.511888:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+110:2349:x1874704171805696:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 183us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857879.511895:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 421 00010000:00010000:3.0:1787857879.512042:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.512051:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857879.514219:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968228 00000001:00080000:3.0:1787857879.514803:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968229 00000001:00080000:3.0:1787857879.515504:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968230 00000100:00100000:3.0:1787857879.515734:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188288768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787857879.516424:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857879.517608:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857879.517753:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188288768 00000100:00100000:0.0:1787857879.517767:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188288768 00000100:00080000:3.0:1787857879.517964:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857879.518050:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787857879.518084:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188288768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787857879.518270:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188288768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 206us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857879.518279:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787857879.518589:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188288768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787857879.519319:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968231 00000100:00100000:3.0:1787857879.519442:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188288896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787857879.519523:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857879.519635:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857879.519757:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188288896 00000100:00100000:0.0:1787857879.519770:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188288896 00000100:00100000:0.0:1787857879.519854:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787857879.519864:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1874704188288896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787857879.520426:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5860:x1874704188288896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 562us (902us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787857879.520436:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787857879.520533:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5860:1874704188288896:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:3.0:1787857879.520588:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.520600:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.520607:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.520614:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857879.520620:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.520629:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.520651:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:3.0:1787857879.520654:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787857879.520661:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857879.521036:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dadb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857879.521321:0:5860:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x50:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787857879.521517:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9048 00000004:00080000:3.0:1787857879.521532:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703571714263ns, next at 704571711147ns, rc = 0 00000001:00080000:3.0:1787857879.521542:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968232 00010000:00010000:3.0:1787857879.521845:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:3.0:1787857879.521850:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857879.521860:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7dac6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41cb expref: 114 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857879.522008:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6009c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+113:32179:x1874704171805568:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 27367us (27730us total) trans 4294968233 rc 0/0 00000100:00100000:3.0:1787857879.522021:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 281 00000020:00080000:3.0:1787857879.522027:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1787857879.634316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857879.634367:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857879.634411:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857879.634452:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171806208 00000100:00100000:0.0:1787857879.634477:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171806208 00000100:00100000:0.0:1787857879.634574:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171806080 00000100:00100000:0.0:1787857879.634578:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171806080 00000100:00100000:0.0:1787857879.634610:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 521 00000100:00100000:0.0:1787857879.634622:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171806208:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857879.634726:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171806208:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857879.634735:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 521 00000100:00100000:0.0:1787857879.634759:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 522 00000100:00100000:0.0:1787857879.634767:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171806080:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857879.634795:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+15:2347:x1874704171806080:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857879.634801:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 522 00000100:00080000:0.0:1787857879.634853:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857879.635318:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171805952 00000100:00100000:1.0:1787857879.635325:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171805952 00000100:00100000:1.0:1787857879.635377:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 616 00000100:00100000:1.0:1787857879.635386:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171805952:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857879.635440:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171805952:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 56us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857879.635449:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 616 00010000:00010000:1.0:1787857879.791979:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787857880.552355:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00000001:00080000:0.0:1787857880.552383:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00000100:00100000:0.0:1787857880.722677:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857880.722766:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171806464 00000100:00100000:2.0:1787857880.722777:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171806464 00000100:00100000:2.0:1787857880.722871:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1399 00000100:00100000:2.0:1787857880.722882:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:32189:x1874704171806464:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857880.722913:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857880.722937:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41d2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723025:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723041:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723055:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723074:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723081:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723088:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723663:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7daf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723674:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7daf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723682:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7daf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857880.723693:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:2.0:1787857880.723807:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723951:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723960:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723967:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857880.723971:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723983:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.723996:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857880.723999:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857880.724004:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724010:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7dae9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724024:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724030:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724035:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724040:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857880.724043:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724048:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724055:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9998c3379900) 00010000:00010000:2.0:1787857880.724058:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857880.724061:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724071:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7daf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724126:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7dae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d2 expref: 116 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724140:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7daf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d2 expref: 115 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.724147:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:2.0:1787857880.724149:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857880.724151:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00100000:2.0:1787857880.724244:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+115:32189:x1874704171806464:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1363us (1577us total) trans 4294968234 rc 0/0 00000100:00100000:2.0:1787857880.724253:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1399 00000100:00100000:2.0:1787857880.736107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857880.736148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857880.736179:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171806976 00000100:00100000:2.0:1787857880.736189:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171806976 00000100:00100000:2.0:1787857880.736244:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1400 00000100:00100000:2.0:1787857880.736255:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+115:32188:x1874704171806976:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857880.736286:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857880.736306:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7db05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41d9 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736400:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736417:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736428:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736443:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736450:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736457:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736907:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736918:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.736926:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857880.736936:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:2.0:1787857880.737029:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737037:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737045:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737052:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857880.737056:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737064:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737075:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857880.737078:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857880.737083:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737089:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737101:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737106:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737112:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737117:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857880.737120:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737125:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737137:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff9998c3379c00) 00010000:00010000:2.0:1787857880.737140:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857880.737143:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737149:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7400/0xd3f183cab4a7db13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737195:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7db05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 118 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737209:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 117 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857880.737217:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:2.0:1787857880.737219:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857880.737221:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7e00, rc 0) 00000100:00100000:2.0:1787857880.737284:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+117:32188:x1874704171806976:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1030us (1134us total) trans 4294968235 rc 0/0 00000100:00100000:2.0:1787857880.737291:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1400 00000100:00100000:3.0:1787857880.737887:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171806720 00000100:00100000:3.0:1787857880.737894:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171806720 00000100:00100000:3.0:1787857880.737940:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00100000:3.0:1787857880.737947:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+117:32189:x1874704171806720:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:3.0:1787857880.737959:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857880.737974:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7daf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d2 expref: 117 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857880.737987:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:3.0:1787857880.737990:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857880.738031:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+116:32189:x1874704171806720:12345-192.168.204.36@tcp:103:cat.0 Request processed in 84us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857880.738565:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00100000:2.0:1787857880.743477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857880.743541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857880.743578:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171807232 00000100:00100000:3.0:1787857880.743597:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171807232 00000100:00100000:1.0:1787857880.743669:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171807360 00000100:00100000:1.0:1787857880.743682:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171807360 00000100:00100000:3.0:1787857880.743698:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 282 00000100:00100000:3.0:1787857880.743715:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+117:32188:x1874704171807232:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857880.743753:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1401 00000100:00100000:1.0:1787857880.743765:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+117:32189:x1874704171807360:12345-192.168.204.36@tcp:58:cat.0 00000004:00020000:1.0:1787857880.743889:0:5856:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_race id 18b sleeping 00000100:00100000:3.0:1787857880.744129:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+118:32188:x1874704171807232:12345-192.168.204.36@tcp:35:cat.0 Request processed in 416us (670us total) trans 4294968236 rc 0/0 00000100:00100000:3.0:1787857880.744139:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 282 00010000:00010000:0.0:1787857880.815568:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787857880.946417:0:6899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704996597661ns, next at 705996595093ns, rc = 0 00000100:00100000:0.0:1787857880.946451:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188289024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857880.946524:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857880.946608:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188289024 00000100:00100000:0.0:1787857880.946615:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188289024 00000100:00100000:0.0:1787857880.946657:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787857880.946666:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188289024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857880.946700:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857880.946741:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188289024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857880.946748:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787857880.946784:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967372 gen 2 00000004:00080000:0.0:1787857880.946789:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967372 committed transno 4294967372 00000100:00100000:0.0:1787857880.946831:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188289024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857881.839493:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857882.478351:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188289280:0@lo:400:kworker.0 00000100:00100000:3.0:1787857882.478449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857882.478541:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901222940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188289792:0@lo:400:kworker.0 00000100:00100000:3.0:1787857882.478569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857882.478600:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857882.478607:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7047840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188289408:0@lo:400:kworker.0 00000100:00100000:3.0:1787857882.478629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857882.478744:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188289280 00000100:00100000:1.0:1787857882.478753:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188289280 00000100:00100000:1.0:1787857882.478802:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188289408 00000100:00100000:1.0:1787857882.478806:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188289408 00000100:00100000:2.0:1787857882.478854:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188289536:0@lo:400:kworker.0 00000100:00100000:1.0:1787857882.478873:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1787857882.478885:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188289280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857882.478894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857882.478921:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857882.478928:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188289152:0@lo:400:kworker.0 00000100:00100000:1.0:1787857882.478953:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188289280:12345-0@lo:400:kworker.0 Request processed in 70us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857882.478962:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1787857882.478975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857882.478984:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1787857882.478993:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188289408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857882.479008:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188289664:0@lo:400:kworker.0 00000100:00100000:2.0:1787857882.479038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857882.479050:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188289408:12345-0@lo:400:kworker.0 Request processed in 56us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857882.479059:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1787857882.479069:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188289664 00000100:00100000:2.0:1787857882.479074:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188289664 00000100:00100000:1.0:1787857882.479105:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7047840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188289408:0@lo:400:kworker.0 00000100:00100000:2.0:1787857882.479107:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1787857882.479118:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188289664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857882.479126:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188289280:0@lo:400:kworker.0 00000100:00100000:2.0:1787857882.479162:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188289664:12345-0@lo:400:kworker.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857882.479170:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1787857882.479179:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188289792 00000100:00100000:1.0:1787857882.479184:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188289792 00000100:00100000:2.0:1787857882.479195:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188289152 00000100:00100000:2.0:1787857882.479200:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188289152 00000100:00100000:2.0:1787857882.479229:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1787857882.479234:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188289536 00000100:00100000:2.0:1787857882.479239:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188289152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857882.479240:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188289536 00000100:00100000:1.0:1787857882.479277:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1787857882.479280:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188289152:12345-0@lo:400:kworker.0 Request processed in 43us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857882.479288:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857882.479290:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1787857882.479331:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188289152:0@lo:400:kworker.0 00000100:00100000:1.0:1787857882.479341:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188289792:12345-0@lo:400:kworker.0 Request processed in 54us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857882.479346:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188289664:0@lo:400:kworker.0 00000100:00100000:1.0:1787857882.479352:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1787857882.479371:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1787857882.479379:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188289536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787857882.479991:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857882.479996:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857882.479998:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857882.480099:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901222940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188289792:0@lo:400:kworker.0 00000100:00100000:1.0:1787857882.480386:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188289536:12345-0@lo:400:kworker.0 Request processed in 1007us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857882.480395:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1787857882.487899:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188289536:0@lo:400:kworker.0 00010000:00010000:3.0:1787857882.862079:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857882.990281:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188289920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857882.990365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857882.990607:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188289920 00000100:00100000:2.0:1787857882.990619:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188289920 00000100:00100000:2.0:1787857882.990682:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787857882.990703:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188289920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857882.990748:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857882.992191:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188289920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1490us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857882.992204:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787857882.997591:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188289920:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787857883.118140:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857883.118150:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857883.118402:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 2 00000040:00080000:1.0:1787857883.118409:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787857883.886389:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787857884.085846:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000001:00080000:3.0:1787857884.085890:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968228 is committed 00000001:00080000:3.0:1787857884.085908:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968235 is committed 00000001:00080000:3.0:1787857884.085918:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968236 is committed 00000004:00080000:3.0:1787857884.085951:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000020:00080000:3.0:1787857884.085961:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998d8753e40 refcount 2 committed 0 result 0 batchid 33 00000020:00080000:3.0:1787857884.085967:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99990205a240 00000020:00080000:3.0:1787857884.085970:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998c5908600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998dadd5c00 00000001:00080000:3.0:1787857884.085990:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968224 is committed 00000020:00080000:3.0:1787857884.086007:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 33 committed batchid 32 00000020:00080000:3.0:1787857884.086218:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 32 00000100:00100000:1.0:1787857884.086634:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857884.086664:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188290048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787857884.086734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857884.086859:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188290048 00000100:00100000:2.0:1787857884.086867:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188290048 00000100:00100000:2.0:1787857884.087142:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787857884.087153:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188290048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787857884.087190:0:8490:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00002000:00010000:2.0:1787857884.087227:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a908bd5, atime: 0x0, ctime: 0x6a908bd5, blocks: 0xb 00010000:00010000:2.0:1787857884.087235:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857884.087254:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787857884.087257:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857884.087264:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857884.087281:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857884.087291:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857884.087299:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857884.087318:0:8490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1787857884.087679:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857884.088076:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857884.088086:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857884.088096:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857884.088101:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857884.088110:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857884.088126:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857884.088139:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7db28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857884.088160:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857884.088176:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857884.088178:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857884.088724:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188290048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1569us (1984us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787857884.088734:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000004:00080000:1.0:1787857884.089007:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999900b2b480/2, rc 0, transno 4294967373 00000100:00100000:1.0:1787857884.089017:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188290048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787857884.766955:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857884.766999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857884.767036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857884.767069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857884.767091:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857884.767108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857884.767134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857884.767163:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171807744 00000100:00100000:0.0:1787857884.767175:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171807744 00000100:00100000:0.0:1787857884.767233:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171808256 00000100:00100000:0.0:1787857884.767236:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171808256 00000100:00100000:0.0:1787857884.767248:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171807872 00000100:00100000:0.0:1787857884.767250:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171807872 00000100:00100000:0.0:1787857884.767265:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171808128 00000100:00100000:0.0:1787857884.767268:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171808128 00000100:00100000:0.0:1787857884.767284:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 525 00000100:00100000:0.0:1787857884.767293:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171807744:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857884.767378:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171807744:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 85us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857884.767386:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 525 00000100:00100000:0.0:1787857884.767404:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 526 00000100:00100000:2.0:1787857884.767409:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171807488 00000100:00100000:0.0:1787857884.767411:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171808256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857884.767414:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171807488 00000100:00100000:0.0:1787857884.767435:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171808256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857884.767442:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 526 00000100:00100000:2.0:1787857884.767451:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 618 00000100:00100000:0.0:1787857884.767452:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 527 00000100:00100000:0.0:1787857884.767470:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2348:x1874704171807872:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857884.767472:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171807488:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857884.767496:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+15:2348:x1874704171807872:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857884.767497:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171807488:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857884.767502:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 527 00000100:00100000:2.0:1787857884.767504:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 618 00000100:00100000:0.0:1787857884.767513:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 528 00000100:00100000:0.0:1787857884.767519:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171808128:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857884.767532:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171808000 00000100:00100000:2.0:1787857884.767535:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171808000 00000100:00100000:0.0:1787857884.767538:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171808128:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857884.767544:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 528 00000100:00100000:2.0:1787857884.767558:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171807616 00000100:00100000:2.0:1787857884.767561:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171807616 00000100:00100000:2.0:1787857884.767578:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 503 00000100:00100000:2.0:1787857884.767583:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2348:x1874704171808000:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857884.767614:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2348:x1874704171808000:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857884.767620:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 503 00000100:00100000:2.0:1787857884.767631:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 504 00000100:00100000:2.0:1787857884.767639:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+106:2348:x1874704171807616:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857884.767663:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+106:2348:x1874704171807616:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857884.767669:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 504 00000100:00080000:1.0:1787857884.767846:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857884.767852:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857884.767854:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787857884.910367:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787857885.691925:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00010000:00010000:3.0:1787857885.936104:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00020000:1.0:1787857886.062672:0:5856:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_fail_race id 18b awake: rc=0 00000100:00100000:3.0:1787857886.066097:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188290176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857886.066198:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857886.066403:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188290176 00000100:00100000:0.0:1787857886.066415:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188290176 00000100:00100000:0.0:1787857886.066504:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787857886.066515:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188290176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857886.066564:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857886.066627:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188290176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.066635:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:3.0:1787857886.066914:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857886.066952:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:3.0:1787857886.066960:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999900b2b480, transno 4294967373 00000100:00100000:3.0:1787857886.066992:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188290176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857886.084159:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.084200:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 105 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.084211:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.084264:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 105 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.084284:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 105 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857886.084305:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188290304:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857886.086855:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998db9b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857886.100160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857886.107714:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188290304:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857886.107766:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.108977:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171808384 00000100:00100000:2.0:1787857886.108992:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171808384 00000100:00080000:3.0:1787857886.109080:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857886.109094:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 106 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.109153:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 422 00000100:00100000:2.0:1787857886.109167:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:2350:x1874704171808384:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857886.109192:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857886.109202:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 106 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.109218:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 106 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.109254:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7e00/0xd3f183cab4a7db1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41d9 expref: 106 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.109273:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:2.0:1787857886.109279:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.109288:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.109296:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.109334:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857886.109419:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+105:2350:x1874704171808384:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 256us (9276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.109437:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 422 00010000:00010000:1.0:1787857886.110668:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.110685:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857886.111320:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].42, 136 off13904 00000100:00100000:0.0:1787857886.111506:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:32189:x1874704171807360:12345-192.168.204.36@tcp:58:cat.0 Request processed in 5367735us (5367966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.111521:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1401 00000100:00100000:0.0:1787857886.114640:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.114906:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171808640 00000100:00100000:2.0:1787857886.114922:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171808640 00000100:00100000:2.0:1787857886.115044:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1402 00000100:00100000:2.0:1787857886.115057:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+104:32188:x1874704171808640:12345-192.168.204.36@tcp:58:cat.0 00000004:00020000:2.0:1787857886.115170:0:19301:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_fail_race id 18b waking 00000100:00100000:2.0:1787857886.131939:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+104:32188:x1874704171808640:12345-192.168.204.36@tcp:58:cat.0 Request processed in 16055us (16484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.131963:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1402 00000100:00100000:3.0:1787857886.138810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857886.138964:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171808768 00000100:00100000:1.0:1787857886.138976:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171808768 00000100:00100000:1.0:1787857886.139042:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1403 00000100:00100000:1.0:1787857886.139056:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+104:32188:x1874704171808768:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857886.139100:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857886.139133:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7db36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41e0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.139214:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.139226:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7db36 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e0 expref: 105 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.139252:0:5858:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.139269:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7db36 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e0 expref: 105 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.139289:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:1.0:1787857886.139293:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857886.139298:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7db36 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e0 expref: 105 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.139305:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1495400, rc 0) 00000100:00100000:1.0:1787857886.139409:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+105:32188:x1874704171808768:12345-192.168.204.36@tcp:101:cat.0 Request processed in 355us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857886.139416:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1403 00000040:00080000:1.0:1787857886.190191:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857886.190203:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857886.190239:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 3 00000040:00080000:1.0:1787857886.190249:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857886.190394:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188290432:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857886.190547:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998db9b0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787857886.197251:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188290432:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857886.204102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.216598:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171808896 00000100:00100000:0.0:1787857886.216619:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171808896 00000100:00100000:0.0:1787857886.216799:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1404 00000100:00100000:0.0:1787857886.220328:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32191:x1874704171808896:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857886.220444:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857886.220670:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32191:x1874704171808896:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 3826us (16581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.220683:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1404 00000100:00080000:3.0:1787857886.225124:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857886.226096:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857886.226246:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171809024 00000100:00100000:3.0:1787857886.226256:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171809024 00000100:00100000:3.0:1787857886.226356:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1405 00000100:00100000:3.0:1787857886.226369:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32191:x1874704171809024:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857886.226471:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226491:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226504:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226523:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226530:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226536:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226559:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226565:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226570:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857886.226605:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00000004:00200000:3.0:1787857886.226610:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857886.226623:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226633:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226638:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226644:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226654:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857886.226658:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226666:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226678:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:3.0:1787857886.226682:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857886.226686:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226693:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7db3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226706:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226712:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226718:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226724:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857886.226727:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226733:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226743:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x98b61b69 (ffff9998d12ef700) 00010000:00010000:3.0:1787857886.226746:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857886.226748:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226754:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7db44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226767:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226772:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226777:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226781:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857886.226783:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226788:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226794:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:3.0:1787857886.226796:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857886.226798:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.226814:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7db4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857886.227084:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32191:x1874704171809024:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 716us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857886.227093:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1405 00000100:00100000:2.0:1787857886.243729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857886.244691:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171809280 00000100:00100000:1.0:1787857886.244712:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171809280 00000100:00100000:1.0:1787857886.244938:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1406 00000100:00100000:1.0:1787857886.244953:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32191:x1874704171809280:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857886.244984:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857886.245012:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7db52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245149:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245177:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245189:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857886.245201:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:1.0:1787857886.245378:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245386:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245392:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245398:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857886.245403:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245433:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245449:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:1.0:1787857886.245452:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857886.245458:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245470:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7db59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245519:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7db52 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e7 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245530:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:1.0:1787857886.245533:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857886.245536:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7db52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e7 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.245547:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1494000, rc 0) 00000100:00100000:1.0:1787857886.245616:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32191:x1874704171809280:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 667us (1904us total) trans 4294968237 rc 301/301 00000100:00100000:1.0:1787857886.245624:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1406 00000100:00100000:3.0:1787857886.267510:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.268907:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171809408 00000100:00100000:0.0:1787857886.268928:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171809408 00000100:00100000:0.0:1787857886.269056:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1407 00000100:00100000:0.0:1787857886.269070:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32191:x1874704171809408:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857886.269145:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857886.269294:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32191:x1874704171809408:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 225us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.269302:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1407 00000100:00100000:0.0:1787857886.281976:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.284434:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171809664 00000100:00100000:2.0:1787857886.284463:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171809664 00000100:00100000:2.0:1787857886.284606:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1408 00000100:00100000:2.0:1787857886.284620:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32191:x1874704171809664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857886.284648:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857886.284672:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41ee expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.295864:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.295887:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.295900:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857886.295912:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00010000:00010000:2.0:1787857886.295988:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7db67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41ee expref: 53 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.296010:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41ee expref: 52 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.296025:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9998c3379200) 00010000:00010000:2.0:1787857886.296029:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857886.296035:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:2.0:1787857886.296152:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32191:x1874704171809664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 11533us (14191us total) trans 4294968238 rc 0/0 00000100:00100000:2.0:1787857886.296160:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1408 00000100:00100000:2.0:1787857886.303398:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857886.305050:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171809920 00000100:00100000:3.0:1787857886.305394:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171809920 00000100:00100000:3.0:1787857886.306274:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1409 00000100:00100000:2.0:1787857886.306389:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32191:x1874704171809920:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857886.306499:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857886.306533:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41ee expref: 52 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.306553:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9998c3379200) 00010000:00010000:2.0:1787857886.306565:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857886.306588:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.306603:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 104 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.306612:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.306644:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 104 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.306663:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 104 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.306677:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b29a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188290560:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857886.306800:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857886.311978:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b29a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188290560:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857886.312017:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.320504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.320632:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171810048 00000100:00100000:0.0:1787857886.320645:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171810048 00010000:00010000:0.0:1787857886.320703:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 105 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857886.320761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 423 00000100:00100000:0.0:1787857886.320774:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+105:2350:x1874704171810048:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857886.320794:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857886.320802:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 105 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.320871:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 105 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.320894:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7da6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41a1 expref: 105 pid: 19301 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.320912:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:0.0:1787857886.320919:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.320930:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.320937:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.320969:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857886.321024:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:2350:x1874704171810048:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 253us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.321032:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 423 00010000:00010000:2.0:1787857886.321439:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321450:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321485:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321497:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321506:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321928:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321938:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321949:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321957:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857886.321960:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321969:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321981:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:2.0:1787857886.321984:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857886.321989:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.321996:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.322006:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.322012:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.322018:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.322024:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857886.322027:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.322037:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.322044:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xf9d584d4 (ffff9998c3379200) 00010000:00010000:2.0:1787857886.322047:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857886.322050:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.322055:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xf9d584d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.322149:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32191:x1874704171809920:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 15856us (18761us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857886.322283:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1409 00000100:00100000:3.0:1787857886.326036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.326558:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171810176 00000100:00100000:0.0:1787857886.326571:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171810176 00000100:00100000:0.0:1787857886.326653:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1410 00000100:00100000:0.0:1787857886.326665:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32191:x1874704171810176:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857886.326694:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857886.326729:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7db8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41f5 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.326775:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.326792:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.326807:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.326976:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7db8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 53 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.326997:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.327006:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857886.327009:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857886.327014:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:0.0:1787857886.327097:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32191:x1874704171810176:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 434us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.327105:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1410 00000100:00100000:1.0:1787857886.337602:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.338003:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171810432 00000100:00100000:2.0:1787857886.338013:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171810432 00000100:00100000:2.0:1787857886.338088:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1411 00000100:00100000:2.0:1787857886.338099:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32191:x1874704171810432:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857886.338209:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.338231:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.338246:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857886.338494:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005440cc33 reply state 00000000537f7766 transno 4294968239 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.338509:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857886.338631:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32191:x1874704171810432:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 532us (1046us total) trans 4294968239 rc 0/0 00000100:00100000:2.0:1787857886.338640:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1411 00000100:00100000:1.0:1787857886.341661:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.341987:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171810560 00000100:00100000:2.0:1787857886.341999:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171810560 00000100:00100000:2.0:1787857886.342082:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1412 00000100:00100000:2.0:1787857886.342094:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32191:x1874704171810560:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857886.342132:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857886.342230:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd41fc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.342307:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.342324:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.342334:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857886.342338:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857886.342342:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6600, rc 0) 00000100:00100000:2.0:1787857886.342726:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32191:x1874704171810560:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 633us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.342735:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1412 00010000:00010000:3.0:1787857886.342864:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.344308:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.344334:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.344341:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857886.344347:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.344357:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.344388:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857886.344392:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857886.344400:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.344406:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7db98 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857886.346080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857886.346259:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171810688 00000100:00100000:1.0:1787857886.346272:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171810688 00000100:00100000:1.0:1787857886.346393:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 283 00000100:00100000:1.0:1787857886.346407:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32191:x1874704171810688:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787857886.346604:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32191:x1874704171810688:12345-192.168.204.36@tcp:49:lhsmtool_posix.0 Request processed in 199us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857886.346614:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 283 00000100:00100000:1.0:1787857886.352948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.353094:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171810944 00000100:00100000:2.0:1787857886.353112:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171810944 00000100:00100000:2.0:1787857886.353301:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 284 00000100:00100000:2.0:1787857886.353312:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32191:x1874704171810944:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857886.353672:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32191:x1874704171810944:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 359us (742us total) trans 4294968240 rc 0/0 00000100:00100000:2.0:1787857886.353682:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 284 00000100:00100000:0.0:1787857886.357038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.357210:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171811200 00000100:00100000:2.0:1787857886.357221:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171811200 00000100:00100000:2.0:1787857886.357362:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1413 00000100:00100000:2.0:1787857886.357376:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32191:x1874704171811200:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857886.357542:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32191:x1874704171811200:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 168us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.357551:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1413 00000100:00100000:0.0:1787857886.362475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.362611:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171811456 00000100:00100000:2.0:1787857886.362624:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171811456 00000100:00100000:2.0:1787857886.362740:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1414 00000100:00100000:2.0:1787857886.362754:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32191:x1874704171811456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857886.362785:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857886.362863:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4203 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.363069:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.363088:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.363098:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.363234:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.363246:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 56 pid: 5858 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857886.363258:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188290688:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857886.363345:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a96540 going to sleep for 11 seconds 00000100:00100000:1.0:1787857886.365720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.366045:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171811584 00000100:00100000:2.0:1787857886.366057:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171811584 00010000:00010000:2.0:1787857886.366125:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 57 pid: 5858 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.366174:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 424 00000100:00100000:2.0:1787857886.366187:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:2349:x1874704171811584:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857886.366207:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857886.366216:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 57 pid: 5858 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.366231:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 57 pid: 5858 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.366261:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857886.366268:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.366278:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.366287:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.366308:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857886.366378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:2349:x1874704171811584:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 193us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.366387:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 424 00010000:00010000:3.0:1787857886.367564:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7db9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41fc expref: 56 pid: 5858 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857886.367590:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188290688:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857886.367628:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.367792:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.367801:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857886.367992:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00000004:00080000:1.0:1787857886.370804:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00010000:00010000:1.0:1787857886.371081:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371096:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371118:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371131:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857886.371136:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371146:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371164:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857886.371168:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857886.371173:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371179:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dbad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371259:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dba6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4203 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371272:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9997c3d03000) 00010000:00010000:1.0:1787857886.371274:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857886.371279:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4203 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.371291:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:1.0:1787857886.371393:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32191:x1874704171811456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 8641us (8935us total) trans 4294968241 rc 301/301 00000100:00100000:1.0:1787857886.371404:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1414 00000100:00100000:1.0:1787857886.377935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857886.378022:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171811840 00000100:00100000:3.0:1787857886.378037:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171811840 00000100:00100000:3.0:1787857886.378116:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 285 00000100:00100000:3.0:1787857886.378131:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32191:x1874704171811840:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857886.378647:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32191:x1874704171811840:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 518us (721us total) trans 4294968242 rc 0/0 00000100:00100000:3.0:1787857886.378656:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 285 00000100:00100000:0.0:1787857886.382527:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.382648:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171811968 00000100:00100000:2.0:1787857886.382664:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171811968 00000100:00100000:2.0:1787857886.382867:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1415 00000100:00100000:2.0:1787857886.382879:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32191:x1874704171811968:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857886.382909:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857886.382930:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dbbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd420a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.383023:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dbc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.383043:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.383057:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857886.383104:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00000004:00200000:2.0:1787857886.383109:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857886.383146:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.383418:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dbbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd420a expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.383464:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd420a expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.383473:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857886.383477:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787857886.383482:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:2.0:1787857886.383627:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:32191:x1874704171811968:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 750us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.383635:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1415 00000100:00100000:0.0:1787857886.386891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.387083:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171812096 00000100:00100000:2.0:1787857886.387099:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171812096 00000100:00100000:2.0:1787857886.387383:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 396 00000100:00100000:2.0:1787857886.387399:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171812096:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00000100:00080000:1.0:1787857886.387451:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857886.387505:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857886.387607:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4211 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857886.387788:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857886.388090:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1787857886.388096:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857886.388112:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.388140:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.388154:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6600, rc 0) 00000100:00100000:2.0:1787857886.388465:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171812096:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1069us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.388475:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 396 00000100:00100000:0.0:1787857886.390796:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.390942:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171812352 00000100:00100000:2.0:1787857886.390957:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171812352 00000100:00100000:2.0:1787857886.391071:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1416 00000100:00100000:2.0:1787857886.391084:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:32191:x1874704171812352:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857886.391250:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:32191:x1874704171812352:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 169us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.391258:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1416 00000100:00100000:0.0:1787857886.398399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857886.398653:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171812480 00000100:00100000:1.0:1787857886.398666:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171812480 00000100:00100000:1.0:1787857886.398742:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:1.0:1787857886.398755:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:32191:x1874704171812480:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857886.398778:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857886.398799:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4218 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.398893:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.398905:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857886.398910:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857886.398916:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.398960:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 12 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.398975:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 12 pid: 6713 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857886.398993:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188290816:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857886.399088:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4df9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857886.402213:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188290816:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857886.402250:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.402271:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1494e00, rc 0) 00000100:00100000:2.0:1787857886.402331:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:32191:x1874704171812480:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3578us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.402340:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 397 00000100:00100000:0.0:1787857886.403455:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.403606:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171812608 00000100:00100000:2.0:1787857886.403614:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171812608 00010000:00010000:2.0:1787857886.403649:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 12 pid: 6713 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.403686:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 425 00000100:00100000:2.0:1787857886.403695:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171812608:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857886.403709:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857886.403934:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 12 pid: 6713 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.403951:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 12 pid: 6713 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.403975:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019c08f08/0xd3f183cab4a7dbc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4211 expref: 12 pid: 6713 timeout: 810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.403996:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857886.404000:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857886.404009:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.404020:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.404061:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.404077:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b28b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188290944:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857886.404252:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d8753900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857886.407780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857886.408047:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171812736 00000100:00100000:1.0:1787857886.408059:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171812736 00002000:00100000:1.0:1787857886.408185:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1e:0x0] (0->157) req@ffff9997c30421c0 x1874704171812736/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:532/0 lens 648/0 e 0 to 0 dl 1787857897 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857886.408198:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c30421c0 with x1874704171812736 ext(0->157) 00002000:00010000:1.0:1787857886.408204:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c30421c0 00000100:00100000:1.0:1787857886.408238:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 120 00000100:00100000:1.0:1787857886.408248:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171812736:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787857886.408520:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b28b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188290944:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857886.408553:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857886.408662:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171812608:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 4967us (5213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.408673:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 425 00000100:00100000:1.0:1787857886.408939:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171812736:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 682us (1161us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1787857886.408948:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 120 00002000:00100000:1.0:1787857886.408955:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1e:0x0] (0->157) req@ffff9997c30421c0 x1874704171812736/t4294967383(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:532/0 lens 648/448 e 0 to 0 dl 1787857897 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857886.408965:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c30421c0 with x1874704171812736 ext(0->157) 00002000:00010000:1.0:1787857886.408969:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c30421c0 00000100:00100000:1.0:1787857886.411530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.411634:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171812864 00000100:00100000:0.0:1787857886.411643:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171812864 00000100:00100000:0.0:1787857886.411757:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1417 00000100:00100000:0.0:1787857886.411771:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:32191:x1874704171812864:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787857886.455898:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968241 is committed 00000001:00080000:3.0:1787857886.455942:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968242 is committed 00000020:00080000:3.0:1787857886.455949:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 33 batchid updated 00000100:00100000:2.0:1787857886.455959:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32191:x1874704171812864:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 44183us (44446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.455972:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1417 00000020:00080000:1.0:1787857886.456482:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00000020:00080000:1.0:1787857886.456498:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00000100:00100000:1.0:1787857886.466969:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.467443:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171812992 00000100:00100000:0.0:1787857886.467459:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171812992 00000100:00100000:0.0:1787857886.467579:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:0.0:1787857886.467592:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171812992:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787857886.510689:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967383 is committed 00000100:00100000:2.0:1787857886.511244:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171812992:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 43647us (44288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.511261:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 398 00000100:00100000:0.0:1787857886.515401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.515567:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171813248 00000100:00100000:2.0:1787857886.515583:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171813248 00000100:00100000:2.0:1787857886.515700:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1418 00000100:00100000:2.0:1787857886.515711:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32191:x1874704171813248:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857886.515796:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857886.515927:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dbc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd420a expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.515946:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857886.515954:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857886.515992:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.516005:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.516017:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857886.516404:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b7a942f reply state 00000000d43e91af transno 4294968243 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.516417:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857886.516576:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32191:x1874704171813248:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 865us (1187us total) trans 4294968243 rc 0/0 00000100:00100000:2.0:1787857886.516585:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1418 00000100:00100000:1.0:1787857886.520666:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.521336:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171813376 00000100:00100000:0.0:1787857886.521351:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171813376 00010000:00010000:0.0:1787857886.521383:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521396:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521404:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521411:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857886.521418:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521437:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521461:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857886.521464:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857886.521470:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521478:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dbd7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857886.521583:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1419 00000100:00100000:0.0:1787857886.521597:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32191:x1874704171813376:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857886.521636:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857886.521661:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd421f expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521750:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521765:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.521790:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857886.521792:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857886.521795:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857886.521887:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32191:x1874704171813376:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 291us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.521894:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1419 00000100:00100000:1.0:1787857886.526360:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.526499:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171813504 00000100:00100000:2.0:1787857886.526512:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171813504 00000100:00100000:2.0:1787857886.526611:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 399 00000100:00100000:2.0:1787857886.526623:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171813504:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787857886.527099:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787857886.527105:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1787857877 00002000:00010000:2.0:1787857886.527107:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb atime from disk: 0 -> 1787857877 00002000:00010000:2.0:1787857886.527110:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1787857877 00002000:00010000:2.0:1787857886.527112:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787857886.527341:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171813504:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 717us (999us total) trans 4294967384 rc 0/0 00000100:00100000:2.0:1787857886.527352:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 399 00000100:00100000:0.0:1787857886.532209:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857886.532389:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171813760 00000100:00100000:1.0:1787857886.532403:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171813760 00000100:00100000:1.0:1787857886.532513:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1420 00000100:00100000:1.0:1787857886.532528:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32191:x1874704171813760:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787857886.532619:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.532641:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.532652:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.532701:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.532804:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 52 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857886.532844:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188291072:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857886.533003:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09fc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857886.537559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.538142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171813888 00000100:00100000:2.0:1787857886.538152:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171813888 00010000:00010000:2.0:1787857886.538197:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 53 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.538248:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 426 00000100:00100000:2.0:1787857886.538261:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2349:x1874704171813888:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857886.538301:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857886.538310:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 53 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.538326:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 53 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.538361:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857886.538368:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.538381:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.538391:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.538413:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857886.538602:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2349:x1874704171813888:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 343us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.538611:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 426 00010000:00010000:1.0:1787857886.539469:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7db91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41f5 expref: 52 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857886.539494:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188291072:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857886.539520:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539531:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539537:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539575:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539582:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539588:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539594:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857886.539599:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539606:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539623:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857886.539626:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787857886.539631:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.539637:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dbe5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857886.539703:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32191:x1874704171813760:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 7179us (7510us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787857886.539725:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1420 00000100:00100000:2.0:1787857886.543474:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857886.543593:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171814016 00000100:00100000:1.0:1787857886.543607:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171814016 00000100:00100000:1.0:1787857886.543789:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 400 00000100:00100000:1.0:1787857886.543803:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171814016:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857886.547112:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.547284:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857886.547295:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857886.547300:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857886.547306:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.547464:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.547490:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 12 pid: 6711 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857886.547513:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188291200:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857886.547652:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6e36d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857886.551963:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.552106:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188291200:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857886.552153:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.552955:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171814144 00000100:00100000:2.0:1787857886.552965:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171814144 00010000:00010000:2.0:1787857886.553009:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 13 pid: 6711 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.553058:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 427 00000100:00100000:2.0:1787857886.553070:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171814144:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857886.553094:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857886.553131:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 13 pid: 6711 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.553146:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 13 pid: 6711 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.553172:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bb7fbf4/0xd3f183cab4a7dbd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4218 expref: 13 pid: 6711 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.553204:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857886.553208:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857886.553217:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.553228:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.553262:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857886.553360:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171814144:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 292us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.553368:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 427 00010000:00010000:0.0:1787857886.554484:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.554503:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.554548:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.554564:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.554574:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.554582:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0030200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857886.554587:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.554598:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.554619:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.554627:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040d8a137/0xd3f183cab4a7dbec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857886.554759:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171814016:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 10954us (11299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.554769:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 400 00000100:00100000:1.0:1787857886.562010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857886.562103:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171814400 00000100:00100000:3.0:1787857886.562116:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171814400 00000100:00100000:3.0:1787857886.562199:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1421 00000100:00100000:3.0:1787857886.562210:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:32191:x1874704171814400:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857886.562306:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.562327:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.562341:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.562643:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.562655:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.562665:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.562710:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 52 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.562729:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 52 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857886.562747:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188291328:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857886.562904:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5383b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857886.570084:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.570235:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171814528 00000100:00100000:0.0:1787857886.570248:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171814528 00010000:00010000:0.0:1787857886.570316:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 53 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857886.570377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 428 00000100:00100000:0.0:1787857886.570390:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2350:x1874704171814528:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857886.570413:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857886.570431:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 53 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.570448:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 53 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.570478:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857886.570484:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.570494:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.570503:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.570528:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857886.570599:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2350:x1874704171814528:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 211us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857886.570609:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 428 00010000:00010000:3.0:1787857886.572033:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dbde lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd421f expref: 52 pid: 7656 timeout: 810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857886.572062:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188291328:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857886.572094:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.572106:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.572112:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857886.572483:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968244 00000001:00080000:3.0:1787857886.572646:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968245 00000001:00080000:3.0:1787857886.572689:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968246 00000100:00100000:0.0:1787857886.575406:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188291456:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787857886.575511:0:19301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857886.575601:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c788f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857886.575658:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188291456 00000100:00100000:3.0:1787857886.575667:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188291456 00000100:00100000:3.0:1787857886.575907:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787857886.575921:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188291456:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787857886.576059:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188291456:12345-0@lo:1000:mdt00_004.0 Request processed in 141us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857886.576071:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787857886.576457:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efa6d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188291456:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787857886.577195:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968247 00000100:00100000:2.0:1787857886.577298:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2b840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188291584:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787857886.577367:0:19301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857886.577414:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5383b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857886.577553:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188291584 00000100:00100000:3.0:1787857886.577561:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188291584 00000100:00100000:3.0:1787857886.577611:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787857886.577621:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19301:x1874704188291584:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787857886.577914:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19301:x1874704188291584:12345-0@lo:1000:mdt00_004.0 Request processed in 294us (545us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1787857886.577923:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787857886.578510:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2b840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19301:1874704188291584:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787857886.578638:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968248 00010000:00010000:2.0:1787857886.578680:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578693:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578707:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578725:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857886.578733:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578741:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578767:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857886.578771:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857886.578777:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578784:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7dbfa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578866:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578872:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578877:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578882:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1495e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857886.578885:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578895:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578904:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:2.0:1787857886.578907:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857886.578917:0:19301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7db36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e0 expref: 103 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578931:0:19301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7db36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e0 expref: 103 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578941:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7db36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e0 expref: 103 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.578986:0:19301:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495400/0xd3f183cab4a7db36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd41e0 expref: 103 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.579252:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188291712:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857886.579431:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f0dff240 going to sleep for 11 seconds 00000100:00080000:1.0:1787857886.579557:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857886.586871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857886.586960:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171814656 00000100:00100000:3.0:1787857886.586972:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171814656 00000100:00100000:3.0:1787857886.587029:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 286 00000100:00100000:3.0:1787857886.587043:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c600bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:32188:x1874704171814656:12345-192.168.204.36@tcp:49:cat.0 00000100:00100000:3.0:1787857886.587222:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c600bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:32188:x1874704171814656:12345-192.168.204.36@tcp:49:cat.0 Request processed in 182us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857886.587230:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 286 00000100:00100000:2.0:1787857886.590492:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188291712:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857886.590531:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590547:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7db2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590596:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590614:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590630:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590642:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590648:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590654:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590660:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857886.590664:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590672:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590685:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:2.0:1787857886.590688:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857886.590692:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590697:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dc01 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590707:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590730:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590736:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590741:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857886.590744:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590750:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590760:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff9998c3379400) 00010000:00010000:2.0:1787857886.590762:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857886.590765:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.590771:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7dbf3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857886.591063:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32191:x1874704171814400:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 28854us (29063us total) trans 4294968249 rc 0/0 00000100:00100000:2.0:1787857886.591075:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1421 00000020:00080000:2.0:1787857886.591083:0:19301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1787857886.591260:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857886.591266:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857886.591753:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787857886.591767:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857886.594910:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.595065:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171814912 00000100:00100000:0.0:1787857886.595081:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171814912 00000100:00100000:0.0:1787857886.595163:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 287 00000100:00100000:0.0:1787857886.595175:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32191:x1874704171814912:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787857886.595992:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x2b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787857886.596132:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968250 00010000:00010000:0.0:1787857886.596186:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.596207:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.596220:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.596230:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.596238:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.596245:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857886.596264:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787857886.596403:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:32191:x1874704171814912:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1226us (1513us total) trans 4294968251 rc 0/0 00000100:00100000:0.0:1787857886.596411:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 287 00000020:00080000:0.0:1787857886.596429:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787857886.597630:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857886.597644:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.597656:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857886.597662:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.597676:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.597697:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff9997c3d03b00) 00010000:00010000:3.0:1787857886.597702:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857886.597709:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.597728:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857886.597757:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857886.597760:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857886.597762:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857886.600335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.600415:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857886.600590:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171815040 00000100:00100000:2.0:1787857886.600605:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171815040 00000100:00100000:2.0:1787857886.600699:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171815168 00000100:00100000:2.0:1787857886.600703:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171815168 00000100:00100000:2.0:1787857886.600747:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 401 00000100:00100000:2.0:1787857886.600760:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:32188:x1874704171815040:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857886.600782:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857886.600803:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ada4e5af/0xd3f183cab4a7dc0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4226 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857886.600864:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 158, mtime: 0x6a908bd5, atime: 0x6a908bd5, ctime: 0x6a908bd5, blocks: 0xb 00010000:00010000:2.0:1787857886.600890:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1787857886.600896:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857886.600905:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ada4e5af/0xd3f183cab4a7dc0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4226 expref: 17 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.600921:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ada4e5af/0xd3f183cab4a7dc0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4226 expref: 17 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.600934:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7400, rc 0) 00000100:00100000:2.0:1787857886.601004:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+17:32188:x1874704171815040:12345-192.168.204.36@tcp:101:cat.0 Request processed in 247us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.601012:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 401 00000100:00100000:2.0:1787857886.601039:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00100000:2.0:1787857886.601047:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:32189:x1874704171815168:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857886.601054:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857886.601063:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b4c5c4/0xd3f183cab4a7dc16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd422d expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.601077:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857886.601081:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857886.601086:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b4c5c4/0xd3f183cab4a7dc16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd422d expref: 17 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.601096:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072b4c5c4/0xd3f183cab4a7dc16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd422d expref: 17 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857886.601103:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7e00, rc 0) 00000100:00100000:2.0:1787857886.601123:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+17:32189:x1874704171815168:12345-192.168.204.36@tcp:101:cat.0 Request processed in 77us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857886.601130:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 402 00000100:00080000:3.0:1787857886.601369:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857886.606729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857886.609608:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171815296 00000100:00100000:3.0:1787857886.609633:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171815296 00002000:00100000:2.0:1787857886.611209:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (0->4095) req@ffff9998efa6d2c0 x1874704171815296/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:532/0 lens 488/0 e 0 to 0 dl 1787857897 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857886.611230:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6d2c0 with x1874704171815296 ext(0->4095) 00002000:00010000:2.0:1787857886.611240:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6d2c0 00000100:00100000:2.0:1787857886.611449:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 121 00000100:00100000:2.0:1787857886.611465:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2350:x1874704171815296:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:2.0:1787857886.611800:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2350:x1874704171815296:12345-192.168.204.36@tcp:3:cat.0 Request processed in 338us (5098us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857886.611809:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 121 00002000:00100000:2.0:1787857886.611844:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (0->4095) req@ffff9998efa6d2c0 x1874704171815296/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:532/0 lens 488/4536 e 0 to 0 dl 1787857897 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857886.611853:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6d2c0 with x1874704171815296 ext(0->4095) 00002000:00010000:2.0:1787857886.611858:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6d2c0 00000100:00100000:2.0:1787857886.619570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857886.622299:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171815552 00000100:00100000:0.0:1787857886.622316:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171815552 00000100:00100000:0.0:1787857886.622406:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 288 00000100:00100000:0.0:1787857886.622428:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+104:32188:x1874704171815552:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857886.622804:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+105:32188:x1874704171815552:12345-192.168.204.36@tcp:35:cat.0 Request processed in 386us (3245us total) trans 4294968252 rc 0/0 00000100:00100000:0.0:1787857886.622812:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 288 00010000:00010000:0.0:1787857886.963319:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857887.601591:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188292096:0@lo:400:kworker.0 00000100:00100000:3.0:1787857887.601705:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857887.601781:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857887.601787:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188292224:0@lo:400:kworker.0 00000100:00100000:3.0:1787857887.601872:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857887.601922:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188292224 00000100:00100000:3.0:1787857887.601934:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188292224 00000100:00100000:3.0:1787857887.602008:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1787857887.602020:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188292224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857887.602217:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188292096 00000100:00100000:2.0:1787857887.602223:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188292096 00000100:00100000:2.0:1787857887.602273:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1787857887.602282:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188292096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857887.602325:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188292096:12345-0@lo:400:kworker.0 Request processed in 46us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857887.602334:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1787857887.602481:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188292224:12345-0@lo:400:kworker.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857887.602488:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00080000:3.0:1787857887.602519:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857887.602564:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188292224:0@lo:400:kworker.0 00000100:00100000:3.0:1787857887.602580:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188292096:0@lo:400:kworker.0 00000100:00100000:0.0:1787857887.606409:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188291840:0@lo:400:kworker.0 00000100:00100000:0.0:1787857887.606509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857887.606617:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188292352:0@lo:400:kworker.0 00000100:00100000:0.0:1787857887.606662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857887.606695:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787857887.606702:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188291968:0@lo:400:kworker.0 00000100:00100000:0.0:1787857887.606725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857887.606746:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188292480:0@lo:400:kworker.0 00000100:00100000:0.0:1787857887.606771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857887.607059:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188292480 00000100:00100000:3.0:1787857887.607071:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188292480 00000100:00100000:3.0:1787857887.607276:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1787857887.607288:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188292480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857887.607356:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188292480:12345-0@lo:400:kworker.0 Request processed in 70us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857887.607364:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1787857887.607392:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188292352 00000100:00100000:3.0:1787857887.607397:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188292352 00000100:00100000:3.0:1787857887.607444:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188291968 00000100:00100000:3.0:1787857887.607447:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188291968 00000100:00100000:3.0:1787857887.607466:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1787857887.607592:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188292352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857887.607682:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188292352:12345-0@lo:400:kworker.0 Request processed in 93us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857887.607689:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1787857887.607702:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1787857887.607708:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188291968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857887.607737:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188291968:12345-0@lo:400:kworker.0 Request processed in 29us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857887.607742:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00080000:3.0:1787857887.607760:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857887.607801:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188291968:0@lo:400:kworker.0 00000100:00100000:3.0:1787857887.608016:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188292480:0@lo:400:kworker.0 00000100:00100000:3.0:1787857887.608036:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188292352:0@lo:400:kworker.0 00000100:00100000:2.0:1787857887.609388:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188291840 00000100:00100000:2.0:1787857887.609412:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188291840 00000100:00100000:2.0:1787857887.609490:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1787857887.609502:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188291840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857887.609612:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188291840:12345-0@lo:400:kworker.0 Request processed in 113us (3103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857887.609620:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1787857887.610054:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188291840:0@lo:400:kworker.0 00000040:00080000:2.0:1787857887.783935:0:22256:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857887.783949:0:22256:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857887.784005:0:22256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 3 00000040:00080000:2.0:1787857887.784012:0:22256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857887.983763:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857888.112684:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188292608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857888.112887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857888.113084:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188292608 00000100:00100000:0.0:1787857888.113110:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188292608 00000100:00100000:0.0:1787857888.113210:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787857888.113225:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188292608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857888.113294:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857888.113367:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188292608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857888.113376:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:1.0:1787857888.113574:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857888.113634:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188292608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857889.017924:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857889.875253:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857889.875350:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171815680 00000100:00100000:2.0:1787857889.875374:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171815680 00000100:00100000:2.0:1787857889.875443:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 620 00000100:00100000:2.0:1787857889.875453:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171815680:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857889.875529:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171815680:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 79us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857889.875538:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 620 00000100:00100000:0.0:1787857889.884083:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857889.884132:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857889.884161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857889.884251:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857889.884475:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171816064 00000100:00100000:0.0:1787857889.884491:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171816064 00000100:00100000:0.0:1787857889.884576:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171816320 00000100:00100000:0.0:1787857889.884580:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171816320 00000100:00100000:0.0:1787857889.884598:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171815936 00000100:00100000:0.0:1787857889.884600:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171815936 00000100:00100000:0.0:1787857889.884619:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 531 00000100:00100000:0.0:1787857889.884630:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2350:x1874704171816064:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857889.884746:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2350:x1874704171816064:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 117us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857889.884754:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 531 00000100:00100000:0.0:1787857889.884774:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 532 00000100:00100000:0.0:1787857889.884779:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171816320:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857889.884801:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171816320:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857889.884807:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 532 00000100:00100000:0.0:1787857889.884838:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 533 00000100:00100000:2.0:1787857889.884960:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171815808 00000100:00100000:2.0:1787857889.884966:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171815808 00000100:00100000:2.0:1787857889.885012:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 508 00000100:00100000:2.0:1787857889.885020:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+105:2349:x1874704171815808:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857889.885073:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+105:2349:x1874704171815808:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 55us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857889.885080:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 508 00000100:00100000:0.0:1787857889.885175:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171815936:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857889.885206:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171815936:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 362us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857889.885212:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 533 00000100:00080000:1.0:1787857889.885437:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857889.885445:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857889.885448:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857889.886491:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857889.886541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857889.886669:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171816192 00000100:00100000:0.0:1787857889.886677:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171816192 00000100:00100000:0.0:1787857889.886743:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 509 00000100:00100000:0.0:1787857889.886753:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:2350:x1874704171816192:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857889.893791:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:2350:x1874704171816192:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 7018us (7285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857889.893808:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 509 00000100:00080000:0.0:1787857889.893964:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857889.893992:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171816448 00000100:00100000:0.0:1787857889.894004:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171816448 00000100:00100000:0.0:1787857889.894407:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 534 00000100:00100000:0.0:1787857889.894416:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171816448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857889.894516:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171816448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 101us (7975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857889.894526:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 534 00000100:00080000:0.0:1787857889.894549:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857890.031191:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857891.063106:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857891.183862:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188292736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857891.183971:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857891.188945:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188292736 00000100:00100000:2.0:1787857891.188967:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188292736 00000100:00100000:2.0:1787857891.189125:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787857891.189141:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188292736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857891.189225:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787857891.190309:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857891.190939:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188292736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1793us (6958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857891.190957:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787857891.190980:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188292736:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787857891.803757:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967384 is committed 00000001:00080000:2.0:1787857891.803795:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967385 is committed 00000001:00080000:1.0:1787857891.818231:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968252 is committed 00000001:00080000:1.0:1787857891.818251:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968251 is committed 00000020:00080000:1.0:1787857891.818268:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c5a3c780 refcount 2 committed 0 result 0 batchid 34 00000020:00080000:1.0:1787857891.818273:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998efad8800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998c5a3c3c0 00000020:00080000:1.0:1787857891.818276:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9998efad8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9998c4e0e000 00000020:00080000:1.0:1787857891.818304:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 34 committed batchid 33 00000020:00080000:1.0:1787857891.818508:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00010000:00010000:3.0:1787857892.078702:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857892.720352:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188292864:0@lo:400:kworker.0 00000100:00100000:1.0:1787857892.720455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857892.720529:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188293376:0@lo:400:kworker.0 00000100:00100000:0.0:1787857892.720542:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188293120:0@lo:400:kworker.0 00000100:00100000:1.0:1787857892.720560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857892.720576:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188292992:0@lo:400:kworker.0 00000100:00100000:0.0:1787857892.720604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857892.720605:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188293248:0@lo:400:kworker.0 00000100:00100000:1.0:1787857892.720636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857892.720669:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188293248 00000100:00100000:1.0:1787857892.720677:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188293248 00000100:00100000:1.0:1787857892.720726:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1787857892.720734:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188293248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857892.720750:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188293504:0@lo:400:kworker.0 00000100:00100000:0.0:1787857892.720777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857892.720786:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188293248:12345-0@lo:400:kworker.0 Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857892.720794:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1787857892.720806:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188293504 00000100:00100000:0.0:1787857892.720810:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188293504 00000100:00100000:1.0:1787857892.720835:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857892.720862:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1787857892.720864:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188293376 00000100:00100000:1.0:1787857892.720868:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188293376 00000100:00100000:0.0:1787857892.720881:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188293504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857892.720894:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188292992 00000100:00100000:1.0:1787857892.720897:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188292992 00000100:00100000:1.0:1787857892.720914:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188293120 00000100:00100000:1.0:1787857892.720917:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188293120 00000100:00100000:0.0:1787857892.720917:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188293504:12345-0@lo:400:kworker.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857892.720923:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1787857892.720933:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1787857892.720939:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188293376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787857892.720942:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857892.720947:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857892.720971:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188293376:12345-0@lo:400:kworker.0 Request processed in 32us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857892.720974:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967385 gen 2 00000100:00100000:1.0:1787857892.720977:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000004:00080000:0.0:1787857892.720979:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967385 committed transno 4294967385 00000100:00100000:1.0:1787857892.720988:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1787857892.720993:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188292992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857892.721013:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188293504:0@lo:400:kworker.0 00000100:00100000:1.0:1787857892.721018:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188292992:12345-0@lo:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857892.721027:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1787857892.721029:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188292992:0@lo:400:kworker.0 00000100:00100000:1.0:1787857892.721038:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1787857892.721043:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188293120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857892.721061:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188293248:0@lo:400:kworker.0 00000100:00100000:1.0:1787857892.721071:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188293120:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857892.721077:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1787857892.721090:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188293376:0@lo:400:kworker.0 00000100:00100000:1.0:1787857892.721095:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188293120:0@lo:400:kworker.0 00000100:00100000:3.0:1787857892.721244:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188292864 00000100:00100000:3.0:1787857892.721249:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188292864 00000100:00100000:3.0:1787857892.721352:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1787857892.721370:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188292864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857892.721437:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188292864:12345-0@lo:400:kworker.0 Request processed in 76us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857892.721445:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1787857892.721495:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188292864:0@lo:400:kworker.0 00010000:00010000:0.0:1787857893.102130:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857893.230954:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857893.230977:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188293632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857893.231065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857893.231152:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188293632 00000100:00100000:1.0:1787857893.231160:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188293632 00000100:00100000:1.0:1787857893.231209:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787857893.231218:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188293632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857893.231255:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857893.231317:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188293632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857893.231326:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787857893.231375:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188293632:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787857893.754620:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857893.754629:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857893.755446:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 2 00000040:00080000:3.0:1787857893.755454:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857893.977577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857893.977661:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171816576 00000100:00100000:0.0:1787857893.977672:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171816576 00000100:00100000:0.0:1787857893.977806:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1422 00000100:00100000:0.0:1787857893.977858:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32160:x1874704171816576:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787857893.977978:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32160:x1874704171816576:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 163us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857893.977986:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1422 00000100:00080000:2.0:1787857893.982999:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857894.126117:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857894.996401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857894.996454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857894.996495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857894.996522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857894.996543:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857894.996562:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857894.996587:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857894.996619:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171817216 00000100:00100000:1.0:1787857894.996628:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171817216 00000100:00100000:1.0:1787857894.996685:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171816832 00000100:00100000:1.0:1787857894.996688:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171816832 00000100:00100000:1.0:1787857894.996720:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 513 00000100:00100000:1.0:1787857894.996731:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2347:x1874704171817216:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857894.996805:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2347:x1874704171817216:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 75us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857894.996812:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 513 00000100:00100000:1.0:1787857894.996862:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 514 00000100:00100000:1.0:1787857894.996870:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+104:2347:x1874704171816832:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857894.996900:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+104:2347:x1874704171816832:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857894.996907:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 514 00000100:00100000:1.0:1787857894.996925:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171816960 00000100:00100000:1.0:1787857894.996929:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171816960 00000100:00100000:1.0:1787857894.996953:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171817472 00000100:00100000:1.0:1787857894.996956:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171817472 00000100:00100000:1.0:1787857894.996967:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171817088 00000100:00100000:1.0:1787857894.996970:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171817088 00000100:00100000:1.0:1787857894.996982:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171817344 00000100:00100000:1.0:1787857894.996984:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171817344 00000100:00100000:1.0:1787857894.997001:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 537 00000100:00100000:1.0:1787857894.997007:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171816960:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857894.997039:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171816960:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857894.997051:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 537 00000100:00100000:1.0:1787857894.997062:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 538 00000100:00100000:1.0:1787857894.997068:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171817472:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857894.997098:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171817472:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857894.997105:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 538 00000100:00100000:1.0:1787857894.997116:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 539 00000100:00100000:1.0:1787857894.997122:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+17:2347:x1874704171817088:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857894.997145:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+17:2347:x1874704171817088:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857894.997151:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 539 00000100:00100000:1.0:1787857894.997162:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 540 00000100:00100000:1.0:1787857894.997167:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171817344:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857894.997190:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171817344:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857894.997196:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 540 00000100:00100000:3.0:1787857894.997737:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171816704 00000100:00100000:3.0:1787857894.997744:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171816704 00000100:00100000:3.0:1787857894.997794:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 622 00000100:00100000:3.0:1787857894.997802:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171816704:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857894.997869:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171816704:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 68us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857894.997875:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 622 00000100:00080000:3.0:1787857894.997904:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857894.997908:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857894.997911:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857895.150442:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787857895.501907:0:22456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 15:11:33 (1787857893) 00000100:00100000:3.0:1787857896.006122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.007628:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171817600 00000100:00100000:1.0:1787857896.007649:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171817600 00000100:00100000:1.0:1787857896.007906:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1423 00000100:00100000:1.0:1787857896.007921:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32803:x1874704171817600:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787857896.008107:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32803:x1874704171817600:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 189us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857896.008115:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1423 00000100:00080000:3.0:1787857896.008355:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857896.032142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.032681:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171817728 00000100:00100000:1.0:1787857896.032698:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171817728 00000100:00100000:1.0:1787857896.032931:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1424 00000100:00100000:1.0:1787857896.032956:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+104:32804:x1874704171817728:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857896.032986:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857896.033019:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4234 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.033133:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.033153:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.033169:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.033188:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.033196:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.033204:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034663:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034690:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034705:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034714:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.034721:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034730:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034756:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:1.0:1787857896.034760:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.034766:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034773:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034791:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034797:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034803:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034807:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.034811:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034880:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034888:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff9998e1a0ce00) 00010000:00010000:1.0:1787857896.034891:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.034894:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.034900:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.035061:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4234 expref: 105 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.035078:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:1.0:1787857896.035081:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.035085:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4234 expref: 105 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.035096:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94800, rc 0) 00000100:00100000:1.0:1787857896.035465:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+104:32804:x1874704171817728:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2508us (3338us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857896.035477:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1424 00000100:00080000:3.0:1787857896.035706:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857896.042100:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.042256:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171817984 00000100:00100000:2.0:1787857896.042275:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171817984 00000100:00100000:2.0:1787857896.042848:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1425 00000100:00100000:2.0:1787857896.042862:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+104:32804:x1874704171817984:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:2.0:1787857896.042956:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857896.042996:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7d95a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd413f expref: 104 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.043021:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:2.0:1787857896.043027:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857896.043861:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.043895:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.043905:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.044124:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.044148:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 48 pid: 5858 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.044164:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188293760:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857896.044509:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6e36d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857896.049569:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188293760:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857896.049616:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857896.050610:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.050771:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171818112 00000100:00100000:2.0:1787857896.050782:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171818112 00010000:00010000:2.0:1787857896.051031:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 49 pid: 5858 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.051081:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 429 00000100:00100000:2.0:1787857896.051095:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:2349:x1874704171818112:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857896.051117:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857896.051128:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 49 pid: 5858 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.051142:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 49 pid: 5858 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.051173:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7d999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4154 expref: 49 pid: 5858 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.051197:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:2.0:1787857896.051203:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.051215:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.051224:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.052743:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857896.053909:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.053931:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.053990:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.054010:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.054024:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.054603:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:2349:x1874704171818112:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3497us (3990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857896.054619:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 429 00000004:00200000:0.0:1787857896.061699:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00010000:00010000:0.0:1787857896.061740:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.061755:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.061765:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.061772:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857896.061779:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.061926:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.062279:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12ef000) 00010000:00010000:0.0:1787857896.062285:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.062305:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.062314:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dc32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857896.062344:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4f24a1f reply state 00000000e4c8664d transno 4294968253 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857896.062356:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857896.063067:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+105:32804:x1874704171817984:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 20199us (20973us total) trans 4294968253 rc 0/0 00000100:00100000:0.0:1787857896.063083:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1425 00010000:00010000:1.0:1787857896.069870:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.069901:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.069916:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.069924:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.069931:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.069952:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.069983:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff9997c3d03500) 00010000:00010000:1.0:1787857896.069987:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.069995:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.070001:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc39 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857896.073541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857896.073763:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171818240 00000100:00100000:0.0:1787857896.073780:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171818240 00000100:00100000:0.0:1787857896.073920:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1426 00000100:00100000:0.0:1787857896.073947:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+104:32805:x1874704171818240:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857896.073997:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857896.074033:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7dc40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd423b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.074137:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.074154:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.074168:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857896.074274:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:0.0:1787857896.074279:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 34 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857896.074314:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.074352:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7dc40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd423b expref: 106 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.074378:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd423b expref: 105 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.074390:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:0.0:1787857896.074393:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857896.074398:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857896.074492:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+105:32805:x1874704171818240:12345-192.168.204.36@tcp:101:bash.0 Request processed in 561us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857896.074501:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1426 00000100:00100000:3.0:1787857896.078394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.078983:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171818368 00000100:00100000:1.0:1787857896.078997:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171818368 00000100:00100000:1.0:1787857896.079064:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1427 00000100:00100000:1.0:1787857896.079075:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+105:32805:x1874704171818368:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857896.079102:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857896.079128:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4242 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079223:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079255:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079269:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079300:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079308:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079315:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079804:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7dc63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079851:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7dc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.079864:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7dc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857896.079911:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:1.0:1787857896.079916:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857896.080055:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7dc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080071:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080084:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080091:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080098:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.080103:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080112:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080128:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:1.0:1787857896.080132:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.080138:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080146:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dc55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080162:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080169:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080175:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080181:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.080185:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080191:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080197:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff9998e1a0ce00) 00010000:00010000:1.0:1787857896.080200:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.080202:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080207:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dc5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080260:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4242 expref: 107 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080276:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495e00/0xd3f183cab4a7dc63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4242 expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.080284:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857896.080287:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857896.080355:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c1495e00, rc 0) 00000100:00100000:1.0:1787857896.080521:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+106:32805:x1874704171818368:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1445us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857896.080532:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1427 00000100:00100000:3.0:1787857896.085110:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857896.085465:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171818496 00000100:00100000:0.0:1787857896.085481:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171818496 00000100:00100000:0.0:1787857896.085586:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1428 00000100:00100000:0.0:1787857896.085600:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+106:32805:x1874704171818496:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857896.085637:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857896.085673:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7dc6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4249 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.085787:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.085812:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.085878:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.085899:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.085907:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.085915:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086025:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086033:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086041:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086048:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857896.086053:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086062:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086077:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857896.086081:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.086088:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086095:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dc71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086111:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086117:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086124:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086129:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857896.086132:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086138:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086146:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03400) 00010000:00010000:0.0:1787857896.086149:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.086152:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086157:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dc78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086208:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7dc6a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4249 expref: 107 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086222:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857896.086224:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.086227:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7dc6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4249 expref: 107 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.086252:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:0.0:1787857896.086375:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+106:32805:x1874704171818496:12345-192.168.204.36@tcp:101:bash.0 Request processed in 778us (1288us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857896.086384:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1428 00000100:00100000:0.0:1787857896.098041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.098254:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171818624 00000100:00100000:2.0:1787857896.098270:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171818624 00000100:00100000:2.0:1787857896.098650:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1429 00000100:00100000:2.0:1787857896.098664:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+48:32806:x1874704171818624:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857896.098696:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857896.098732:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dc7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4250 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.098909:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.098931:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.098960:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857896.099056:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1787857896.099061:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 34 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857896.099101:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.099138:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dc7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.099163:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.099173:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:2.0:1787857896.099177:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857896.099182:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6600, rc 0) 00000100:00100000:2.0:1787857896.099424:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32806:x1874704171818624:12345-192.168.204.36@tcp:101:rm.0 Request processed in 744us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857896.099441:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1429 00000100:00100000:3.0:1787857896.106683:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.106897:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171818752 00000100:00100000:1.0:1787857896.106927:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171818752 00000100:00100000:1.0:1787857896.107039:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1430 00000100:00100000:1.0:1787857896.107051:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:32806:x1874704171818752:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857896.107083:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857896.107113:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7dc8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4257 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107202:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107220:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107233:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107264:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107271:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107279:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107438:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dca2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107448:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107456:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857896.107500:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:1.0:1787857896.107506:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857896.107535:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107550:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107557:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107566:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107573:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.107577:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107585:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107598:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:1.0:1787857896.107601:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.107606:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107613:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7dc94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107628:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107634:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107646:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107652:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.107655:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107661:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107668:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff9998e1a0ce00) 00010000:00010000:1.0:1787857896.107670:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.107673:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107679:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7dc9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107716:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7dc8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4257 expref: 51 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107731:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94800/0xd3f183cab4a7dca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4257 expref: 50 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.107738:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857896.107740:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857896.107743:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94800, rc 0) 00000100:00100000:1.0:1787857896.107946:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32806:x1874704171818752:12345-192.168.204.36@tcp:101:rm.0 Request processed in 896us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857896.107960:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1430 00000100:00100000:3.0:1787857896.112607:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.112775:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171818880 00000100:00100000:1.0:1787857896.112789:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171818880 00000100:00100000:1.0:1787857896.112942:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1431 00000100:00100000:1.0:1787857896.112955:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32806:x1874704171818880:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857896.112986:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857896.113014:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd425e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113119:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113139:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113152:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113169:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113176:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113183:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113295:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113310:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113317:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113324:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.113329:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113338:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113353:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857896.113357:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.113363:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113370:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7dcb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113602:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113609:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113615:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113620:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857896.113624:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113630:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113637:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998e1a0c600) 00010000:00010000:1.0:1787857896.113640:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.113643:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113648:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7dcb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113689:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dca9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd425e expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113700:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857896.113703:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857896.113706:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7dca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd425e expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.113715:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95c00, rc 0) 00000100:00100000:1.0:1787857896.113801:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32806:x1874704171818880:12345-192.168.204.36@tcp:101:rm.0 Request processed in 849us (1212us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857896.113810:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1431 00000100:00100000:3.0:1787857896.117424:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.117571:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171819008 00000100:00100000:2.0:1787857896.117583:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171819008 00000100:00100000:2.0:1787857896.117666:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1432 00000100:00100000:2.0:1787857896.117678:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32806:x1874704171819008:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857896.117712:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857896.117746:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dcbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4265 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.117895:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.117915:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.117930:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.117961:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.117968:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.117976:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118065:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118073:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118080:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118091:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857896.118096:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118104:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118119:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857896.118122:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857896.118129:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118136:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dcc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118152:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118158:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118164:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118169:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857896.118171:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118177:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118189:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379d00) 00010000:00010000:2.0:1787857896.118191:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857896.118194:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118200:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118256:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dcbe lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4265 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118272:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857896.118275:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857896.118279:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dcbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4265 expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.118289:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6e00, rc 0) 00000100:00100000:2.0:1787857896.118378:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32806:x1874704171819008:12345-192.168.204.36@tcp:101:rm.0 Request processed in 701us (974us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857896.118387:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1432 00000100:00100000:3.0:1787857896.138348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857896.138681:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171819136 00000100:00100000:0.0:1787857896.138696:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171819136 00000100:00100000:0.0:1787857896.138800:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1433 00000100:00100000:0.0:1787857896.138867:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32807:x1874704171819136:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857896.138910:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857896.139080:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7dcd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd426c expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139190:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139211:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139226:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139263:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139270:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139277:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139365:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139372:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139390:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139399:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857896.139404:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139413:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139428:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857896.139432:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.139438:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139446:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dcda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139468:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139474:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139479:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139485:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857896.139488:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139495:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139503:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03400) 00010000:00010000:0.0:1787857896.139506:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.139509:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.139514:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7dce1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.140196:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7dcd3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd426c expref: 51 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.140211:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857896.140213:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.140218:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7dcd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd426c expref: 51 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.140230:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:0.0:1787857896.140362:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32807:x1874704171819136:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1550us (2032us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857896.140373:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1433 00000100:00100000:3.0:1787857896.143475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857896.144064:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171819264 00000100:00100000:0.0:1787857896.144080:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171819264 00000100:00100000:0.0:1787857896.144207:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1434 00000100:00100000:0.0:1787857896.144218:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32807:x1874704171819264:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857896.144256:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857896.144287:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dce8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4273 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144433:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144452:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144467:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144486:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144495:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144501:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144598:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144607:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144615:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144622:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857896.144628:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144636:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144656:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857896.144659:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.144666:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144672:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dcef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144689:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144695:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144701:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144707:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857896.144710:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144715:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144722:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03800) 00010000:00010000:0.0:1787857896.144725:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.144727:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144734:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dcf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144777:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dce8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4273 expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144789:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857896.144791:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.144794:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4273 expref: 51 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.144804:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71c00, rc 0) 00000100:00100000:0.0:1787857896.144961:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32807:x1874704171819264:12345-192.168.204.36@tcp:101:cp.0 Request processed in 744us (1507us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857896.144970:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1434 00000100:00100000:3.0:1787857896.149186:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.150190:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171819520 00000100:00100000:2.0:1787857896.150208:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171819520 00000100:00100000:2.0:1787857896.150330:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1435 00000100:00100000:2.0:1787857896.150343:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32807:x1874704171819520:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857896.150377:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857896.150426:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dcfd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd427a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.150698:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.150719:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.150734:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.150752:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.150760:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.150767:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857896.151744:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:2.0:1787857896.152043:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152058:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152067:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152111:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152124:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152133:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152139:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857896.152144:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152153:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152167:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857896.152170:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857896.152175:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152181:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dd04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857896.152198:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6eace49 reply state 000000000b6849df transno 4294968254 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.152212:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857896.152276:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dcfd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152292:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.152305:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857896.152308:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857896.152310:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:2.0:1787857896.152416:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32807:x1874704171819520:12345-192.168.204.36@tcp:101:cp.0 Request processed in 2077us (3617us total) trans 4294968254 rc 0/0 00000100:00100000:2.0:1787857896.152425:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1435 00000100:00100000:3.0:1787857896.156200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:0.0:1787857896.156746:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.156765:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.156773:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.156781:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857896.156788:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.156798:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.156858:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379d00) 00010000:00010000:0.0:1787857896.156863:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857896.156870:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857896.156877:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dd0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.157150:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171819648 00000100:00100000:2.0:1787857896.157166:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171819648 00000100:00100000:2.0:1787857896.157304:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:2.0:1787857896.157318:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171819648:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857896.157344:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857896.157375:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4281 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857896.157676:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857896.157706:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1787857896.157711:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857896.157725:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.157750:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.157767:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00080000:0.0:1787857896.157920:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857896.161201:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171819648:12345-192.168.204.36@tcp:101:cp.0 Request processed in 970us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857896.161253:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 403 00000100:00100000:0.0:1787857896.162798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.163072:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171819776 00000100:00100000:1.0:1787857896.163085:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171819776 00000100:00100000:1.0:1787857896.163185:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 404 00000100:00100000:1.0:1787857896.163200:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:32807:x1874704171819776:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857896.163227:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857896.163262:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4288 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.163308:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.163320:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857896.163325:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857896.163332:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.163391:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 10 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.163409:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 10 pid: 8490 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857896.163429:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188293888:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857896.163572:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7227d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857896.167987:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857896.168103:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171819904 00000100:00100000:3.0:1787857896.168118:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171819904 00010000:00010000:3.0:1787857896.168179:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 11 pid: 8490 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857896.168246:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 430 00000100:00100000:3.0:1787857896.168260:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171819904:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857896.168284:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857896.168329:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 11 pid: 8490 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.168348:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 11 pid: 8490 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.168457:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857896.168464:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857896.168478:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.168492:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.168669:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 11 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857896.168693:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874704188294016:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857896.168878:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787857896.169716:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4281 expref: 11 pid: 8490 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.169738:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188293888:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857896.169771:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.169784:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f5c00, rc 0) 00000100:00100000:2.0:1787857896.169865:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:32807:x1874704171819776:12345-192.168.204.36@tcp:101:cp.0 Request processed in 6668us (7077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857896.169875:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 404 00010000:00010000:3.0:1787857896.174662:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857896.175950:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5842:1874704188294016:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857896.175997:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857896.176096:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171819904:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 7838us (8130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857896.176110:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 430 00000100:00100000:0.0:1787857896.176283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857896.176978:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171820160 00000100:00100000:3.0:1787857896.176991:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171820160 00000100:00100000:3.0:1787857896.177063:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 289 00000100:00100000:3.0:1787857896.177075:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32807:x1874704171820160:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:3.0:1787857896.179410:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32807:x1874704171820160:12345-192.168.204.36@tcp:35:cp.0 Request processed in 2319us (3110us total) trans 4294968255 rc 0/0 00000100:00100000:3.0:1787857896.179429:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 289 00000100:00100000:0.0:1787857896.227566:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.227682:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171820288 00000100:00100000:2.0:1787857896.227696:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171820288 00000100:00100000:2.0:1787857896.227792:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1436 00000100:00100000:2.0:1787857896.227804:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+106:32810:x1874704171820288:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857896.227861:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857896.227892:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dd2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd428f expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.228008:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.228028:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.228049:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228143:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228159:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228167:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228318:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dd43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228327:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dd43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228333:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dd43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857896.228378:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2c:0x0]: returning size 158 00000004:00200000:3.0:1787857896.228384:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857896.228407:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dd43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228551:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dd43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228561:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228569:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228576:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228587:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857896.228593:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228601:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228617:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857896.228621:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857896.228627:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228634:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228652:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228658:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228663:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228669:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857896.228672:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228678:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.228688:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12ef800) 00010000:00010000:3.0:1787857896.228691:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857896.228693:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.229622:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.230093:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dd2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd428f expref: 108 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.230113:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dd43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd428f expref: 107 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.230124:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857896.230127:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857896.230130:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72200, rc 0) 00000100:00100000:3.0:1787857896.231342:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+107:32810:x1874704171820288:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2431us (3544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857896.231363:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1436 00000100:00100000:0.0:1787857896.242551:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.242792:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171820416 00000100:00100000:2.0:1787857896.242806:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171820416 00000100:00100000:2.0:1787857896.242952:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 405 00000100:00100000:2.0:1787857896.242965:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171820416:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857896.242992:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857896.243017:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7dd4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4296 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.243102:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188294144:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857896.243228:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bfc00 going to sleep for 11 seconds 00000100:00080000:0.0:1787857896.243370:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1787857896.247944:0:6711:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857896.247959:0:6711:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb mtime: 0 -> 1787857895 00002000:00010000:2.0:1787857896.247962:0:6711:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb atime: 0 -> 1787857895 00002000:00010000:2.0:1787857896.247964:0:6711:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb ctime: 0 -> 1787857895 00000100:00100000:2.0:1787857896.248008:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188294144:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857896.248069:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7dd4a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4296 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.248109:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad872755/0xd3f183cab4a7dd4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4296 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.248129:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6200, rc 0) 00000100:00100000:2.0:1787857896.248242:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171820416:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5269us (5707us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857896.248256:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 405 00000100:00100000:3.0:1787857896.253019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.253246:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171820544 00000100:00100000:2.0:1787857896.253262:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171820544 00000100:00100000:2.0:1787857896.253529:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1437 00000100:00100000:2.0:1787857896.253544:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+107:32810:x1874704171820544:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857896.253577:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857896.253614:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dd51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd429d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.253725:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.253744:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.253758:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857896.253887:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:2.0:1787857896.253892:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857896.253919:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.253951:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dd51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd429d expref: 109 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.253974:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd429d expref: 108 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.253989:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857896.253992:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857896.253997:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6e00, rc 0) 00000100:00100000:2.0:1787857896.254078:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:32810:x1874704171820544:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 538us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857896.254086:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1437 00000100:00100000:0.0:1787857896.266090:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.266255:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171820672 00000100:00100000:2.0:1787857896.266273:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171820672 00000100:00100000:2.0:1787857896.266387:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 406 00000100:00100000:2.0:1787857896.266400:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171820672:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857896.266430:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857896.266457:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42a4 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.266550:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188294272:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857896.266697:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857896.272472:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188294272:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857896.272549:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd5f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42a4 expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.272594:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8994854/0xd3f183cab4a7dd5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42a4 expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.272613:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00100000:2.0:1787857896.272771:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171820672:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 6372us (6697us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857896.272782:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 406 00000100:00100000:3.0:1787857896.279774:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.280284:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171820928 00000100:00100000:1.0:1787857896.280313:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171820928 00000100:00100000:1.0:1787857896.280406:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1438 00000100:00100000:1.0:1787857896.280418:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c613a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:32810:x1874704171820928:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1787857896.281167:0:19301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].43, 136 off14040 00000100:00100000:1.0:1787857896.282130:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c613a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:32810:x1874704171820928:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 1702us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857896.282144:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1438 00000100:00100000:0.0:1787857896.302283:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857896.302333:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188294400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857896.302800:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857896.302964:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188294400 00000100:00100000:3.0:1787857896.302974:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188294400 00000100:00100000:3.0:1787857896.303059:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787857896.303069:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188294400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857896.303114:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857896.303170:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188294400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857896.303179:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787857896.303254:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188294400:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787857896.303694:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787857896.820434:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857896.820442:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857896.820490:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 44 count 3 00000040:00080000:3.0:1787857896.820496:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857896.825292:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185c780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188294528:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857896.825470:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c12edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857896.834172:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185c780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188294528:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857896.838191:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857896.838308:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171821056 00000100:00100000:3.0:1787857896.838321:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171821056 00000100:00100000:3.0:1787857896.838394:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1439 00000100:00100000:3.0:1787857896.838405:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32820:x1874704171821056:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857896.839297:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857896.840874:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32820:x1874704171821056:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 2455us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857896.840891:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1439 00000100:00100000:3.0:1787857896.855052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857896.855101:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171821312 00000100:00100000:3.0:1787857896.855111:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171821312 00000100:00100000:3.0:1787857896.855190:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1440 00000100:00100000:3.0:1787857896.855204:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32820:x1874704171821312:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857896.855246:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857896.855272:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.855408:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7dd6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.855426:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.855439:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857896.855452:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2c:0x0]: returning size 158 00010000:00010000:3.0:1787857896.855650:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dd66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ab expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.855673:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7dd6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ab expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.855684:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857896.855687:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857896.855692:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:3.0:1787857896.855775:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32820:x1874704171821312:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 575us (737us total) trans 4294968256 rc 0/0 00000100:00100000:3.0:1787857896.855784:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1440 00000100:00100000:3.0:1787857896.866537:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857896.866591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.867056:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171821440 00000100:00100000:2.0:1787857896.867068:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171821440 00000100:00100000:2.0:1787857896.867133:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 407 00000100:00100000:2.0:1787857896.867143:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171821440:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857896.867207:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.867243:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.867255:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857896.867260:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857896.867266:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.867330:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.867351:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 9 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.867371:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188294656:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857896.867579:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857896.867610:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171821568 00000100:00100000:2.0:1787857896.867614:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171821568 00000100:00100000:2.0:1787857896.867664:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:2.0:1787857896.867672:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:2350:x1874704171821568:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857896.867687:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857896.867719:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73a00/0xd3f183cab4a7dd6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ab expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.867745:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857896.867752:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857896.867782:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2350:x1874704171821568:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 112us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857896.867789:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:3.0:1787857896.870897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857896.870944:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171821696 00000100:00100000:3.0:1787857896.870954:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171821696 00002000:00100000:3.0:1787857896.871009:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (0->157) req@ffff9998e185d2c0 x1874704171821696/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:542/0 lens 648/0 e 0 to 0 dl 1787857907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857896.871021:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998e185d2c0 with x1874704171821696 ext(0->157) 00010000:00010000:3.0:1787857896.871029:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 10 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.871046:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 10 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857896.871055:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998e185d2c0 00000100:00100000:3.0:1787857896.871085:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:3.0:1787857896.871095:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171821696:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:2.0:1787857896.874110:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188294656:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857896.874153:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857896.876032:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2347:x1874704171821696:12345-192.168.204.36@tcp:4:cp.0 Request processed in 4925us (5136us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787857896.876047:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00002000:00100000:3.0:1787857896.876061:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (0->157) req@ffff9998e185d2c0 x1874704171821696/t4294967374(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:542/0 lens 648/448 e 0 to 0 dl 1787857907 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857896.876071:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998e185d2c0 with x1874704171821696 ext(0->157) 00010000:00010000:3.0:1787857896.876082:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 12 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857896.876102:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 12 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857896.876115:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998e185d2c0 00000100:00100000:0.0:1787857896.897695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857896.897774:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171821824 00000100:00100000:2.0:1787857896.897785:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171821824 00010000:00010000:2.0:1787857896.897857:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 12 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.897912:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 431 00000100:00100000:2.0:1787857896.897938:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171821824:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857896.897958:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857896.897982:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 12 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.897999:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 12 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898029:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7dd27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4288 expref: 12 pid: 14028 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898391:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857896.898396:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857896.898403:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898416:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898444:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857896.898501:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171821824:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 568us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857896.898509:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 431 00010000:00010000:2.0:1787857896.898545:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898556:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898580:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898589:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898597:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898603:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857896.898607:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898616:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898626:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857896.898634:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d426dfc3/0xd3f183cab4a7dd7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857896.898672:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171821440:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 31532us (32164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857896.898679:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 407 00000100:00100000:3.0:1787857896.904435:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.908286:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171822080 00000100:00100000:1.0:1787857896.908302:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171822080 00000100:00100000:1.0:1787857896.908374:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1441 00000100:00100000:1.0:1787857896.908385:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32820:x1874704171822080:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857896.908533:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32820:x1874704171822080:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 151us (4118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857896.908540:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1441 00000100:00100000:3.0:1787857896.916038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.916191:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171822208 00000100:00100000:1.0:1787857896.916203:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171822208 00000100:00100000:1.0:1787857896.916274:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:1.0:1787857896.916284:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171822208:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857896.916306:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857896.916330:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42b2 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857896.916359:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 158, mtime: 0x6a908be7, atime: 0x0, ctime: 0x6a908be7, blocks: 0x1 00010000:00010000:1.0:1787857896.916382:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1787857896.916387:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857896.916397:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.916418:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.916439:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f4c00, rc 0) 00000100:00100000:1.0:1787857896.916506:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171822208:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 223us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857896.916513:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 408 00000100:00100000:3.0:1787857896.922705:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857896.922796:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171822464 00000100:00100000:0.0:1787857896.922807:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171822464 00000100:00100000:0.0:1787857896.922897:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1442 00000100:00100000:0.0:1787857896.922909:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32820:x1874704171822464:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857896.923032:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32820:x1874704171822464:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857896.923040:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1442 00000100:00100000:3.0:1787857896.926392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857896.926561:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171822592 00000100:00100000:0.0:1787857896.926573:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171822592 00002000:00100000:0.0:1787857896.926629:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c:0x0] (0->4095) req@ffff9998e185e940 x1874704171822592/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:542/0 lens 488/0 e 0 to 0 dl 1787857907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857896.926641:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998e185e940 with x1874704171822592 ext(0->4095) 00002000:00010000:0.0:1787857896.926647:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998e185e940 00000100:00100000:0.0:1787857896.926681:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 122 00000100:00100000:0.0:1787857896.926693:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171822592:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787857896.926954:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171822592:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 262us (570us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857896.926963:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 122 00002000:00100000:0.0:1787857896.926970:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c:0x0] (0->4095) req@ffff9998e185e940 x1874704171822592/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:542/0 lens 488/4536 e 0 to 0 dl 1787857907 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857896.926978:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998e185e940 with x1874704171822592 ext(0->4095) 00002000:00010000:0.0:1787857896.926983:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998e185e940 00000100:00100000:2.0:1787857896.955414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.955634:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171822720 00000100:00100000:1.0:1787857896.955644:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171822720 00000100:00100000:1.0:1787857896.955711:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1443 00000100:00100000:1.0:1787857896.955723:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32820:x1874704171822720:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857896.955746:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857896.955769:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7dd89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42b9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.955810:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.955849:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.955864:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.956326:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7dd89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.956344:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857896.956358:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857896.956361:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857896.956365:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f5000, rc 0) 00000100:00100000:1.0:1787857896.956434:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32820:x1874704171822720:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 713us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857896.956442:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1443 00000100:00100000:1.0:1787857896.992711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857896.992764:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171822848 00000100:00100000:1.0:1787857896.992777:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171822848 00000100:00100000:1.0:1787857896.992871:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1444 00000100:00100000:1.0:1787857896.992883:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32820:x1874704171822848:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857896.992941:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857896.993084:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32820:x1874704171822848:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 203us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857896.993092:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1444 00000100:00100000:3.0:1787857897.011786:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.011849:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171822976 00000100:00100000:3.0:1787857897.011861:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171822976 00000100:00100000:3.0:1787857897.011935:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:3.0:1787857897.011947:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171822976:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857897.011996:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012014:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857897.012018:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857897.012025:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012043:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012079:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012088:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012098:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012105:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857897.012110:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012120:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012135:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.012143:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd231365/0xd3f183cab4a7dd97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857897.012237:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171822976:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 293us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857897.012246:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 409 00000100:00100000:2.0:1787857897.016467:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.016545:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171823232 00000100:00100000:3.0:1787857897.016559:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171823232 00000100:00100000:3.0:1787857897.016713:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1445 00000100:00100000:3.0:1787857897.016726:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32820:x1874704171823232:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857897.016847:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.016870:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.016880:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.017099:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.017115:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 55 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857897.017132:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188294784:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857897.017245:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2f50240 going to sleep for 11 seconds 00000001:00080000:3.0:1787857897.043227:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968253 is committed 00000020:00080000:3.0:1787857897.043250:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 34 batchid updated 00000001:00080000:3.0:1787857897.043266:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968254 is committed 00000001:00080000:3.0:1787857897.043272:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968255 is committed 00000020:00080000:3.0:1787857897.043285:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000020:00080000:3.0:1787857897.043295:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000100:00100000:3.0:1787857897.049086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.049118:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171823360 00000100:00100000:3.0:1787857897.049125:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171823360 00010000:00010000:3.0:1787857897.049167:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 54 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857897.049205:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 432 00000100:00100000:3.0:1787857897.049214:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171823360:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857897.049243:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857897.049251:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 54 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.049264:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 54 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.049289:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857897.049295:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.049305:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.049314:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.049332:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857897.049381:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171823360:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 167us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857897.049389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 432 00010000:00010000:1.0:1787857897.049583:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7dd90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b9 expref: 53 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857897.049600:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188294784:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857897.049621:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049630:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049640:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049913:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049922:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049929:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049935:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857897.049940:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049949:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049959:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857897.049962:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857897.049966:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.049972:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dd9e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857897.050102:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32820:x1874704171823232:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 33378us (33647us total) trans 4294968257 rc 0/0 00000100:00100000:1.0:1787857897.050112:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1445 00000040:00080000:3.0:1787857897.050613:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857897.050619:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857897.051128:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787857897.051140:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857897.074461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.074501:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171823616 00000100:00100000:3.0:1787857897.075620:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171823616 00000100:00100000:3.0:1787857897.075714:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 290 00000100:00100000:3.0:1787857897.075729:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32820:x1874704171823616:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857897.076096:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32820:x1874704171823616:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 371us (1646us total) trans 4294968258 rc 0/0 00000100:00100000:3.0:1787857897.076106:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 290 00010000:00010000:3.0:1787857897.208864:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857897.367290:0:22509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857897.367303:0:22509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857897.367357:0:22509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 44 count 3 00000040:00080000:0.0:1787857897.367364:0:22509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857897.463127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.463310:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171823744 00000100:00100000:3.0:1787857897.463324:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171823744 00000100:00100000:3.0:1787857897.463391:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 410 00000100:00100000:3.0:1787857897.463402:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171823744:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857897.463421:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857897.463441:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42c0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.463470:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857897.463474:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857897.463483:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.463499:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.463525:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73a00, rc 0) 00000100:00100000:3.0:1787857897.463594:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171823744:12345-192.168.204.36@tcp:101:rm.0 Request processed in 194us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857897.463603:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 410 00000100:00100000:0.0:1787857897.482663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857897.485809:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171824000 00000100:00100000:1.0:1787857897.488042:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171824000 00000100:00100000:1.0:1787857897.488126:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1446 00000100:00100000:1.0:1787857897.488136:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+107:32821:x1874704171824000:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:1.0:1787857897.488194:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787857897.488234:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dd43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd428f expref: 107 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.488256:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857897.488267:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dd58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd429d expref: 106 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.488276:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857897.488279:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857897.488305:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.488319:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.488329:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.488345:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.488352:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.488358:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.489606:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.489628:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.489637:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.489679:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.489697:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 53 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857897.489713:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188294912:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857897.489856:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857897.493796:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857897.493865:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171824128 00000100:00100000:2.0:1787857897.493875:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171824128 00010000:00010000:2.0:1787857897.493932:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 54 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857897.493978:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 433 00000100:00100000:2.0:1787857897.493989:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171824128:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857897.494007:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857897.494017:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 54 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.494033:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 54 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.494064:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857897.494071:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.494083:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.494091:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.494117:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857897.494188:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171824128:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 200us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857897.494197:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 433 00010000:00010000:3.0:1787857897.494645:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7dd12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd427a expref: 53 pid: 5856 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857897.494666:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188294912:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857897.494692:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.494701:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.494707:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857897.502254:0:19301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9112 00000004:00080000:3.0:1787857897.502272:0:19301:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721552453924ns, next at 722552449406ns, rc = 0 00010000:00010000:3.0:1787857897.502366:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502384:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502396:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502404:0:19301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502411:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502417:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502451:0:19301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857897.502475:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502482:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502489:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502496:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857897.502502:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502510:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502525:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857897.502529:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857897.502535:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502541:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7ddba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502567:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502573:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502582:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502588:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857897.502591:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502597:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502605:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857897.502608:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857897.502610:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502617:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7ddac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857897.502630:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b19a4fb6 reply state 000000002561fce8 transno 4294968259 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857897.502640:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857897.502759:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+107:32821:x1874704171824000:12345-192.168.204.36@tcp:36:rm.0 Request processed in 14619us (20105us total) trans 4294968259 rc 0/0 00000100:00100000:3.0:1787857897.502768:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1446 00010000:00010000:3.0:1787857897.502813:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857897.502852:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502859:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857897.502862:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502870:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502878:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857897.502881:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857897.502884:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502889:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7ddc1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.502905:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857897.502907:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857897.502909:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857897.509158:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.509178:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.509185:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.509190:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857897.509195:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.509202:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.509333:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857897.509337:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857897.509342:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.509349:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7ddb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857897.762249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857897.762387:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171824256 00000100:00100000:0.0:1787857897.762399:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171824256 00000100:00100000:0.0:1787857897.762469:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1447 00000100:00100000:0.0:1787857897.762481:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:32837:x1874704171824256:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787857897.762530:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857897.762554:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7ddc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42c7 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.762626:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ddcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.762644:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ddcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.762658:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ddcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857897.762739:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 7680 00000004:00200000:0.0:1787857897.762743:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857897.762769:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ddcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.762800:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7ddc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c7 expref: 108 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.763009:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ddcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c7 expref: 107 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.763020:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857897.763023:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857897.763026:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:3.0:1787857897.767221:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+107:32837:x1874704171824256:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 4719us (4963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857897.767234:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1447 00000100:00100000:2.0:1787857897.840933:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188295168:0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857897.841070:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188295680:0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857897.841122:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787857897.841127:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188295040:0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857897.841169:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188295552:0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857897.841235:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188295680 00000100:00100000:2.0:1787857897.841244:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188295680 00000100:00100000:2.0:1787857897.841310:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1787857897.841320:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188295680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841378:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188295680:12345-0@lo:400:kworker.0 Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857897.841386:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1787857897.841408:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188295168 00000100:00100000:2.0:1787857897.841412:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188295168 00000100:00100000:2.0:1787857897.841434:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188295552 00000100:00100000:2.0:1787857897.841436:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188295552 00000100:00100000:2.0:1787857897.841459:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1787857897.841465:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188295168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841495:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188295168:12345-0@lo:400:kworker.0 Request processed in 31us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857897.841516:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1787857897.841528:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1787857897.841535:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188295552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841564:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874704188295552:12345-0@lo:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857897.841570:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00080000:2.0:1787857897.841586:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857897.841590:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857897.841620:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874704188295552:0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841629:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188295168:0@lo:400:kworker.0 00000100:00100000:2.0:1787857897.841638:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188295680:0@lo:400:kworker.0 00000100:00100000:3.0:1787857897.841859:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188295296:0@lo:400:kworker.0 00000100:00100000:3.0:1787857897.841900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857897.841933:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857897.841939:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188295424:0@lo:400:kworker.0 00000100:00100000:3.0:1787857897.841963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857897.842003:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188295040 00000100:00100000:3.0:1787857897.842007:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188295040 00000100:00100000:3.0:1787857897.842034:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1787857897.842040:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188295040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857897.842074:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3305:x1874704188295040:12345-0@lo:400:kworker.0 Request processed in 34us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857897.842081:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1787857897.842109:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188295424 00000100:00100000:3.0:1787857897.842113:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188295424 00000100:00100000:3.0:1787857897.842139:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1787857897.842146:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188295424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857897.842179:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188295424:12345-0@lo:400:kworker.0 Request processed in 34us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857897.842186:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1787857897.842215:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188295296 00000100:00100000:3.0:1787857897.842219:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188295296 00000100:00100000:3.0:1787857897.842251:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1787857897.842257:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188295296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857897.842284:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188295296:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857897.842290:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1787857897.842321:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188295424:0@lo:400:kworker.0 00000100:00100000:3.0:1787857897.842331:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188295296:0@lo:400:kworker.0 00000100:00080000:3.0:1787857897.842347:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857897.842360:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3305:1874704188295040:0@lo:400:kworker.0 00000100:00100000:1.0:1787857897.844811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857897.844942:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171824384 00000100:00100000:2.0:1787857897.844952:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171824384 00000100:00100000:2.0:1787857897.845024:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1448 00000100:00100000:2.0:1787857897.845036:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32843:x1874704171824384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857897.845066:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857897.845097:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ddd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42ce expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.845306:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ddd6 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ce expref: 54 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.845324:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff9998c3379300) 00010000:00010000:2.0:1787857897.845327:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857897.845333:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7ddd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ce expref: 54 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.845360:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:2.0:1787857897.845433:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32843:x1874704171824384:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 399us (636us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857897.845441:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1448 00000100:00100000:2.0:1787857897.851343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.851467:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171824640 00000100:00100000:3.0:1787857897.851478:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171824640 00000100:00100000:3.0:1787857897.851562:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1449 00000100:00100000:3.0:1787857897.851574:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+107:32843:x1874704171824640:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857897.851603:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857897.851608:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787857897.851654:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ddcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c7 expref: 107 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.851681:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857897.851686:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857897.851699:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dddd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42d5 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.852021:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.852040:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.852054:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.852070:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.852077:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.852084:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853241:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853255:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853269:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857897.853282:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 0 00010000:00010000:3.0:1787857897.853372:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853380:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853386:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853392:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857897.853396:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853403:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853415:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857897.853418:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857897.853422:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853428:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7dde4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857897.853441:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cb14e23 reply state 000000001b5fc602 transno 4294968260 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857897.853455:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857897.853487:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dddd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 109 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853765:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 108 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.853775:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:3.0:1787857897.853777:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857897.853779:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72a00, rc 0) 00000100:00100000:3.0:1787857897.853947:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+109:32843:x1874704171824640:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2374us (2613us total) trans 4294968260 rc 0/0 00000100:00100000:3.0:1787857897.853957:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1449 00000100:00100000:3.0:1787857897.861406:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857897.861582:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171824896 00000100:00100000:1.0:1787857897.861592:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171824896 00000100:00100000:1.0:1787857897.861645:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1450 00000100:00100000:1.0:1787857897.861655:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+109:32843:x1874704171824896:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857897.861681:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857897.861700:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42dc expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.861802:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.861851:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 110 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.861861:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.861896:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 110 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.861918:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 110 pid: 19301 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857897.861931:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188295808:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857897.862004:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3ca80 going to sleep for 11 seconds 00010000:00010000:0.0:1787857897.862199:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.862222:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.862235:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.862242:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857897.862247:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.862254:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.862269:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12ef700) 00010000:00010000:0.0:1787857897.862271:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857897.862276:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.862282:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7ddeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857897.865319:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857897.865454:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171825024 00000100:00100000:2.0:1787857897.865464:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171825024 00010000:00010000:2.0:1787857897.865522:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 110 pid: 19301 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857897.865565:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 434 00000100:00100000:2.0:1787857897.865575:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+110:2350:x1874704171825024:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857897.865589:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857897.865597:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 110 pid: 19301 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.865612:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 110 pid: 19301 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.865638:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:2.0:1787857897.865645:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.865654:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.865662:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.865682:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857897.865739:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+110:2350:x1874704171825024:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 166us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857897.865747:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 434 00010000:00010000:1.0:1787857897.866167:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7ddf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42d5 expref: 109 pid: 19301 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857897.866191:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188295808:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857897.866226:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866241:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866247:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857897.866270:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 0 00010000:00010000:1.0:1787857897.866624:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866632:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866639:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866646:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857897.866650:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866657:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866668:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:1.0:1787857897.866671:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857897.866675:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866681:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7de07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866740:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de00 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42dc expref: 109 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866749:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857897.866752:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857897.866755:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42dc expref: 109 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.866763:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f5200, rc 0) 00000100:00100000:1.0:1787857897.867642:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:32843:x1874704171824896:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 5160us (5418us total) trans 4294968261 rc 301/301 00000100:00100000:1.0:1787857897.867661:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1450 00000100:00100000:3.0:1787857897.870880:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857897.870944:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171825280 00000100:00100000:0.0:1787857897.870958:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171825280 00000100:00100000:0.0:1787857897.871161:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 291 00000100:00100000:0.0:1787857897.871175:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:32843:x1874704171825280:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857897.871933:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+109:32843:x1874704171825280:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 758us (1059us total) trans 4294968262 rc 0/0 00000100:00100000:0.0:1787857897.871943:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 291 00000100:00100000:2.0:1787857897.874440:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857897.874595:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171825408 00000100:00100000:0.0:1787857897.874609:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171825408 00000100:00100000:0.0:1787857897.874699:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1451 00000100:00100000:0.0:1787857897.874714:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+109:32843:x1874704171825408:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857897.874748:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857897.874786:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7de15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42e3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.875061:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7de15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42e3 expref: 110 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.875080:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7de15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42e3 expref: 110 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.875104:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857897.875108:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857897.875113:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857897.875237:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+110:32843:x1874704171825408:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 527us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857897.875246:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1451 00000100:00100000:1.0:1787857897.878684:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.878798:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171825664 00000100:00100000:3.0:1787857897.878808:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171825664 00000100:00100000:2.0:1787857897.879212:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1452 00000100:00100000:2.0:1787857897.879226:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+110:32843:x1874704171825664:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787857897.879398:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879424:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879438:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879789:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879799:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879806:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879813:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857897.879859:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879870:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879888:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857897.879891:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787857897.879897:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857897.879914:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857897.880013:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+111:32843:x1874704171825664:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 788us (1338us total) trans 4294968263 rc 0/0 00000100:00100000:2.0:1787857897.880023:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1452 00000100:00100000:2.0:1787857897.883747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857897.884019:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171825920 00000100:00100000:1.0:1787857897.884033:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171825920 00000100:00100000:1.0:1787857897.884120:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1453 00000100:00100000:1.0:1787857897.884134:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+111:32843:x1874704171825920:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857897.884777:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.884802:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.885577:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857897.886041:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968264 00000004:00010000:0.0:1787857897.886157:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc14089f reply state 00000000b65a2b0a transno 4294968265 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857897.886168:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857897.886342:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+114:32843:x1874704171825920:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 2208us (2606us total) trans 4294968265 rc 0/0 00000100:00100000:0.0:1787857897.886351:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1453 00000020:00080000:0.0:1787857897.886357:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787857897.889971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.890575:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171826176 00000100:00100000:3.0:1787857897.890589:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171826176 00000100:00100000:3.0:1787857897.890658:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 292 00000100:00100000:3.0:1787857897.890670:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6009050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+114:32843:x1874704171826176:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857897.891296:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6009050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+115:32843:x1874704171826176:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 624us (1336us total) trans 4294968266 rc 0/0 00000100:00100000:3.0:1787857897.891306:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 292 00010000:00010000:1.0:1787857897.891428:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.891444:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.891453:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.891461:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857897.891467:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.891477:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.891505:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857897.891509:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857897.891516:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.891522:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857897.930143:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857897.930431:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171826432 00000100:00100000:0.0:1787857897.930442:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171826432 00000100:00100000:0.0:1787857897.930516:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1454 00000100:00100000:0.0:1787857897.930527:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+114:32846:x1874704171826432:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857897.930556:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857897.930580:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7de2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.930663:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.930679:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.930690:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.930706:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.930713:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857897.930720:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.934409:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.934436:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.934451:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857897.934471:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787857897.935224:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935239:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935247:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935254:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857897.935259:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935268:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935285:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857897.935364:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857897.935372:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935379:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7de31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935399:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935405:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935416:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935421:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857897.935423:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935430:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935438:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03400) 00010000:00010000:1.0:1787857897.935441:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857897.935444:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.935450:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7de38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.936066:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7de2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ea expref: 117 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.936088:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ea expref: 116 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857897.936097:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857897.936099:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857897.936102:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f5200, rc 0) 00000100:00100000:1.0:1787857897.936469:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+116:32846:x1874704171826432:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5941us (6339us total) trans 4294968267 rc 0/0 00000100:00100000:1.0:1787857897.936483:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1454 00000100:00100000:2.0:1787857897.952263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.952347:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171826560 00000100:00100000:3.0:1787857897.952361:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171826560 00000100:00100000:3.0:1787857897.952432:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1455 00000100:00100000:3.0:1787857897.952444:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+116:32846:x1874704171826560:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:3.0:1787857897.952646:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952670:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952686:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952719:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952727:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952733:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952739:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857897.952743:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952751:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952764:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857897.952767:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857897.952772:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857897.952782:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857897.953072:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+116:32846:x1874704171826560:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 626us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857897.953083:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1455 00000100:00100000:0.0:1787857897.956441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857897.956592:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171826816 00000100:00100000:3.0:1787857897.956602:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171826816 00000100:00100000:3.0:1787857897.956692:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 293 00000100:00100000:3.0:1787857897.956703:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+116:32846:x1874704171826816:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1787857897.957108:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+117:32846:x1874704171826816:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 405us (674us total) trans 4294968268 rc 0/0 00000100:00100000:3.0:1787857897.957118:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 293 00000100:00100000:1.0:1787857898.044090:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.044145:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.044238:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171827072 00000100:00100000:2.0:1787857898.044250:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171827072 00000100:00100000:2.0:1787857898.044350:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171827328 00000100:00100000:2.0:1787857898.044354:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171827328 00000100:00100000:2.0:1787857898.044382:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1456 00000100:00100000:2.0:1787857898.044393:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+118:32851:x1874704171827072:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.044423:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857898.044444:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7de54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42f1 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.044551:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.044567:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.044583:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.044595:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.044749:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7de54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 121 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.044770:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 120 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.044779:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.044782:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787857898.044786:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6e00, rc 0) 00000100:00100000:2.0:1787857898.044891:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+120:32851:x1874704171827072:12345-192.168.204.36@tcp:101:cat.0 Request processed in 500us (815us total) trans 4294968269 rc 0/0 00000100:00100000:2.0:1787857898.044899:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1456 00000100:00100000:2.0:1787857898.044920:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1457 00000100:00100000:2.0:1787857898.044928:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+119:32852:x1874704171827328:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.044937:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857898.044944:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7de69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42f8 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.044985:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7de70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.044994:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7de70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.045006:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7de70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.045014:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.045073:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7de69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f8 expref: 122 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.045086:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7de70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f8 expref: 121 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.045093:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.045096:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787857898.045099:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:2.0:1787857898.045121:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+121:32852:x1874704171827328:12345-192.168.204.36@tcp:101:cat.0 Request processed in 195us (976us total) trans 4294968270 rc 0/0 00000100:00100000:2.0:1787857898.045128:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1457 00000100:00080000:3.0:1787857898.045425:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857898.055783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.055881:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171827584 00000100:00100000:3.0:1787857898.055892:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171827584 00000100:00100000:3.0:1787857898.055956:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1458 00000100:00100000:3.0:1787857898.055966:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+121:32854:x1874704171827584:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.055988:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.056007:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd42ff expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.056114:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7de85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.056130:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7de85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.056143:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7de85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857898.056156:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1787857898.056306:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7de7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ff expref: 124 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.056324:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7de85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ff expref: 123 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.056332:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.056335:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787857898.056339:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857898.056406:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+123:32854:x1874704171827584:12345-192.168.204.36@tcp:101:cat.0 Request processed in 441us (632us total) trans 4294968271 rc 0/0 00000100:00100000:3.0:1787857898.056414:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1458 00000100:00100000:3.0:1787857898.066072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.066143:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.066291:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171827840 00000100:00100000:0.0:1787857898.066306:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171827840 00000100:00100000:0.0:1787857898.066394:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1459 00000100:00100000:0.0:1787857898.066406:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+123:32855:x1874704171827840:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.066433:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.066455:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7de93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4306 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.066577:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.066594:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.066608:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.066620:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.066758:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7de93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 126 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.066776:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 125 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.066785:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.066788:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787857898.066791:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:0.0:1787857898.066890:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+125:32855:x1874704171827840:12345-192.168.204.36@tcp:101:cat.0 Request processed in 487us (830us total) trans 4294968272 rc 0/0 00000100:00100000:0.0:1787857898.066898:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1459 00000100:00100000:1.0:1787857898.068488:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171828096 00000100:00100000:1.0:1787857898.068501:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171828096 00000100:00100000:1.0:1787857898.068585:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:1.0:1787857898.068595:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+125:32852:x1874704171828096:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:1.0:1787857898.068611:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787857898.068649:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7de3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ea expref: 125 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.068671:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7de70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f8 expref: 124 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.068683:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7de15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42e3 expref: 123 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.068694:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.068699:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857898.068745:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+122:32852:x1874704171828096:12345-192.168.204.36@tcp:103:cat.0 Request processed in 151us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857898.068752:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:1.0:1787857898.068869:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.068917:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171828352 00000100:00100000:3.0:1787857898.068924:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171828352 00000100:00100000:1.0:1787857898.068951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.068977:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 294 00000100:00100000:3.0:1787857898.068987:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+122:32851:x1874704171828352:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857898.069030:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171828480 00000100:00100000:1.0:1787857898.069035:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171828480 00000100:00100000:1.0:1787857898.069069:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:1.0:1787857898.069077:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+123:2349:x1874704171828480:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857898.069085:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857898.069097:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7de85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42ff expref: 123 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.069111:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.069114:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857898.069137:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+123:2349:x1874704171828480:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857898.069145:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:1.0:1787857898.070786:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+122:32851:x1874704171828352:12345-192.168.204.36@tcp:35:cat.0 Request processed in 1791us (1907us total) trans 4294968273 rc 0/0 00000100:00100000:1.0:1787857898.070799:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 294 00000100:00100000:2.0:1787857898.078809:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.078959:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171828608 00000100:00100000:0.0:1787857898.078968:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171828608 00000100:00100000:0.0:1787857898.079037:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1460 00000100:00100000:0.0:1787857898.079049:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+122:32852:x1874704171828608:12345-192.168.204.36@tcp:58:cat.0 00010000:00010000:0.0:1787857898.079169:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.079187:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 122 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.079207:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 122 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.079216:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.079256:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 122 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.079270:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 122 pid: 7656 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857898.079285:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188295936:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857898.079394:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 122 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.079404:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 122 pid: 19301 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857898.079413:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999012503c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188296064:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857898.079441:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2da7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857898.082288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.082461:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171828992 00000100:00100000:3.0:1787857898.082472:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171828992 00000100:00100000:3.0:1787857898.082531:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1461 00000100:00100000:3.0:1787857898.082541:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+123:32853:x1874704171828992:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.082567:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.082589:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7deaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4314 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082672:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082687:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082699:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082713:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082720:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082727:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082895:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082906:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.082914:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857898.082923:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000100:00100000:3.0:1787857898.089523:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.089580:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.089677:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171829248 00000100:00100000:0.0:1787857898.089687:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171829248 00000100:00100000:0.0:1787857898.089752:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 295 00000100:00100000:0.0:1787857898.089763:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+125:32855:x1874704171829248:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.090080:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+126:32855:x1874704171829248:12345-192.168.204.36@tcp:35:cat.0 Request processed in 318us (498us total) trans 4294968274 rc 0/0 00000100:00100000:0.0:1787857898.090089:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 295 00000100:00100000:1.0:1787857898.090290:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171828736 00000100:00100000:1.0:1787857898.090294:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171828736 00000100:00100000:1.0:1787857898.090335:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1462 00000100:00100000:1.0:1787857898.090344:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+126:32851:x1874704171828736:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857898.090355:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857898.090377:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7decb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd430d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.090445:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.090462:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.090479:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857898.090506:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:1.0:1787857898.090511:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857898.090526:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.090551:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7decb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 128 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.090570:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 127 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.090581:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.090584:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857898.090589:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f5c00, rc 0) 00000100:00100000:1.0:1787857898.090625:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+127:32851:x1874704171828736:12345-192.168.204.36@tcp:101:cat.0 Request processed in 283us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857898.090631:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1462 00000100:00100000:3.0:1787857898.093450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.094551:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188295936:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857898.094568:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999012503c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188296064:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857898.094600:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857898.094699:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171829376 00000100:00100000:1.0:1787857898.094706:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171829376 00010000:00010000:1.0:1787857898.094747:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 127 pid: 7656 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857898.094789:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 435 00000100:00100000:1.0:1787857898.094798:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+127:2349:x1874704171829376:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857898.094837:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857898.094847:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 127 pid: 7656 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.094860:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 127 pid: 7656 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.094887:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7de9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4306 expref: 127 pid: 7656 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.094908:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.094914:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.094924:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857898.094979:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+126:2349:x1874704171829376:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 182us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857898.094988:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 435 00010000:00010000:2.0:1787857898.096462:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096480:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096490:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096520:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.096527:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096535:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096554:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.096559:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857898.096565:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096572:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7dec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096595:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096602:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857898.096610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857898.096615:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096622:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.096626:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096632:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096647:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.096649:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.096652:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096658:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7deb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096670:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096677:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096683:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096688:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.096691:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096697:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096703:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12ef900) 00010000:00010000:2.0:1787857898.096706:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.096708:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096714:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73200/0xd3f183cab4a7debd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096773:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7deaf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4314 expref: 126 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096785:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.096788:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.096791:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7deaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4314 expref: 126 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.096802:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72800, rc 0) 00000100:00100000:2.0:1787857898.096896:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+125:32853:x1874704171828992:12345-192.168.204.36@tcp:101:cat.0 Request processed in 14355us (14623us total) trans 4294968275 rc 301/301 00000100:00100000:2.0:1787857898.096906:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1461 00000100:00100000:0.0:1787857898.097002:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171829632 00000100:00100000:0.0:1787857898.097011:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171829632 00000100:00100000:0.0:1787857898.097063:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 296 00000100:00100000:0.0:1787857898.097074:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+125:32854:x1874704171829632:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.097259:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+126:32854:x1874704171829632:12345-192.168.204.36@tcp:35:cat.0 Request processed in 187us (655us total) trans 4294968276 rc 0/0 00000100:00100000:0.0:1787857898.097266:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 296 00000100:00100000:1.0:1787857898.111917:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.111960:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.112030:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.112063:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171830272 00000100:00100000:1.0:1787857898.112077:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171830272 00000100:00100000:1.0:1787857898.112141:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00100000:1.0:1787857898.112153:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+126:32853:x1874704171830272:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857898.112460:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+127:32853:x1874704171830272:12345-192.168.204.36@tcp:35:cat.0 Request processed in 308us (428us total) trans 4294968277 rc 0/0 00000100:00100000:1.0:1787857898.112468:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 297 00000100:00100000:3.0:1787857898.112884:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171830016 00000100:00100000:3.0:1787857898.112891:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171830016 00010000:00010000:3.0:1787857898.112932:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 127 pid: 19301 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857898.112973:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 436 00000100:00100000:3.0:1787857898.112981:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+127:2350:x1874704171830016:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857898.112995:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857898.113004:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 127 pid: 19301 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.113022:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 127 pid: 19301 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.113049:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7de5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42f1 expref: 127 pid: 19301 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.113070:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.113078:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.113090:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.113099:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.113137:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857898.113167:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+126:2350:x1874704171830016:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 187us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857898.113175:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 436 00010000:00010000:3.0:1787857898.113331:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.113339:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857898.113590:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171829888 00000100:00100000:2.0:1787857898.113596:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171829888 00000100:00100000:2.0:1787857898.113633:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1463 00000100:00100000:2.0:1787857898.113643:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+126:32856:x1874704171829888:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.113663:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:3.0:1787857898.113667:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].44, 136 off14176 00010000:00010000:2.0:1787857898.113687:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd431b expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857898.113740:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+127:32852:x1874704171828608:12345-192.168.204.36@tcp:58:cat.0 Request processed in 34692us (34942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857898.113748:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1460 00010000:00010000:2.0:1787857898.113770:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.113785:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.113795:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.113810:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.113861:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.113870:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114005:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114015:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114024:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.114036:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.114122:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114131:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114139:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114146:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.114151:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114164:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114176:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.114180:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857898.114185:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114191:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7def5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114215:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114221:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114228:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114233:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.114236:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114242:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114249:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.114251:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.114254:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114264:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7dee7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114272:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114279:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114285:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114291:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.114294:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114299:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114307:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379300) 00010000:00010000:2.0:1787857898.114309:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.114313:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114319:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7deee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114358:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dee0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd431b expref: 127 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114375:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.114377:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.114381:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7dee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd431b expref: 127 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.114391:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6200, rc 0) 00000100:00100000:2.0:1787857898.114429:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+126:32856:x1874704171829888:12345-192.168.204.36@tcp:101:cat.0 Request processed in 788us (2525us total) trans 4294968278 rc 301/301 00000100:00100000:2.0:1787857898.114437:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1463 00000100:00100000:0.0:1787857898.124637:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.125117:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.125242:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171830656 00000100:00100000:2.0:1787857898.125257:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171830656 00000100:00100000:2.0:1787857898.125338:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 298 00000100:00100000:2.0:1787857898.125350:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c600ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+126:32856:x1874704171830656:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.125395:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171830400 00000100:00100000:3.0:1787857898.125401:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171830400 00000100:00100000:3.0:1787857898.125480:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1464 00000100:00100000:3.0:1787857898.125490:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+127:32852:x1874704171830400:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.125502:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.125603:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4322 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857898.125639:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c600ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+129:32856:x1874704171830656:12345-192.168.204.36@tcp:35:cat.0 Request processed in 290us (519us total) trans 4294968279 rc 0/0 00000100:00100000:2.0:1787857898.125649:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 298 00010000:00010000:3.0:1787857898.125658:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.125673:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4322 expref: 128 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.125701:0:5856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.125716:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4322 expref: 128 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.125730:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.125734:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857898.125738:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4322 expref: 128 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.125745:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73800, rc 0) 00000100:00100000:3.0:1787857898.125769:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+128:32852:x1874704171830400:12345-192.168.204.36@tcp:101:cat.0 Request processed in 282us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857898.125776:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1464 00000100:00100000:3.0:1787857898.133252:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.133344:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171830912 00000100:00100000:0.0:1787857898.133353:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171830912 00000100:00100000:0.0:1787857898.133440:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1465 00000100:00100000:0.0:1787857898.133449:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+128:32860:x1874704171830912:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.133483:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.133504:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7df0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4329 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133599:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133613:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133624:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133637:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133644:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133651:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133774:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133784:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.133791:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.133801:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.134106:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134114:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134121:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134128:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.134133:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134142:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134165:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.134168:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.134173:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134179:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134605:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134611:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134616:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134625:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.134628:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134634:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134641:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.134644:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.134647:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134653:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134660:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134665:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134670:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134675:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.134677:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134682:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134692:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03b00) 00010000:00010000:0.0:1787857898.134694:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.134696:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134701:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134747:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7df0a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4329 expref: 130 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134757:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.134759:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.134762:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7df0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4329 expref: 130 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.134770:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:0.0:1787857898.136340:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+129:32860:x1874704171830912:12345-192.168.204.36@tcp:101:cat.0 Request processed in 2881us (3089us total) trans 4294968280 rc 301/301 00000100:00100000:0.0:1787857898.136352:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1465 00000100:00100000:1.0:1787857898.146401:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.146655:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171831168 00000100:00100000:0.0:1787857898.146671:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171831168 00000100:00100000:0.0:1787857898.146732:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 299 00000100:00100000:0.0:1787857898.146745:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+129:32860:x1874704171831168:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.147997:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+130:32860:x1874704171831168:12345-192.168.204.36@tcp:35:cat.0 Request processed in 1243us (1596us total) trans 4294968281 rc 0/0 00000100:00100000:0.0:1787857898.148015:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 299 00000100:00100000:1.0:1787857898.154386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.155234:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171831424 00000100:00100000:3.0:1787857898.155249:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171831424 00000100:00100000:3.0:1787857898.155327:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1466 00000100:00100000:3.0:1787857898.155339:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+130:32863:x1874704171831424:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.155365:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.155394:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7df2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4330 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155496:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155520:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155533:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155551:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155559:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155566:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155718:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155728:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155736:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857898.155745:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1787857898.155890:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155910:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155917:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155924:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.155929:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155937:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155951:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.155954:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857898.155960:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155966:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155985:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155992:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.155998:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156003:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.156006:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156013:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156024:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.156027:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.156030:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156036:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156045:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156050:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156056:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156061:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.156064:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156069:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156077:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12efd00) 00010000:00010000:3.0:1787857898.156079:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.156082:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156088:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156138:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7df2d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4330 expref: 132 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156149:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.156152:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857898.156156:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7df2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4330 expref: 132 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.156166:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72c00, rc 0) 00000100:00100000:3.0:1787857898.157060:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+131:32863:x1874704171831424:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1712us (2672us total) trans 4294968282 rc 301/301 00000100:00100000:3.0:1787857898.157074:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1466 00000100:00100000:0.0:1787857898.191727:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.191786:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.191958:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171831936 00000100:00100000:2.0:1787857898.191970:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171831936 00000100:00100000:2.0:1787857898.192039:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 300 00000100:00100000:2.0:1787857898.192051:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+131:32863:x1874704171831936:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:2.0:1787857898.192358:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+132:32863:x1874704171831936:12345-192.168.204.36@tcp:35:cat.0 Request processed in 308us (570us total) trans 4294968283 rc 0/0 00000100:00100000:2.0:1787857898.192367:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 300 00000100:00100000:3.0:1787857898.192993:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171831680 00000100:00100000:3.0:1787857898.193002:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171831680 00000100:00100000:3.0:1787857898.193063:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1467 00000100:00100000:3.0:1787857898.193072:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+132:32861:x1874704171831680:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.193087:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.193114:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7df50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4337 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193204:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193223:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193239:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193259:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193267:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193274:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193431:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193441:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193449:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857898.193459:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1787857898.193689:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193698:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193705:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193711:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.193716:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193727:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193739:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.193742:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857898.193747:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193753:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7df65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193770:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193775:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193780:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193784:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.193786:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193792:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193798:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.193801:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.193804:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193813:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7df57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193865:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193871:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193877:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193882:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.193885:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.193892:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.194023:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12efd00) 00010000:00010000:3.0:1787857898.194026:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.194030:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.194036:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7df5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.203714:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7df50 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4337 expref: 134 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.203739:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.203743:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.203750:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7df50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4337 expref: 134 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.203771:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72c00, rc 0) 00000100:00100000:2.0:1787857898.204073:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+133:32861:x1874704171831680:12345-192.168.204.36@tcp:101:cat.0 Request processed in 10999us (12354us total) trans 4294968284 rc 301/301 00000100:00100000:2.0:1787857898.204084:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1467 00000100:00100000:0.0:1787857898.216110:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.216162:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.216213:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171832448 00000100:00100000:0.0:1787857898.216224:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171832448 00000100:00100000:0.0:1787857898.216284:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1468 00000100:00100000:0.0:1787857898.216295:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+133:32862:x1874704171832448:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.216327:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.216349:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd433e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216453:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216470:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216482:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216656:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216665:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216673:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216806:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216841:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.216849:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.216861:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000100:00100000:3.0:1787857898.217072:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171832320 00000100:00100000:3.0:1787857898.217079:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171832320 00000100:00100000:3.0:1787857898.217120:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 301 00000100:00100000:3.0:1787857898.217129:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+135:32861:x1874704171832320:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.217347:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+136:32861:x1874704171832320:12345-192.168.204.36@tcp:35:cat.0 Request processed in 218us (1250us total) trans 4294968285 rc 0/0 00000100:00100000:3.0:1787857898.217356:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 301 00010000:00010000:0.0:1787857898.219606:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219623:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219631:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219638:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.219643:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219652:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219672:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.219675:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.219681:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219693:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7df88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219714:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219720:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219726:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219731:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.219734:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219740:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219747:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.219750:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.219753:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219759:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7df7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219770:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219776:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219783:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219788:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.219791:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219797:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219804:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03b00) 00010000:00010000:0.0:1787857898.219806:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.219809:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219814:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7df81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219927:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df73 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd433e expref: 136 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219938:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.219941:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.219944:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7df73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd433e expref: 136 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.219954:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:0.0:1787857898.220036:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+135:32862:x1874704171832448:12345-192.168.204.36@tcp:101:cat.0 Request processed in 3742us (3872us total) trans 4294968286 rc 301/301 00000100:00100000:0.0:1787857898.220050:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1468 00010000:00010000:3.0:1787857898.222418:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857898.226160:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.226320:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171832704 00000100:00100000:3.0:1787857898.226332:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171832704 00000100:00100000:3.0:1787857898.226394:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 302 00000100:00100000:3.0:1787857898.226405:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+135:32862:x1874704171832704:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.227007:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+136:32862:x1874704171832704:12345-192.168.204.36@tcp:35:cat.0 Request processed in 601us (856us total) trans 4294968287 rc 0/0 00000100:00100000:3.0:1787857898.227018:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 302 00000100:00100000:3.0:1787857898.237506:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.238446:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171832960 00000100:00100000:2.0:1787857898.238461:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171832960 00000100:00100000:2.0:1787857898.238544:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1469 00000100:00100000:2.0:1787857898.238554:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+136:32857:x1874704171832960:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.238579:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857898.238602:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7df96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4345 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238686:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238701:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238714:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238730:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238737:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238742:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238918:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238929:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.238938:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.238950:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.239042:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239049:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239057:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239062:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.239066:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239073:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239089:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.239092:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857898.239098:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239104:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7dfab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239120:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239126:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239131:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239137:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.239140:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239146:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239167:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.239170:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.239174:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239180:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7df9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239422:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239427:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239433:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239437:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.239440:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239445:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239453:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379300) 00010000:00010000:2.0:1787857898.239455:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.239458:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239463:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7dfa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239510:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7df96 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4345 expref: 138 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239521:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.239524:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.239528:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7df96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4345 expref: 138 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.239536:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:2.0:1787857898.239659:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+137:32857:x1874704171832960:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1106us (2173us total) trans 4294968288 rc 301/301 00000100:00100000:2.0:1787857898.239668:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1469 00000100:00100000:3.0:1787857898.262063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.262116:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.262148:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171833472 00000100:00100000:3.0:1787857898.262157:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171833472 00000100:00100000:3.0:1787857898.262221:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1470 00000100:00100000:3.0:1787857898.262234:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+137:32870:x1874704171833472:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.262266:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.262292:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7dfb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd434c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262386:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857898.262402:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171833216 00010000:00010000:3.0:1787857898.262407:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857898.262409:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171833216 00010000:00010000:3.0:1787857898.262426:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262444:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262452:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857898.262454:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 303 00010000:00010000:3.0:1787857898.262464:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857898.262468:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+139:32857:x1874704171833216:12345-192.168.204.36@tcp:35:cat.0 00010000:00010000:3.0:1787857898.262619:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262630:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262638:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857898.262648:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000100:00100000:0.0:1787857898.262680:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+140:32857:x1874704171833216:12345-192.168.204.36@tcp:35:cat.0 Request processed in 215us (626us total) trans 4294968289 rc 0/0 00000100:00100000:0.0:1787857898.262688:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 303 00010000:00010000:3.0:1787857898.262704:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262714:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262721:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262727:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.262731:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262739:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262754:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.262757:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857898.262763:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262769:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7dfce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262785:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262791:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262796:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262801:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.262804:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262810:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262851:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.262855:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.262859:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262865:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7dfc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262873:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262878:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262883:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262887:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa73e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.262890:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262896:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262903:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12efd00) 00010000:00010000:3.0:1787857898.262905:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.262907:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262912:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7dfc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262952:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7dfb9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd434c expref: 140 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262968:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.262970:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857898.262974:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7dfb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd434c expref: 140 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.262982:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa72a00, rc 0) 00000100:00100000:3.0:1787857898.263010:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+139:32870:x1874704171833472:12345-192.168.204.36@tcp:101:cat.0 Request processed in 779us (894us total) trans 4294968290 rc 301/301 00000100:00100000:3.0:1787857898.263017:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1470 00000100:00100000:2.0:1787857898.279358:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.279488:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171833728 00000100:00100000:0.0:1787857898.279500:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171833728 00000100:00100000:0.0:1787857898.279563:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 304 00000100:00100000:0.0:1787857898.279574:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6008450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+139:32870:x1874704171833728:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.279873:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6008450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+140:32870:x1874704171833728:12345-192.168.204.36@tcp:35:cat.0 Request processed in 301us (525us total) trans 4294968291 rc 0/0 00000100:00100000:0.0:1787857898.279881:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 304 00000100:00100000:3.0:1787857898.279954:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.280432:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171833984 00000100:00100000:0.0:1787857898.280439:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171833984 00000100:00100000:0.0:1787857898.280489:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1471 00000100:00100000:0.0:1787857898.280503:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+140:32869:x1874704171833984:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.280527:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.280548:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7dfdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4353 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280636:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280657:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280668:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280683:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280691:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280699:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280865:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280876:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280883:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.280904:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.280979:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280986:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.280993:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281000:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.281004:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281011:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281024:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.281027:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.281032:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281038:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7dff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281054:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281061:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281066:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281071:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.281074:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281080:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281091:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.281093:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.281096:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281102:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7dfe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281112:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281118:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281124:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281129:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.281132:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281138:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281145:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03b00) 00010000:00010000:0.0:1787857898.281148:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.281151:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281156:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7dfea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281314:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7dfdc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4353 expref: 142 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281326:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.281328:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.281332:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7dfdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4353 expref: 142 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.281343:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:0.0:1787857898.281392:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+141:32869:x1874704171833984:12345-192.168.204.36@tcp:101:cat.0 Request processed in 889us (1438us total) trans 4294968292 rc 301/301 00000100:00100000:0.0:1787857898.281400:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1471 00000100:00100000:3.0:1787857898.295386:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.295435:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.295911:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171834496 00000100:00100000:1.0:1787857898.295923:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171834496 00000100:00100000:1.0:1787857898.295984:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1472 00000100:00100000:1.0:1787857898.295995:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+141:32867:x1874704171834496:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857898.296023:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857898.296048:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7dfff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd435a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296142:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296157:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296168:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296184:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296191:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296209:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296390:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296401:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.296407:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857898.296417:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787857898.297137:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297149:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297157:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297163:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.297168:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297177:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297204:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.297207:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857898.297214:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297224:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297243:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297250:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297255:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297260:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.297263:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297268:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297275:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.297277:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.297279:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297285:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297295:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297301:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297307:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297311:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.297314:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297320:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297327:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857898.297330:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.297333:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297338:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e00d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297393:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7dfff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd435a expref: 143 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297404:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.297407:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857898.297411:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7dfff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd435a expref: 143 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.297420:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f4000, rc 0) 00000100:00100000:0.0:1787857898.298113:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171834240 00000100:00100000:0.0:1787857898.298127:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171834240 00000100:00100000:0.0:1787857898.298190:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 305 00000100:00100000:0.0:1787857898.298210:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+143:32869:x1874704171834240:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.299363:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+144:32867:x1874704171834496:12345-192.168.204.36@tcp:101:cat.0 Request processed in 3359us (3916us total) trans 4294968293 rc 301/301 00000100:00100000:3.0:1787857898.299377:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1472 00000100:00100000:0.0:1787857898.309174:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+143:32869:x1874704171834240:12345-192.168.204.36@tcp:35:cat.0 Request processed in 10951us (13786us total) trans 4294968294 rc 0/0 00000100:00100000:0.0:1787857898.309205:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 305 00000100:00100000:3.0:1787857898.310427:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.311254:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171834752 00000100:00100000:2.0:1787857898.311267:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171834752 00000100:00100000:2.0:1787857898.311329:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1473 00000100:00100000:2.0:1787857898.311339:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+143:32882:x1874704171834752:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.311363:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857898.311386:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4361 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311474:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311489:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311514:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311531:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311536:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311547:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311694:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311705:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.311893:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.311907:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.312008:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312016:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312022:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312652:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.312658:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312668:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312680:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.312683:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857898.312688:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312694:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312723:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312731:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312737:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312742:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.312744:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312749:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312756:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.312759:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.312762:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312768:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e029 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312777:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312783:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312789:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312794:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.312796:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312802:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312810:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379300) 00010000:00010000:2.0:1787857898.312812:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.312858:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.312866:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.318104:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e022 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4361 expref: 145 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.318134:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.318137:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.318143:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4361 expref: 145 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.318163:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:2.0:1787857898.318256:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+144:32882:x1874704171834752:12345-192.168.204.36@tcp:101:cat.0 Request processed in 6916us (7833us total) trans 4294968295 rc 301/301 00000100:00100000:2.0:1787857898.318271:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1473 00000100:00100000:2.0:1787857898.328065:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.328384:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171835008 00000100:00100000:3.0:1787857898.328394:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171835008 00000100:00100000:3.0:1787857898.328458:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:3.0:1787857898.328469:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+144:32867:x1874704171835008:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.328734:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+145:32867:x1874704171835008:12345-192.168.204.36@tcp:35:cat.0 Request processed in 267us (681us total) trans 4294968296 rc 0/0 00000100:00100000:3.0:1787857898.328743:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 306 00000100:00100000:0.0:1787857898.335435:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.335591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.335790:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171835520 00000100:00100000:0.0:1787857898.335800:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171835520 00000100:00100000:0.0:1787857898.335876:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 307 00000100:00100000:0.0:1787857898.335887:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+145:32882:x1874704171835520:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.336181:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+146:32882:x1874704171835520:12345-192.168.204.36@tcp:35:cat.0 Request processed in 294us (591us total) trans 4294968297 rc 0/0 00000100:00100000:0.0:1787857898.336458:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 307 00000100:00100000:1.0:1787857898.337792:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171835264 00000100:00100000:1.0:1787857898.337863:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171835264 00000100:00100000:1.0:1787857898.337931:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1474 00000100:00100000:1.0:1787857898.337942:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+146:32868:x1874704171835264:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857898.337964:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857898.337986:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4368 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338062:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338078:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338090:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338108:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338115:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338122:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338293:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338305:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338312:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857898.338326:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787857898.338446:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338455:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338463:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338469:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.338474:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338482:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338496:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.338499:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857898.338505:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338513:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e05a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338533:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338538:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338547:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338552:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e95c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.338555:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338561:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338568:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.338570:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.338573:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338800:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e04c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338811:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338847:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338854:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338859:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.338863:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338873:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338883:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857898.338886:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.338889:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338895:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7e053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338943:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e045 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4368 expref: 148 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338955:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.338958:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857898.338962:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4368 expref: 148 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.338972:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94c00, rc 0) 00000100:00100000:1.0:1787857898.339052:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+147:32868:x1874704171835264:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1111us (4246us total) trans 4294968298 rc 301/301 00000100:00100000:1.0:1787857898.339060:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1474 00000100:00100000:2.0:1787857898.350750:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857898.350788:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188296192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857898.350917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857898.351063:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188296192 00000100:00100000:1.0:1787857898.351074:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188296192 00000100:00100000:1.0:1787857898.351143:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787857898.351156:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188296192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857898.351210:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857898.351263:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188296192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857898.351270:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787857898.352938:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188296192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857898.364325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.364431:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171835776 00000100:00100000:2.0:1787857898.364442:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171835776 00000100:00100000:2.0:1787857898.364512:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 308 00000100:00100000:2.0:1787857898.364522:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+147:32868:x1874704171835776:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:2.0:1787857898.364788:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+148:32868:x1874704171835776:12345-192.168.204.36@tcp:35:cat.0 Request processed in 266us (474us total) trans 4294968299 rc 0/0 00000100:00100000:2.0:1787857898.364796:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 308 00000100:00100000:2.0:1787857898.370344:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.370615:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171836032 00000100:00100000:0.0:1787857898.370628:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171836032 00000100:00100000:0.0:1787857898.370698:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1475 00000100:00100000:0.0:1787857898.370709:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+148:32865:x1874704171836032:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.370734:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.370757:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd436f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.371750:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.371772:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.371785:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.371804:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.371847:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.371855:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.371989:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.372003:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.372012:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.372022:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787857898.372509:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372521:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372529:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372536:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.372541:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372549:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372563:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.372566:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857898.372572:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372579:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e07d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372596:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372603:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372609:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372614:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.372617:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372623:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372630:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.372633:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.372636:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372642:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e06f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372651:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372656:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372661:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372665:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.372668:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372677:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372683:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03b00) 00010000:00010000:1.0:1787857898.372685:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.372687:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372692:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372742:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e068 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd436f expref: 150 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372753:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.372755:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857898.372758:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd436f expref: 150 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.372767:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:1.0:1787857898.372907:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+149:32865:x1874704171836032:12345-192.168.204.36@tcp:101:cat.0 Request processed in 2199us (2573us total) trans 4294968300 rc 301/301 00000100:00100000:1.0:1787857898.372917:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1475 00000100:00100000:2.0:1787857898.381324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.381370:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.381642:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171836544 00000100:00100000:1.0:1787857898.381654:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171836544 00000100:00100000:1.0:1787857898.381725:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 309 00000100:00100000:3.0:1787857898.381726:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171836416 00000100:00100000:3.0:1787857898.381734:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171836416 00000100:00100000:1.0:1787857898.381740:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+150:32865:x1874704171836544:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.381782:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1476 00000100:00100000:3.0:1787857898.381792:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+150:32873:x1874704171836416:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.381805:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.381868:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7e08b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4376 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.381936:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.381954:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.381968:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.381984:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.381990:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.381998:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857898.382052:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+152:32865:x1874704171836544:12345-192.168.204.36@tcp:35:cat.0 Request processed in 316us (680us total) trans 4294968301 rc 0/0 00000100:00100000:1.0:1787857898.382061:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 309 00010000:00010000:3.0:1787857898.382128:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382137:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382146:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857898.382155:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1787857898.382220:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382229:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382235:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382241:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.382246:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382254:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382266:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.382270:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857898.382274:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382280:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72800/0xd3f183cab4a7e0a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382297:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382307:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382313:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382319:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.382322:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382327:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382335:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.382338:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.382341:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382346:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72a00/0xd3f183cab4a7e092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382355:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382360:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382366:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382370:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.382373:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382379:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382386:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12efd00) 00010000:00010000:3.0:1787857898.382389:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.382392:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382397:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72200/0xd3f183cab4a7e099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382433:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7e08b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4376 expref: 152 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382444:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.382446:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857898.382449:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73e00/0xd3f183cab4a7e08b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4376 expref: 152 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.382459:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73e00, rc 0) 00000100:00100000:3.0:1787857898.382484:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+151:32873:x1874704171836416:12345-192.168.204.36@tcp:101:cat.0 Request processed in 694us (1176us total) trans 4294968302 rc 301/301 00000100:00100000:3.0:1787857898.382491:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1476 00000100:00100000:0.0:1787857898.386602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.386692:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171836800 00000100:00100000:3.0:1787857898.386704:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171836800 00000100:00100000:3.0:1787857898.386766:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1477 00000100:00100000:3.0:1787857898.386776:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+151:32871:x1874704171836800:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.386805:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.386875:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7e0ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd437d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.386968:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.386987:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.386998:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387013:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387020:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387025:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387168:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387178:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387186:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857898.387208:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1787857898.387308:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387317:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387323:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387329:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.387334:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387341:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387354:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.387356:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857898.387361:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387368:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e0c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387385:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387391:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387396:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387404:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.387407:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387412:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387419:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.387421:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.387424:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387429:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72600/0xd3f183cab4a7e0b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387440:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387446:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387453:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387458:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa72c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.387460:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387465:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387476:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12ef200) 00010000:00010000:3.0:1787857898.387478:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.387481:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387487:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa72c00/0xd3f183cab4a7e0bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387536:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7e0ae lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd437d expref: 153 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387549:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.387552:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857898.387555:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73400/0xd3f183cab4a7e0ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd437d expref: 153 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.387566:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa73400, rc 0) 00000100:00100000:3.0:1787857898.387645:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+152:32871:x1874704171836800:12345-192.168.204.36@tcp:101:cat.0 Request processed in 870us (1056us total) trans 4294968303 rc 301/301 00000100:00100000:3.0:1787857898.387654:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1477 00000100:00100000:3.0:1787857898.389000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.392375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.392466:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171837312 00000100:00100000:1.0:1787857898.392477:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171837312 00000100:00100000:1.0:1787857898.392553:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1478 00000100:00100000:1.0:1787857898.392563:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+152:32858:x1874704171837312:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857898.392590:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857898.392611:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e0d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4384 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392695:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392711:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392722:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392735:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392741:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392747:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392909:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392920:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.392938:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857898.392949:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787857898.393048:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393056:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393064:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393069:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.393074:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393083:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393095:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.393098:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857898.393103:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393109:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e0e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393128:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393134:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393139:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393145:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.393147:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393164:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393172:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.393174:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.393178:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393392:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7e0d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393404:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393410:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393416:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393422:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.393425:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393432:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393440:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857898.393443:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.393446:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393452:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7e0df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393502:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e0d1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4384 expref: 154 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393512:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.393515:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857898.393519:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7e0d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4384 expref: 154 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.393528:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f5000, rc 0) 00000100:00100000:1.0:1787857898.393600:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+153:32858:x1874704171837312:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1038us (1236us total) trans 4294968304 rc 301/301 00000100:00100000:1.0:1787857898.393608:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1478 00000100:00100000:0.0:1787857898.395285:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171837056 00000100:00100000:0.0:1787857898.395297:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171837056 00000100:00100000:0.0:1787857898.395358:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 310 00000100:00100000:0.0:1787857898.395368:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c600b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+153:32873:x1874704171837056:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.396046:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c600b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+154:32873:x1874704171837056:12345-192.168.204.36@tcp:35:cat.0 Request processed in 673us (7048us total) trans 4294968305 rc 0/0 00000100:00100000:0.0:1787857898.396056:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 310 00000100:00100000:3.0:1787857898.406760:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.406806:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.406955:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171837568 00000100:00100000:0.0:1787857898.406966:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171837568 00000100:00100000:0.0:1787857898.407033:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1479 00000100:00100000:0.0:1787857898.407045:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+154:32864:x1874704171837568:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.407068:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.407092:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e0f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd438b expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407209:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407228:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407244:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407263:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407270:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407276:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407438:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407449:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407455:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.407466:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.407581:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407590:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407597:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407603:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.407608:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407617:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407630:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.407633:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.407638:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407646:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407663:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407669:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407675:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407680:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.407683:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407690:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407696:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.407699:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.407703:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407708:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e0fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407717:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407723:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407729:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407735:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.407737:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407743:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407750:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03600) 00010000:00010000:0.0:1787857898.407752:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.407755:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407761:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407803:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e0f4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd438b expref: 156 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407854:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.407856:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.407861:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e0f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd438b expref: 156 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.407872:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:0.0:1787857898.407933:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+155:32864:x1874704171837568:12345-192.168.204.36@tcp:101:cat.0 Request processed in 890us (1185us total) trans 4294968306 rc 301/301 00000100:00100000:0.0:1787857898.407943:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1479 00000100:00100000:1.0:1787857898.408797:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171837824 00000100:00100000:1.0:1787857898.408810:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171837824 00000100:00100000:1.0:1787857898.408885:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 311 00000100:00100000:1.0:1787857898.408907:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+155:32871:x1874704171837824:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857898.409090:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+156:32871:x1874704171837824:12345-192.168.204.36@tcp:35:cat.0 Request processed in 185us (2282us total) trans 4294968307 rc 0/0 00000100:00100000:1.0:1787857898.409099:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 311 00000100:00100000:2.0:1787857898.420586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.420765:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171838080 00000100:00100000:0.0:1787857898.420778:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171838080 00000100:00100000:0.0:1787857898.420880:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1480 00000100:00100000:0.0:1787857898.420892:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+156:32880:x1874704171838080:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.420921:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.420946:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4392 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421032:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421048:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421060:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421076:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421085:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421091:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421248:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421259:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421267:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.421277:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.421370:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421378:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421385:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421391:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.421395:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421403:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421420:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.421423:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.421428:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421435:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e12c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421451:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421457:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421462:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421467:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.421470:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421476:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421483:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.421485:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.421488:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421494:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e11e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421575:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421581:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421586:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421590:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.421593:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421598:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421605:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03600) 00010000:00010000:0.0:1787857898.421607:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.421609:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421614:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421650:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e117 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4392 expref: 158 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421658:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.421660:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.421664:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4392 expref: 158 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.421671:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:0.0:1787857898.421737:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+157:32880:x1874704171838080:12345-192.168.204.36@tcp:101:cat.0 Request processed in 848us (1163us total) trans 4294968308 rc 301/301 00000100:00100000:0.0:1787857898.421745:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1480 00000100:00100000:3.0:1787857898.425059:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.430057:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171838336 00000100:00100000:1.0:1787857898.430082:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171838336 00000100:00100000:1.0:1787857898.430204:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 312 00000100:00100000:1.0:1787857898.430220:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+157:32858:x1874704171838336:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857898.430657:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+158:32858:x1874704171838336:12345-192.168.204.36@tcp:35:cat.0 Request processed in 439us (5609us total) trans 4294968309 rc 0/0 00000100:00100000:1.0:1787857898.430667:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 312 00000100:00100000:3.0:1787857898.435111:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.435328:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171838592 00000100:00100000:0.0:1787857898.435339:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171838592 00000100:00100000:0.0:1787857898.435403:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1481 00000100:00100000:0.0:1787857898.435412:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+158:32859:x1874704171838592:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.435441:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.435465:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e13a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4399 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435572:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435588:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435601:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435770:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435779:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435791:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435972:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435982:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.435990:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.436001:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.436114:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436122:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436129:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436135:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.436140:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436147:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436160:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.436163:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.436169:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436175:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e14f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436201:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436207:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436212:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436218:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.436221:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436227:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436234:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.436237:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.436240:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436246:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436256:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436261:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436267:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436271:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.436274:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436280:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436286:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03f00) 00010000:00010000:0.0:1787857898.436288:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.436291:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436296:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436339:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e13a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4399 expref: 160 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436350:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.436353:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.436356:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e13a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4399 expref: 160 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.436366:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:0.0:1787857898.436436:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+159:32859:x1874704171838592:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1025us (1336us total) trans 4294968310 rc 301/301 00000100:00100000:0.0:1787857898.436447:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1481 00000100:00100000:3.0:1787857898.436953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.437249:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171838848 00000100:00100000:1.0:1787857898.437257:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171838848 00000100:00100000:1.0:1787857898.437316:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 313 00000100:00100000:1.0:1787857898.437326:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+159:32864:x1874704171838848:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857898.437532:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+160:32864:x1874704171838848:12345-192.168.204.36@tcp:35:cat.0 Request processed in 207us (581us total) trans 4294968311 rc 0/0 00000100:00100000:1.0:1787857898.437541:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 313 00000100:00100000:1.0:1787857898.447812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.447928:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171839104 00000100:00100000:2.0:1787857898.447940:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171839104 00000100:00100000:2.0:1787857898.448008:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1482 00000100:00100000:2.0:1787857898.448018:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+160:32866:x1874704171839104:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.448045:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857898.448070:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e15d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43a0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448153:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448169:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448182:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448206:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448214:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448220:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448366:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448376:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448384:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.448395:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.448958:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448969:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448976:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448983:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.448987:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.448995:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449008:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.449011:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857898.449016:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449023:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449039:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449045:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449051:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449057:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.449060:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449065:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449077:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.449079:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.449082:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449087:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449095:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449101:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449107:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449112:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.449115:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449121:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449128:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379300) 00010000:00010000:2.0:1787857898.449130:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.449132:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449139:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e16b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449186:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e15d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43a0 expref: 162 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449209:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.449211:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.449215:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e15d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43a0 expref: 162 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.449225:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:2.0:1787857898.449294:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+161:32866:x1874704171839104:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1277us (1493us total) trans 4294968312 rc 301/301 00000100:00100000:2.0:1787857898.449303:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1482 00000100:00100000:3.0:1787857898.449731:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.449799:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171839360 00000100:00100000:0.0:1787857898.449807:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171839360 00000100:00100000:0.0:1787857898.449888:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 314 00000100:00100000:0.0:1787857898.449898:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+161:32880:x1874704171839360:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.450070:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+162:32880:x1874704171839360:12345-192.168.204.36@tcp:35:cat.0 Request processed in 172us (341us total) trans 4294968313 rc 0/0 00000100:00100000:0.0:1787857898.450078:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 314 00000100:00100000:0.0:1787857898.456260:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.457463:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171839616 00000100:00100000:1.0:1787857898.457475:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171839616 00000100:00100000:1.0:1787857898.457543:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 315 00000100:00100000:1.0:1787857898.457559:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+162:32859:x1874704171839616:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857898.457844:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+163:32859:x1874704171839616:12345-192.168.204.36@tcp:35:cat.0 Request processed in 281us (1591us total) trans 4294968314 rc 0/0 00000100:00100000:1.0:1787857898.457853:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 315 00000100:00100000:1.0:1787857898.458732:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.458796:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171839872 00000100:00100000:0.0:1787857898.458803:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171839872 00000100:00100000:0.0:1787857898.458876:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1483 00000100:00100000:0.0:1787857898.458885:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+163:32878:x1874704171839872:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.458916:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.458944:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43a7 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459012:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459027:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459040:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459054:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459063:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459069:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459207:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459216:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459223:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.459235:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.459326:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459335:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459342:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459348:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.459353:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459360:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459384:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.459387:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.459392:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459398:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459411:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459417:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459423:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459429:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.459431:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459437:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459444:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.459446:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.459449:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459454:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e187 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459466:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459472:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459477:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459482:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.459654:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459663:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459672:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03f00) 00010000:00010000:0.0:1787857898.459675:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.459678:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459684:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e18e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459726:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e180 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43a7 expref: 165 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459737:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.459740:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.459744:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43a7 expref: 165 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.459755:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c0030200, rc 0) 00000100:00100000:0.0:1787857898.459802:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+164:32878:x1874704171839872:12345-192.168.204.36@tcp:101:cat.0 Request processed in 918us (1073us total) trans 4294968315 rc 301/301 00000100:00100000:0.0:1787857898.459810:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1483 00000100:00100000:0.0:1787857898.466726:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.471169:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171840128 00000100:00100000:3.0:1787857898.471186:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171840128 00000100:00100000:1.0:1787857898.471448:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.471628:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171840384 00000100:00100000:0.0:1787857898.471633:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171840384 00000100:00100000:0.0:1787857898.471689:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 316 00000100:00100000:0.0:1787857898.471701:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c600b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+165:32866:x1874704171840384:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.471986:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c600b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+166:32866:x1874704171840384:12345-192.168.204.36@tcp:35:cat.0 Request processed in 286us (542us total) trans 4294968316 rc 0/0 00000100:00100000:0.0:1787857898.471994:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 316 00000100:00100000:2.0:1787857898.472224:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1484 00000100:00100000:2.0:1787857898.472233:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+165:32881:x1874704171840128:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.472246:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857898.472269:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e1a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43ae expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472358:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472377:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472389:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472411:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472433:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472441:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472792:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472805:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.472853:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.472869:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.473019:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473027:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473034:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473041:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.473046:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473060:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473076:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.473079:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857898.473084:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473091:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473107:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473113:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473119:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473124:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.473128:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473134:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473142:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.473144:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.473147:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473157:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473166:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473172:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473178:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473182:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.473185:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473202:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473210:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379300) 00010000:00010000:2.0:1787857898.473213:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.473216:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473222:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473263:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e1a3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ae expref: 167 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473281:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.473283:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.473287:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e1a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ae expref: 167 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.473619:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:2.0:1787857898.473680:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+166:32881:x1874704171840128:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1447us (6961us total) trans 4294968317 rc 301/301 00000100:00100000:2.0:1787857898.473690:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1484 00000100:00100000:0.0:1787857898.488331:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.488430:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171840640 00000100:00100000:1.0:1787857898.488439:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171840640 00000100:00100000:1.0:1787857898.488509:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1485 00000100:00100000:1.0:1787857898.488520:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+166:32874:x1874704171840640:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857898.488547:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857898.488571:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e1c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43b5 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488669:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488688:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488702:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488718:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488726:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488733:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488934:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488947:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.488955:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857898.488966:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787857898.489068:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489078:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489087:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489094:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.489100:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489109:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489126:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:1.0:1787857898.489130:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857898.489136:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489147:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e1db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489167:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489174:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489180:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489185:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f8e94c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.489188:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489206:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489213:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.489215:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.489218:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489223:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e1cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489233:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489239:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489246:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489252:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857898.489255:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489260:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489267:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857898.489269:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857898.489272:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489278:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e1d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489321:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e1c6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43b5 expref: 168 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489332:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:1.0:1787857898.489334:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857898.489338:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e1c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43b5 expref: 168 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857898.489348:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95c00, rc 0) 00000100:00100000:1.0:1787857898.489418:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+167:32874:x1874704171840640:12345-192.168.204.36@tcp:101:cat.0 Request processed in 900us (1098us total) trans 4294968318 rc 301/301 00000100:00100000:1.0:1787857898.489430:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1485 00000100:00100000:3.0:1787857898.496107:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.496156:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.496246:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171840896 00000100:00100000:1.0:1787857898.496258:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171840896 00000100:00100000:1.0:1787857898.496315:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 317 00000100:00100000:1.0:1787857898.496326:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+167:32874:x1874704171840896:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857898.496563:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+168:32874:x1874704171840896:12345-192.168.204.36@tcp:35:cat.0 Request processed in 238us (465us total) trans 4294968319 rc 0/0 00000100:00100000:1.0:1787857898.496571:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 317 00000100:00100000:3.0:1787857898.504243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.505044:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171841408 00000100:00100000:0.0:1787857898.505059:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171841408 00000100:00100000:0.0:1787857898.505116:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:0.0:1787857898.505127:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+168:32878:x1874704171841408:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.505410:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+169:32878:x1874704171841408:12345-192.168.204.36@tcp:35:cat.0 Request processed in 284us (1178us total) trans 4294968320 rc 0/0 00000100:00100000:0.0:1787857898.505419:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 318 00000100:00100000:2.0:1787857898.506112:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171841152 00000100:00100000:2.0:1787857898.506120:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171841152 00000100:00100000:2.0:1787857898.506155:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1486 00000100:00100000:2.0:1787857898.506163:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+169:32877:x1874704171841152:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.506177:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857898.506212:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43bc expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506302:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506318:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506330:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506344:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506352:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506359:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506467:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506478:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506485:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.506496:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.506558:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506566:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506574:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506581:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.506586:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506594:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506613:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.506617:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857898.506623:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506631:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e1fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506647:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506653:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506659:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506664:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.506667:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506673:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506681:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.506684:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.506687:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506694:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e1f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506708:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506714:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506720:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506726:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.506729:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506736:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506743:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379300) 00010000:00010000:2.0:1787857898.506745:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.506748:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506753:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e1f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506788:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1e9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43bc expref: 171 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506799:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.506801:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.506805:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e1e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43bc expref: 171 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.506835:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6e00, rc 0) 00000100:00100000:2.0:1787857898.506881:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+170:32877:x1874704171841152:12345-192.168.204.36@tcp:101:cat.0 Request processed in 719us (10724us total) trans 4294968321 rc 301/301 00000100:00100000:2.0:1787857898.506888:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1486 00000100:00100000:3.0:1787857898.510701:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.510734:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857898.511031:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171841920 00000100:00100000:0.0:1787857898.511046:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171841920 00000100:00100000:0.0:1787857898.511120:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1487 00000100:00100000:0.0:1787857898.511132:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+170:32872:x1874704171841920:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.511164:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.511201:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e20c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43c3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511317:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511338:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511352:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511370:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511377:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511383:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511556:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511567:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511576:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.511589:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.511695:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511703:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511710:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511716:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.511720:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511728:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511741:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.511745:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.511750:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511756:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511773:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511779:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511784:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511793:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc5a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.511797:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511803:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511810:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.511813:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.511846:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511852:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e213 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511862:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511869:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511875:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511880:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.511883:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511889:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511902:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03f00) 00010000:00010000:0.0:1787857898.511904:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.511907:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511913:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4600/0xd3f183cab4a7e21a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511955:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e20c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43c3 expref: 172 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511966:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.511968:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.511971:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e20c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43c3 expref: 172 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.511980:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4e00, rc 0) 00000100:00100000:0.0:1787857898.512053:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+171:32872:x1874704171841920:12345-192.168.204.36@tcp:101:cat.0 Request processed in 923us (1317us total) trans 4294968322 rc 301/301 00000100:00100000:0.0:1787857898.512062:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1487 00000100:00100000:0.0:1787857898.513060:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171841664 00000100:00100000:0.0:1787857898.513071:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171841664 00000100:00100000:0.0:1787857898.513112:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00100000:0.0:1787857898.513120:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+171:32881:x1874704171841664:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1787857898.513362:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+172:32881:x1874704171841664:12345-192.168.204.36@tcp:35:cat.0 Request processed in 241us (2669us total) trans 4294968323 rc 0/0 00000100:00100000:0.0:1787857898.513375:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 319 00000100:00100000:1.0:1787857898.522881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.522927:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857898.522957:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171842432 00000100:00100000:1.0:1787857898.522967:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171842432 00000100:00100000:1.0:1787857898.523021:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 320 00000100:00100000:1.0:1787857898.523032:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+172:32877:x1874704171842432:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1787857898.523283:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+173:32877:x1874704171842432:12345-192.168.204.36@tcp:35:cat.0 Request processed in 252us (354us total) trans 4294968324 rc 0/0 00000100:00100000:1.0:1787857898.523482:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 320 00000100:00100000:0.0:1787857898.526047:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171842176 00000100:00100000:0.0:1787857898.526063:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171842176 00000100:00100000:0.0:1787857898.526141:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1488 00000100:00100000:0.0:1787857898.526154:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+173:32875:x1874704171842176:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857898.526179:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857898.526214:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e22f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43ca expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526326:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526341:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526353:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526370:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526376:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526382:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526707:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526721:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.526729:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857898.526739:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787857898.527125:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527134:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527140:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527146:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.527151:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527158:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527170:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:0.0:1787857898.527173:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857898.527179:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527186:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527217:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527223:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527229:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527234:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.527237:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527244:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527252:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.527254:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.527257:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527263:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527274:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527280:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527285:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527470:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fc200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857898.527474:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527481:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527559:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9997c3d03600) 00010000:00010000:0.0:1787857898.527562:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857898.527566:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527572:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e23d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527623:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e22f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ca expref: 175 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527634:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:0.0:1787857898.527636:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857898.527640:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e22f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ca expref: 175 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857898.527650:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857898.527721:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+174:32875:x1874704171842176:12345-192.168.204.36@tcp:101:cat.0 Request processed in 1570us (4851us total) trans 4294968325 rc 301/301 00000100:00100000:0.0:1787857898.527730:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1488 00000100:00100000:0.0:1787857898.528357:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.531257:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171842688 00000100:00100000:3.0:1787857898.531276:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171842688 00000100:00100000:3.0:1787857898.531363:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 321 00000100:00100000:3.0:1787857898.531374:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+174:32872:x1874704171842688:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.531813:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+175:32872:x1874704171842688:12345-192.168.204.36@tcp:35:cat.0 Request processed in 438us (3458us total) trans 4294968326 rc 0/0 00000100:00100000:3.0:1787857898.531844:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 321 00000100:00100000:1.0:1787857898.534201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857898.534300:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171842944 00000100:00100000:2.0:1787857898.534312:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171842944 00000100:00100000:2.0:1787857898.534377:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1489 00000100:00100000:2.0:1787857898.534388:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+175:32879:x1874704171842944:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857898.534420:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857898.534442:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43d1 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534547:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534564:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534578:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534593:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534601:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534611:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534751:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534762:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534770:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857898.534782:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857898.534924:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534931:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534938:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534944:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.534949:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534956:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534968:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857898.534970:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857898.534975:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534981:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.534996:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535001:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535007:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535011:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.535014:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535018:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535023:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.535025:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.535027:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535032:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535039:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535045:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535051:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535056:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857898.535058:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535064:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535070:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998c3379300) 00010000:00010000:2.0:1787857898.535073:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857898.535075:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535081:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535121:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e252 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43d1 expref: 177 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535131:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857898.535133:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857898.535137:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43d1 expref: 177 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857898.535147:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce7600, rc 0) 00000100:00100000:2.0:1787857898.535220:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+176:32879:x1874704171842944:12345-192.168.204.36@tcp:101:cat.0 Request processed in 832us (1038us total) trans 4294968327 rc 301/301 00000100:00100000:2.0:1787857898.535231:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1489 00000100:00100000:0.0:1787857898.542348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.542456:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171843200 00000100:00100000:3.0:1787857898.542470:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171843200 00000100:00100000:3.0:1787857898.542545:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 322 00000100:00100000:3.0:1787857898.542557:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6008850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+176:32875:x1874704171843200:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.542854:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6008850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+177:32875:x1874704171843200:12345-192.168.204.36@tcp:35:cat.0 Request processed in 298us (522us total) trans 4294968328 rc 0/0 00000100:00100000:3.0:1787857898.542863:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 322 00000100:00100000:1.0:1787857898.546575:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.546665:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171843456 00000100:00100000:3.0:1787857898.546675:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171843456 00000100:00100000:3.0:1787857898.546732:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1490 00000100:00100000:3.0:1787857898.546743:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+177:32876:x1874704171843456:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1787857898.546769:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857898.546794:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e275 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43d8 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.546911:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.546927:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.546938:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.546953:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.546959:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.546965:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547097:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547108:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547115:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857898.547125:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1787857898.547235:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547246:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547253:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547259:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999014e3e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.547263:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547270:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547282:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857898.547285:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857898.547290:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547297:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e28a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547312:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547318:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547323:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547328:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.547332:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547338:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547344:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.547346:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.547349:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547355:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e27c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547364:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547370:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547376:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547380:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857898.547382:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547388:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547396:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff9998d12ef200) 00010000:00010000:3.0:1787857898.547398:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857898.547401:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547406:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547445:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e275 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43d8 expref: 179 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547456:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:3.0:1787857898.547458:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857898.547462:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e275 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43d8 expref: 179 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857898.547471:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090200, rc 0) 00000100:00100000:3.0:1787857898.547535:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+178:32876:x1874704171843456:12345-192.168.204.36@tcp:101:cat.0 Request processed in 794us (969us total) trans 4294968329 rc 301/301 00000100:00100000:3.0:1787857898.547544:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1490 00000100:00100000:2.0:1787857898.552679:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.553045:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171843712 00000100:00100000:3.0:1787857898.553058:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171843712 00000100:00100000:2.0:1787857898.553248:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 323 00000100:00100000:2.0:1787857898.553261:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+178:32879:x1874704171843712:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:2.0:1787857898.553555:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+179:32879:x1874704171843712:12345-192.168.204.36@tcp:35:cat.0 Request processed in 296us (886us total) trans 4294968330 rc 0/0 00000100:00100000:2.0:1787857898.553564:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 323 00000100:00100000:0.0:1787857898.557644:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857898.557734:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171843968 00000100:00100000:3.0:1787857898.557745:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171843968 00000100:00100000:3.0:1787857898.557795:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 324 00000100:00100000:3.0:1787857898.557804:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+179:32876:x1874704171843968:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1787857898.558110:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+180:32876:x1874704171843968:12345-192.168.204.36@tcp:35:cat.0 Request processed in 306us (476us total) trans 4294968331 rc 0/0 00000100:00100000:3.0:1787857898.558119:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 324 00000040:00080000:3.0:1787857899.119437:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857899.119451:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857899.119496:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 45 count 4 00000040:00080000:3.0:1787857899.119504:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857899.119662:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188296320:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857899.119786:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7227b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857899.133051:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188296320:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857899.135523:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.136013:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171844096 00000100:00100000:2.0:1787857899.136027:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171844096 00000100:00100000:2.0:1787857899.136129:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1491 00000100:00100000:2.0:1787857899.136140:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32883:x1874704171844096:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857899.136189:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x52:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857899.136325:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32883:x1874704171844096:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 185us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.136334:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1491 00000100:00080000:3.0:1787857899.136417:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857899.141228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.143007:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171844224 00000100:00100000:2.0:1787857899.143023:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171844224 00000100:00100000:2.0:1787857899.143206:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1492 00000100:00100000:2.0:1787857899.143218:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32883:x1874704171844224:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787857899.143290:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143307:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143322:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143337:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143344:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143349:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143372:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143381:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143387:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857899.143427:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:2.0:1787857899.143432:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857899.143446:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143457:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143463:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143469:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143480:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857899.143663:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143672:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143685:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857899.143688:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857899.143694:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143701:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e298 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143716:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143723:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143734:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143739:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857899.143742:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143747:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143758:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8138294e (ffff9998c3379300) 00010000:00010000:2.0:1787857899.143761:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857899.143764:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143770:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e29f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143785:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143791:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143796:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143801:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857899.143804:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.143810:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.144057:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857899.144061:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857899.144065:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.144071:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e2a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.144297:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32883:x1874704171844224:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 1079us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.144307:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1492 00000100:00100000:0.0:1787857899.151194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.151458:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171844480 00000100:00100000:2.0:1787857899.151470:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171844480 00000100:00100000:2.0:1787857899.151539:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1493 00000100:00100000:2.0:1787857899.151561:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32883:x1874704171844480:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857899.151592:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857899.151612:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e2ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43df expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151717:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151733:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151747:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857899.151758:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787857899.151892:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151900:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151906:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151917:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857899.151922:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151929:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151941:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857899.151944:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857899.151949:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151955:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e2b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.151996:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e2ad lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43df expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.152006:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9998d8bfd200) 00010000:00010000:2.0:1787857899.152009:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857899.152012:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e2ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43df expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.152023:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:2.0:1787857899.152096:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32883:x1874704171844480:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 547us (924us total) trans 4294968332 rc 301/301 00000100:00100000:2.0:1787857899.152104:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1493 00000100:00100000:0.0:1787857899.157203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.157291:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171844608 00000100:00100000:1.0:1787857899.157301:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171844608 00000100:00100000:1.0:1787857899.157366:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1494 00000100:00100000:1.0:1787857899.157376:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32883:x1874704171844608:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857899.157414:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x52:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857899.157534:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32883:x1874704171844608:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 159us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857899.157543:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1494 00000100:00100000:2.0:1787857899.161963:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857899.162075:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171844864 00000100:00100000:0.0:1787857899.162089:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171844864 00000100:00100000:0.0:1787857899.162160:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1495 00000100:00100000:0.0:1787857899.162172:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32883:x1874704171844864:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857899.162214:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857899.162244:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7e2c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43e6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857899.164311:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:0.0:1787857899.166335:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e2c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.166359:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.166373:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.166466:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7e2c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43e6 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.166613:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43e6 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.166629:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857899.166632:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857899.166636:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd400, rc 0) 00000100:00100000:0.0:1787857899.166786:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32883:x1874704171844864:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 4615us (4834us total) trans 4294968333 rc 0/0 00000100:00100000:0.0:1787857899.166796:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1495 00000100:00100000:0.0:1787857899.177036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.177162:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171845120 00000100:00100000:2.0:1787857899.177174:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171845120 00000100:00100000:2.0:1787857899.177308:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1496 00000100:00100000:2.0:1787857899.177320:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32883:x1874704171845120:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857899.177388:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857899.177418:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e2c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43e6 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.177440:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857899.177454:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857899.177628:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.177645:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.177655:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.177718:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.177727:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.177734:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178016:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178031:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178039:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178045:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857899.178050:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178059:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178069:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9998e1a0c900) 00010000:00010000:2.0:1787857899.178072:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857899.178077:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178083:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e2d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178094:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178099:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178104:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178109:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857899.178112:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178118:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178125:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0xea2bfd12 (ffff9998c3379300) 00010000:00010000:2.0:1787857899.178127:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857899.178130:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.178136:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e2de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0xea2bfd12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.178240:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32883:x1874704171845120:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 920us (1215us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857899.178248:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1496 00000100:00100000:3.0:1787857899.181651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.182753:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171845248 00000100:00100000:1.0:1787857899.182767:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171845248 00000100:00100000:0.0:1787857899.182887:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1497 00000100:00100000:0.0:1787857899.182904:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:32883:x1874704171845248:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857899.182929:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857899.182970:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc600/0xd3f183cab4a7e2e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43ed expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.183017:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.183032:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.183047:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.183187:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc600/0xd3f183cab4a7e2e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.183208:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 56 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.183219:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:0.0:1787857899.183222:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857899.183225:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd200, rc 0) 00000100:00100000:0.0:1787857899.183303:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32883:x1874704171845248:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 404us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.183310:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1497 00000100:00100000:0.0:1787857899.189166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857899.191718:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171845504 00000100:00100000:0.0:1787857899.191744:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171845504 00000100:00100000:0.0:1787857899.191864:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1498 00000100:00100000:0.0:1787857899.191887:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32883:x1874704171845504:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857899.191993:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.192013:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.192025:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857899.192430:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 88 off9528 00000004:00080000:0.0:1787857899.192442:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723242624535ns, next at 724242622333ns, rc = 0 00000004:00010000:0.0:1787857899.193151:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015d5c168 reply state 000000008c95571a transno 4294968334 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857899.193162:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857899.193343:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:32883:x1874704171845504:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1466us (4183us total) trans 4294968334 rc 0/0 00000100:00100000:0.0:1787857899.193353:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1498 00000100:00100000:0.0:1787857899.198632:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.198693:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171845632 00000100:00100000:2.0:1787857899.198703:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171845632 00000100:00100000:2.0:1787857899.198766:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1499 00000100:00100000:2.0:1787857899.198778:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:32883:x1874704171845632:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857899.198806:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857899.198971:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43f4 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.199049:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 59 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.199065:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 59 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.199067:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.199076:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.199083:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.199088:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:2.0:1787857899.199090:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857899.199094:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00010000:00010000:1.0:1787857899.199424:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fc200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857899.199431:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.199440:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.199452:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:1.0:1787857899.199455:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857899.199459:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.199465:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e2f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.199653:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:32883:x1874704171845632:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 877us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.199661:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1499 00000100:00100000:2.0:1787857899.204993:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857899.205114:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171845760 00000100:00100000:0.0:1787857899.205126:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171845760 00000100:00100000:0.0:1787857899.205203:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 411 00000100:00100000:0.0:1787857899.205215:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171845760:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787857899.205656:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857899.206737:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171845760:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 1518us (1745us total) trans 4294967386 rc 0/0 00000100:00100000:0.0:1787857899.206748:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 411 00000100:00100000:2.0:1787857899.211634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857899.211743:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171846016 00000100:00100000:3.0:1787857899.211754:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171846016 00000100:00100000:2.0:1787857899.212576:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 325 00000100:00100000:2.0:1787857899.212588:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:32883:x1874704171846016:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857899.212859:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:32883:x1874704171846016:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 273us (1234us total) trans 4294968335 rc 0/0 00000100:00100000:2.0:1787857899.212868:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 325 00000100:00100000:0.0:1787857899.215709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.215790:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171846272 00000100:00100000:1.0:1787857899.215800:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171846272 00000100:00100000:1.0:1787857899.215880:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1500 00000100:00100000:1.0:1787857899.215892:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:32883:x1874704171846272:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857899.216020:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:32883:x1874704171846272:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857899.216028:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1500 00000100:00100000:3.0:1787857899.228375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.228888:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171846400 00000100:00100000:2.0:1787857899.228903:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171846400 00000100:00100000:2.0:1787857899.228984:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1501 00000100:00100000:2.0:1787857899.228996:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:32883:x1874704171846400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857899.229023:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857899.229051:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e301 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd43fb expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.229142:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e308 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.229157:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.229170:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857899.229228:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857899.229250:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.229276:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e301 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43fb expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.229295:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e308 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43fb expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.229304:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:2.0:1787857899.229307:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787857899.229310:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2707c00, rc 0) 00000100:00100000:2.0:1787857899.229383:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:32883:x1874704171846400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 389us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.229390:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1501 00010000:00010000:3.0:1787857899.247861:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857899.249729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857899.249872:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171846528 00000100:00100000:0.0:1787857899.249891:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171846528 00000100:00100000:0.0:1787857899.249956:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 412 00000100:00100000:0.0:1787857899.249967:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171846528:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857899.249990:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857899.250015:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4402 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857899.250050:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908bea, blocks: 0x1 00010000:00010000:0.0:1787857899.250076:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1787857899.250082:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857899.250092:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.250111:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 12 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.250125:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fc600, rc 0) 00000100:00100000:0.0:1787857899.250198:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171846528:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 232us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.250206:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 412 00000100:00100000:0.0:1787857899.258228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.261692:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171846784 00000100:00100000:2.0:1787857899.261709:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171846784 00000100:00100000:2.0:1787857899.261789:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1502 00000100:00100000:2.0:1787857899.261799:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:32883:x1874704171846784:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857899.262208:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:32883:x1874704171846784:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 407us (3990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.262217:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1502 00000100:00100000:1.0:1787857899.280645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.280859:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171846912 00000100:00100000:2.0:1787857899.280997:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171846912 00000100:00100000:0.0:1787857899.281138:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:0.0:1787857899.281149:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:32883:x1874704171846912:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857899.281169:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857899.281196:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4409 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.281230:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.281239:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857899.281243:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857899.281248:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.281287:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 13 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.281300:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 13 pid: 8490 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857899.281321:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900b2bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188296448:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857899.281429:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b84240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857899.291474:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900b2bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188296448:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857899.291532:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.291558:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fc200, rc 0) 00000100:00100000:0.0:1787857899.291624:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:32883:x1874704171846912:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 10475us (10991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.291634:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 413 00000100:00100000:1.0:1787857899.308166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.310023:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171847040 00000100:00100000:2.0:1787857899.310038:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171847040 00010000:00010000:2.0:1787857899.310098:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 13 pid: 8490 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.310155:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 437 00000100:00100000:2.0:1787857899.310193:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171847040:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857899.310212:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857899.310234:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 13 pid: 8490 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.310247:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 13 pid: 8490 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.310270:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e30f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4402 expref: 13 pid: 8490 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.310289:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857899.310293:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857899.310301:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.310311:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.310350:0:17347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.310365:0:17347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17347:1874704188296576:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857899.310454:0:17347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d09bfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857899.326788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.326972:0:17347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17347:1874704188296576:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857899.327001:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857899.327070:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171847040:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 16895us (18915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.327082:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 437 00000100:00100000:0.0:1787857899.327340:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171847168 00000100:00100000:0.0:1787857899.327347:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171847168 00002000:00100000:0.0:1787857899.327398:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1f:0x0] (0->157) req@ffff9998f9d0b0c0 x1874704171847168/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:545/0 lens 648/0 e 0 to 0 dl 1787857910 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857899.327409:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d0b0c0 with x1874704171847168 ext(0->157) 00002000:00010000:0.0:1787857899.327413:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f9d0b0c0 00000100:00100000:0.0:1787857899.327449:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 123 00000100:00100000:0.0:1787857899.327459:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171847168:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787857899.327997:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171847168:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 536us (1217us total) trans 4294967387 rc 0/0 00000100:00100000:0.0:1787857899.328005:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 123 00002000:00100000:0.0:1787857899.328013:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1f:0x0] (0->157) req@ffff9998f9d0b0c0 x1874704171847168/t4294967387(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:545/0 lens 648/448 e 0 to 0 dl 1787857910 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857899.328022:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d0b0c0 with x1874704171847168 ext(0->157) 00002000:00010000:0.0:1787857899.328026:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998f9d0b0c0 00000100:00100000:0.0:1787857899.337198:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.337311:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171847296 00000100:00100000:2.0:1787857899.337320:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171847296 00000100:00100000:2.0:1787857899.337393:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1503 00000100:00100000:2.0:1787857899.337405:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:32883:x1874704171847296:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787857899.484071:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968334 is committed 00000004:00080000:0.0:1787857899.484092:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 22 committed 00000001:00080000:0.0:1787857899.484124:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968325 is committed 00000001:00080000:0.0:1787857899.484222:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968335 is committed 00000001:00080000:0.0:1787857899.484230:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968330 is committed 00000001:00080000:0.0:1787857899.484262:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968331 is committed 00000004:00080000:0.0:1787857899.484303:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000100:00100000:3.0:1787857899.484767:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188296832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787857899.484869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857899.484962:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857899.484973:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188296704:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787857899.485005:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857899.485013:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32883:x1874704171847296:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 147607us (147839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.485026:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1503 00000100:00100000:1.0:1787857899.485391:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188296832 00000100:00100000:1.0:1787857899.485399:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188296832 00000100:00100000:1.0:1787857899.485475:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188296704 00000100:00100000:1.0:1787857899.485479:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188296704 00000100:00100000:1.0:1787857899.485504:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1787857899.485515:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188296832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787857899.485717:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787857899.485722:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 1787857898 00002000:00010000:1.0:1787857899.485724:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787857899.485727:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1787857898 -> 1787857898 00002000:00010000:1.0:1787857899.485729:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787857899.485776:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188296832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 264us (907us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787857899.485783:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1787857899.485798:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1787857899.485805:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188296704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787857899.485850:0:6711:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:28 count 1 00010000:00010000:1.0:1787857899.485893:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.485920:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 10 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.485933:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 16 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.485942:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787857899.485947:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857899.485952:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.485988:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 16 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.486003:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 16 pid: 14028 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857899.486017:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188296960:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857899.486085:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 10 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.486095:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 10 pid: 6711 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857899.486104:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188297088:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857899.486129:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b6c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787857899.487772:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857899.487787:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787857899.487912:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99990153da40/2, rc 0, transno 4294967388 00000100:00100000:3.0:1787857899.487925:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188296832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787857899.493267:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188296960:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857899.499024:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188297088:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857899.499064:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.509886:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.509929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.509948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.510029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171847424 00000100:00100000:1.0:1787857899.510041:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171847424 00010000:00010000:1.0:1787857899.510107:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 17 pid: 14028 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857899.510143:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171847680 00000100:00100000:1.0:1787857899.510147:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171847680 00010000:00010000:1.0:1787857899.510164:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 11 pid: 6711 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857899.510200:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 438 00000100:00100000:1.0:1787857899.510213:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+17:2349:x1874704171847424:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857899.510230:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857899.510237:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 17 pid: 14028 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510251:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 17 pid: 14028 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510279:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ffbc95b/0xd3f183cab4a7dda5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42c0 expref: 17 pid: 14028 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510310:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857899.510378:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171847424:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 168us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857899.510387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 438 00000100:00100000:1.0:1787857899.510408:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 439 00000100:00100000:1.0:1787857899.510416:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171847680:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857899.510437:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857899.510443:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 11 pid: 6711 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510455:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 11 pid: 6711 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510470:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c74fa38a/0xd3f183cab4a7dd82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd42b2 expref: 11 pid: 6711 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510481:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857899.510486:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857899.510492:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510504:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510538:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857899.510560:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171847680:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 145us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857899.510566:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 439 00010000:00010000:1.0:1787857899.510595:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510605:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510617:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510626:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.510647:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857899.511383:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188296704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25576us (26374us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787857899.511391:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1787857899.511413:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171847552 00000100:00100000:1.0:1787857899.511419:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171847552 00000100:00100000:1.0:1787857899.511450:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 416 00000100:00100000:1.0:1787857899.511459:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171847552:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787857899.511541:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857899.511549:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.511559:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857899.511563:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.511573:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.511594:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.511602:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e31d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.511622:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857899.511624:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857899.511626:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787857899.511692:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998f9d09a40/2, rc 0, transno 4294967375 00000100:00100000:1.0:1787857899.511701:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188296704:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787857899.514498:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787857899.591366:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967387 is committed 00000001:00080000:2.0:1787857899.591723:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967388 is committed 00000100:00100000:0.0:1787857899.593600:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171847552:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 82128us (83656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.593615:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 416 00000100:00100000:2.0:1787857899.608234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857899.608508:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171847936 00000100:00100000:3.0:1787857899.608521:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171847936 00000100:00100000:3.0:1787857899.608590:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1504 00000100:00100000:3.0:1787857899.608601:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32883:x1874704171847936:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857899.608802:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857899.608887:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e308 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43fb expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.608911:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:3.0:1787857899.608917:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857899.608949:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.608963:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.608973:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857899.609229:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005440cc33 reply state 00000000f1255a54 transno 4294968336 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857899.609240:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857899.609601:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:32883:x1874704171847936:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 999us (1378us total) trans 4294968336 rc 0/0 00000100:00100000:3.0:1787857899.609610:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1504 00010000:00010000:1.0:1787857899.614743:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.614762:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.614769:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.614777:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c52a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857899.614782:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.614790:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.614810:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:1.0:1787857899.614813:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857899.615221:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.615229:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e324 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.616595:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857899.619047:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171848064 00000100:00100000:3.0:1787857899.619067:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171848064 00000100:00100000:3.0:1787857899.619218:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 417 00000100:00100000:3.0:1787857899.619229:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171848064:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787857899.619521:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:3.0:1787857899.619526:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 1787857898 -> 1787857895 00002000:00010000:3.0:1787857899.619528:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 0 -> 1787857895 00002000:00010000:3.0:1787857899.619531:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1787857898 -> 1787857897 00002000:00010000:3.0:1787857899.619533:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787857899.619598:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171848064:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 371us (3013us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787857899.619606:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 417 00000100:00100000:3.0:1787857899.628612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.628744:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171848320 00000100:00100000:2.0:1787857899.628756:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171848320 00000100:00100000:2.0:1787857899.629100:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1505 00000100:00100000:2.0:1787857899.629113:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:32883:x1874704171848320:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787857899.629213:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.629233:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.629243:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.629288:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.629303:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 53 pid: 5857 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.629320:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7047840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188297216:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857899.629425:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c1254e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857899.639140:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7047840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188297216:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857899.639340:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857899.639505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.639661:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171848448 00000100:00100000:2.0:1787857899.639670:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171848448 00010000:00010000:2.0:1787857899.639722:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 54 pid: 5857 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.639883:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 440 00000100:00100000:2.0:1787857899.639895:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2350:x1874704171848448:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857899.639918:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857899.639925:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 54 pid: 5857 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.639938:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 54 pid: 5857 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.639966:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e2ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43ed expref: 54 pid: 5857 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.639998:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:2.0:1787857899.640003:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.640015:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.640024:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.640047:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857899.640112:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2350:x1874704171848448:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 219us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.640120:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 440 00010000:00010000:0.0:1787857899.642882:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.642903:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.642941:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.642950:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.642958:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.642969:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857899.642974:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.642981:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.643013:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:0.0:1787857899.643016:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787857899.643023:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.643028:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e32b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857899.643185:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32883:x1874704171848320:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 14071us (14582us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787857899.643195:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1505 00000100:00100000:0.0:1787857899.650773:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857899.650936:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171848576 00000100:00100000:3.0:1787857899.650948:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171848576 00000100:00100000:3.0:1787857899.651026:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 418 00000100:00100000:3.0:1787857899.651038:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171848576:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857899.651088:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.651111:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.651121:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857899.651125:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857899.651130:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.651186:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.651202:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 12 pid: 6714 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857899.651222:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188297344:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857899.651556:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7227900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857899.662781:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857899.662919:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188297344:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857899.662956:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857899.663335:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171848704 00000100:00100000:1.0:1787857899.663343:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171848704 00010000:00010000:1.0:1787857899.663774:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 13 pid: 6714 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857899.663849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 441 00000100:00100000:1.0:1787857899.663860:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171848704:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857899.663877:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857899.663907:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 13 pid: 6714 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.663920:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 13 pid: 6714 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.663952:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009958475b/0xd3f183cab4a7e316 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4409 expref: 13 pid: 6714 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.663970:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857899.663974:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857899.663979:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.664737:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.664902:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857899.664970:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171848704:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1110us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857899.664979:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 441 00010000:00010000:0.0:1787857899.668856:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.668885:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.668941:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.668951:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.668960:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.668967:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857899.668971:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.668980:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.669191:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.669200:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000539d806/0xd3f183cab4a7e332 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857899.669515:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171848576:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 18473us (18755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.669531:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 418 00000100:00100000:3.0:1787857899.675179:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.679027:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171848960 00000100:00100000:2.0:1787857899.679048:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171848960 00000100:00100000:2.0:1787857899.679147:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1506 00000100:00100000:2.0:1787857899.679159:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:32883:x1874704171848960:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857899.682090:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.682122:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.682136:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.682723:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.682743:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 53 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.682753:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.682803:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 53 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.682852:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 53 pid: 19301 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.683011:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7044f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188297472:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857899.683124:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b18780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857899.687442:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7044f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188297472:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857899.687561:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857899.691066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.691300:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171849088 00000100:00100000:2.0:1787857899.691313:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171849088 00010000:00010000:2.0:1787857899.691376:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 54 pid: 19301 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.691420:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 442 00000100:00100000:2.0:1787857899.691432:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2349:x1874704171849088:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857899.691453:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857899.691474:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 54 pid: 19301 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.691490:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 54 pid: 19301 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.691517:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e2fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd43f4 expref: 54 pid: 19301 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.691536:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:2.0:1787857899.691541:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.691550:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.691558:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.691592:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857899.691662:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2349:x1874704171849088:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 233us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.691675:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 442 00010000:00010000:3.0:1787857899.692917:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.692934:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857899.693198:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968337 00000001:00080000:3.0:1787857899.694115:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968338 00000001:00080000:3.0:1787857899.694200:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968339 00000100:00100000:3.0:1787857899.696142:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188297600:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787857899.696235:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857899.696287:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857899.696888:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188297600 00000100:00100000:0.0:1787857899.696900:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188297600 00000100:00100000:0.0:1787857899.696960:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787857899.696970:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188297600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787857899.697085:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188297600:12345-0@lo:1000:mdt00_002.0 Request processed in 115us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.697093:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787857899.697613:0:5858:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967388 gen 2 00000004:00080000:3.0:1787857899.697621:0:5858:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99990153da40, transno 4294967388 00000100:00100000:3.0:1787857899.697640:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188297600:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787857899.699209:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968340 00000100:00100000:3.0:1787857899.699325:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188297728:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787857899.699405:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857899.699439:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c72270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857899.699594:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188297728 00000100:00100000:0.0:1787857899.699602:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188297728 00000100:00100000:0.0:1787857899.699672:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787857899.699684:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1874704188297728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787857899.699962:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1874704188297728:12345-0@lo:1000:mdt00_002.0 Request processed in 279us (557us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787857899.699970:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787857899.700723:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5858:1874704188297728:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787857899.700772:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700783:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700790:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700796:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857899.700801:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700808:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700849:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9997c3d03f00) 00010000:00010000:2.0:1787857899.700853:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857899.700859:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700874:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e340 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700909:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700916:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700923:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700928:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857899.700930:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700935:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700943:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857899.700946:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857899.700953:0:5858:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4322 expref: 106 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700965:0:5858:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4322 expref: 106 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.700974:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4322 expref: 106 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.701021:0:5858:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4322 expref: 106 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.701036:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188297856:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857899.701110:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b18780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857899.706313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.706428:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188297856:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857899.706458:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.706479:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7dea8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.706514:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.706529:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 106 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.706539:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.706581:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 106 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.706595:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 106 pid: 5858 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.706611:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188297984:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857899.706711:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171849216 00000100:00100000:0.0:1787857899.706718:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171849216 00000100:00100000:0.0:1787857899.706770:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 326 00000100:00100000:0.0:1787857899.706781:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+107:32852:x1874704171849216:12345-192.168.204.36@tcp:49:cat.0 00000100:00100000:2.0:1787857899.708596:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b18780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857899.708667:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:365dae28-8203-4526-83a5-01baf5c55d8b+107:32852:x1874704171849216:12345-192.168.204.36@tcp:49:cat.0 Request processed in 1882us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.708679:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 326 00000100:00100000:1.0:1787857899.716560:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.716595:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.716651:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.716726:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171849600 00000100:00100000:2.0:1787857899.716739:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171849600 00000100:00100000:2.0:1787857899.716850:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171849728 00000100:00100000:2.0:1787857899.716854:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171849728 00010000:00010000:2.0:1787857899.716884:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 108 pid: 5858 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857899.716918:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 443 00000100:00100000:2.0:1787857899.716928:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171849728:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857899.716945:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857899.716952:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 108 pid: 5858 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.716966:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 108 pid: 5858 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.717004:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857899.717012:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.717025:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.717037:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.717063:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857899.717131:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171849728:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 204us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.717141:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 443 00000100:00100000:2.0:1787857899.717160:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:2.0:1787857899.717180:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+107:32851:x1874704171849600:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:2.0:1787857899.717189:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857899.717202:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa73800/0xd3f183cab4a7df03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4322 expref: 107 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.717220:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:2.0:1787857899.717224:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857899.717244:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+106:32851:x1874704171849600:12345-192.168.204.36@tcp:103:cat.0 Request processed in 78us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.717264:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:0.0:1787857899.717784:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171849344 00000100:00100000:0.0:1787857899.717793:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171849344 00000100:00100000:0.0:1787857899.718603:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 419 00000100:00100000:0.0:1787857899.718616:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+17:32852:x1874704171849344:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1787857899.718636:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857899.718657:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e34e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4410 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857899.718686:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 158, mtime: 0x6a908be7, atime: 0x6a908be7, ctime: 0x6a908be9, blocks: 0xb 00010000:00010000:0.0:1787857899.718708:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1787857899.718713:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857899.718723:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4410 expref: 18 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.718738:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000489d4206/0xd3f183cab4a7e34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4410 expref: 18 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.718750:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fc600, rc 0) 00000100:00100000:0.0:1787857899.718793:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+18:32852:x1874704171849344:12345-192.168.204.36@tcp:101:cat.0 Request processed in 182us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.718799:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 419 00000100:00080000:0.0:1787857899.718845:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787857899.719285:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7ded2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd430d expref: 105 pid: 5858 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857899.719304:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188297984:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857899.719332:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719344:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719361:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719375:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719383:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719390:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719396:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857899.719400:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719408:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719425:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857899.719428:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857899.719433:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719440:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e347 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719451:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719456:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719594:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719600:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857899.719603:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719610:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719619:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9997c3d03800) 00010000:00010000:3.0:1787857899.719621:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857899.719624:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.719629:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e339 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857899.719925:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32883:x1874704171848960:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 40767us (45112us total) trans 4294968341 rc 0/0 00000100:00100000:3.0:1787857899.719935:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1506 00000020:00080000:3.0:1787857899.719941:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787857899.720260:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857899.720266:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857899.720929:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787857899.720941:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857899.728848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857899.729453:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171849856 00000100:00100000:1.0:1787857899.730588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857899.730694:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171849856 00000100:00100000:3.0:1787857899.730768:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1507 00000100:00100000:3.0:1787857899.730780:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+105:32851:x1874704171849856:12345-192.168.204.36@tcp:58:cat.0 00000100:00100000:3.0:1787857899.730969:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+105:32851:x1874704171849856:12345-192.168.204.36@tcp:58:cat.0 Request processed in 190us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857899.730977:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1507 00000100:00100000:0.0:1787857899.734927:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.735029:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171850240 00000100:00100000:1.0:1787857899.735042:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171850240 00000100:00100000:1.0:1787857899.735110:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1508 00000100:00100000:1.0:1787857899.735119:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+105:32851:x1874704171850240:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857899.735143:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857899.735180:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e355 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4417 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.735247:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e355 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4417 expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.735274:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e355 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4417 expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.735296:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9998e1a0cc00) 00010000:00010000:1.0:1787857899.735299:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857899.735303:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0e00, rc 0) 00000100:00100000:1.0:1787857899.735371:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+106:32851:x1874704171850240:12345-192.168.204.36@tcp:101:cat.0 Request processed in 252us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857899.735378:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1508 00000100:00100000:2.0:1787857899.736212:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171850112 00000100:00100000:2.0:1787857899.736221:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171850112 00000100:00100000:2.0:1787857899.736356:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 327 00000100:00100000:2.0:1787857899.736367:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:32883:x1874704171850112:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787857899.737672:0:5859:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x2d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787857899.737787:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968342 00000100:00100000:3.0:1787857899.740616:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.742393:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171850368 00000100:00100000:1.0:1787857899.742409:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171850368 00002000:00100000:1.0:1787857899.742476:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1f:0x0] (0->4095) req@ffff9998ffaa0000 x1874704171850368/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:545/0 lens 488/0 e 0 to 0 dl 1787857910 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857899.742488:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffaa0000 with x1874704171850368 ext(0->4095) 00002000:00010000:1.0:1787857899.742494:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffaa0000 00000100:00100000:1.0:1787857899.742530:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 124 00000100:00100000:1.0:1787857899.742540:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+18:2347:x1874704171850368:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:1.0:1787857899.742858:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:365dae28-8203-4526-83a5-01baf5c55d8b+18:2347:x1874704171850368:12345-192.168.204.36@tcp:3:cat.0 Request processed in 317us (2251us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1787857899.743415:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.743439:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.743454:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.743475:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.743483:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.743490:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.743558:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857899.743661:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:32883:x1874704171850112:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 7296us (13079us total) trans 4294968343 rc 0/0 00000100:00100000:2.0:1787857899.743672:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 327 00000020:00080000:2.0:1787857899.743678:0:5859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787857899.743726:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 124 00002000:00100000:1.0:1787857899.743738:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1f:0x0] (0->4095) req@ffff9998ffaa0000 x1874704171850368/t0(0) o3->365dae28-8203-4526-83a5-01baf5c55d8b@192.168.204.36@tcp:545/0 lens 488/4536 e 0 to 0 dl 1787857910 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857899.743748:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffaa0000 with x1874704171850368 ext(0->4095) 00002000:00010000:1.0:1787857899.743753:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffaa0000 00000100:00100000:0.0:1787857899.744670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857899.744831:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171850624 00000100:00100000:0.0:1787857899.744841:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171850624 00000100:00100000:0.0:1787857899.744901:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:0.0:1787857899.744912:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:32855:x1874704171850624:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:0.0:1787857899.744925:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857899.744952:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e355 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4417 expref: 106 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.744970:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9998e1a0cc00) 00010000:00010000:0.0:1787857899.744981:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857899.747813:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+105:32855:x1874704171850624:12345-192.168.204.36@tcp:103:cat.0 Request processed in 2895us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857899.747843:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 71 00010000:00010000:3.0:1787857899.753220:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857899.753238:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.753260:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857899.753265:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.753277:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.753297:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff9998c3379300) 00010000:00010000:3.0:1787857899.753300:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857899.753306:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857899.753316:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e35c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857899.753683:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857899.753686:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857899.753689:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857899.757459:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857899.757672:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171850752 00000100:00100000:3.0:1787857899.757682:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171850752 00000100:00100000:3.0:1787857899.757776:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1509 00000100:00100000:3.0:1787857899.757787:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+105:32855:x1874704171850752:12345-192.168.204.36@tcp:58:cat.0 00000100:00100000:3.0:1787857899.757971:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+105:32855:x1874704171850752:12345-192.168.204.36@tcp:58:cat.0 Request processed in 185us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857899.757978:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1509 00000100:00100000:2.0:1787857899.761756:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857899.762201:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171850880 00000100:00100000:1.0:1787857899.762215:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171850880 00000100:00100000:1.0:1787857899.762472:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1510 00000100:00100000:1.0:1787857899.762484:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+105:32855:x1874704171850880:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1787857899.762507:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857899.762535:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e363 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd441e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.762605:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e363 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd441e expref: 106 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.762620:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e363 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd441e expref: 106 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857899.762644:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9998e1a0c600) 00010000:00010000:1.0:1787857899.762648:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857899.762652:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c1400, rc 0) 00000100:00100000:1.0:1787857899.762795:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+106:32855:x1874704171850880:12345-192.168.204.36@tcp:101:cat.0 Request processed in 312us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857899.762802:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1510 00000100:00100000:0.0:1787857899.768199:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.768346:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171851136 00000100:00100000:2.0:1787857899.768357:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171851136 00000100:00100000:2.0:1787857899.768470:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:2.0:1787857899.768481:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+106:32854:x1874704171851136:12345-192.168.204.36@tcp:103:cat.0 00010000:00010000:2.0:1787857899.768501:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857899.768528:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e363 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd441e expref: 106 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.768546:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9998e1a0c600) 00010000:00010000:2.0:1787857899.768557:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857899.768617:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+105:32854:x1874704171851136:12345-192.168.204.36@tcp:103:cat.0 Request processed in 138us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.768625:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:0.0:1787857899.771550:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857899.771633:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171851264 00000100:00100000:3.0:1787857899.771643:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171851264 00000100:00100000:3.0:1787857899.771704:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1511 00000100:00100000:3.0:1787857899.771714:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+105:32854:x1874704171851264:12345-192.168.204.36@tcp:58:cat.0 00000100:00100000:3.0:1787857899.771878:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+105:32854:x1874704171851264:12345-192.168.204.36@tcp:58:cat.0 Request processed in 165us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857899.771886:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1511 00000100:00100000:3.0:1787857899.776153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.776338:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171851392 00000100:00100000:2.0:1787857899.776352:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171851392 00000100:00100000:2.0:1787857899.776425:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1512 00000100:00100000:2.0:1787857899.776436:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+105:32854:x1874704171851392:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1787857899.776472:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857899.776530:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e36a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4425 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.776620:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e36a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4425 expref: 106 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.776637:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6800/0xd3f183cab4a7e36a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4425 expref: 106 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857899.776662:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9998c3379e00) 00010000:00010000:2.0:1787857899.776666:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857899.776671:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6800, rc 0) 00000100:00100000:2.0:1787857899.776757:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+106:32854:x1874704171851392:12345-192.168.204.36@tcp:101:cat.0 Request processed in 323us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857899.776765:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1512 00000100:00100000:0.0:1787857899.865031:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857899.865258:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171851648 00000100:00100000:2.0:1787857899.865270:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171851648 00000100:00100000:2.0:1787857899.865342:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 328 00000100:00100000:2.0:1787857899.865352:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6008c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+106:32851:x1874704171851648:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:2.0:1787857899.865804:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6008c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:365dae28-8203-4526-83a5-01baf5c55d8b+107:32851:x1874704171851648:12345-192.168.204.36@tcp:35:cat.0 Request processed in 452us (784us total) trans 4294968344 rc 0/0 00000100:00100000:2.0:1787857899.866951:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 328 00000100:00100000:1.0:1787857900.123182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857900.123235:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857900.123272:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857900.123390:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171852032 00000100:00100000:0.0:1787857900.123403:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171852032 00000100:00100000:0.0:1787857900.123485:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 543 00000100:00100000:0.0:1787857900.123500:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171852032:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857900.123790:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171851904 00000100:00100000:3.0:1787857900.123795:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171851904 00000100:00100000:3.0:1787857900.123852:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 544 00000100:00100000:3.0:1787857900.123861:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171851904:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857900.123869:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171852032:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 369us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857900.123881:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 543 00000100:00100000:3.0:1787857900.123898:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171851904:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857900.123906:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 544 00000100:00100000:2.0:1787857900.124430:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171851776 00000100:00100000:2.0:1787857900.124436:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171851776 00000100:00100000:2.0:1787857900.124481:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 624 00000100:00100000:2.0:1787857900.124489:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171851776:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857900.124790:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171851776:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 301us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857900.124802:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 624 00010000:00010000:3.0:1787857900.277858:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857900.784089:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857900.784099:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857900.784699:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787857900.784710:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787857901.054417:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00000001:00080000:3.0:1787857901.054467:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00010000:00010000:3.0:1787857901.296303:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857901.422262:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188298112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857901.422342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857901.422623:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188298112 00000100:00100000:3.0:1787857901.422634:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188298112 00000100:00100000:3.0:1787857901.422765:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787857901.422776:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188298112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857901.422856:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 93519872 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857901.422919:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188298112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857901.422926:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787857901.428955:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:2.0:1787857901.428969:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9998f9d09a40, transno 4294967375 00000100:00100000:2.0:1787857901.429024:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188298112:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787857901.434957:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787857902.321737:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857902.959001:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188298368:0@lo:400:kworker.0 00000100:00100000:0.0:1787857902.959087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857902.959184:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188298880:0@lo:400:kworker.0 00000100:00100000:0.0:1787857902.959223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857902.959258:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787857902.959263:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188298240:0@lo:400:kworker.0 00000100:00100000:0.0:1787857902.959294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857902.959314:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188298752:0@lo:400:kworker.0 00000100:00100000:0.0:1787857902.959335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857902.959363:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188298880 00000100:00100000:0.0:1787857902.959370:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188298880 00000100:00100000:0.0:1787857902.959429:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1787857902.959440:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188298880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857902.959499:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188298880:12345-0@lo:400:kworker.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857902.959508:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00080000:0.0:1787857902.959535:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857902.959581:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188298880:0@lo:400:kworker.0 00000100:00100000:2.0:1787857902.959850:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188298496:0@lo:400:kworker.0 00000100:00100000:2.0:1787857902.959885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857902.959915:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857902.959921:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188298624:0@lo:400:kworker.0 00000100:00100000:2.0:1787857902.959943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857902.960290:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188298368 00000100:00100000:3.0:1787857902.960296:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188298368 00000100:00100000:3.0:1787857902.960336:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188298752 00000100:00100000:3.0:1787857902.960339:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188298752 00000100:00100000:3.0:1787857902.960364:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188298496 00000100:00100000:3.0:1787857902.960368:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188298496 00000100:00100000:3.0:1787857902.960383:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1787857902.960390:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188298368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857902.960437:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188298368:12345-0@lo:400:kworker.0 Request processed in 47us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857902.960443:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1787857902.960460:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1787857902.960466:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188298752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857902.960487:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188298624 00000100:00100000:1.0:1787857902.960493:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188298624 00000100:00100000:3.0:1787857902.960498:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188298752:12345-0@lo:400:kworker.0 Request processed in 32us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857902.960506:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1787857902.960522:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1787857902.960528:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1787857902.960532:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188298496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857902.960541:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188298624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857902.960578:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188298496:12345-0@lo:400:kworker.0 Request processed in 49us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857902.960586:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1787857902.960591:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188298624:12345-0@lo:400:kworker.0 Request processed in 53us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857902.960599:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1787857902.960608:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188298240 00000100:00100000:3.0:1787857902.960613:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188298240 00000100:00100000:3.0:1787857902.960641:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1787857902.960648:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188298240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857902.960690:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188298240:12345-0@lo:400:kworker.0 Request processed in 43us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857902.960696:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00080000:3.0:1787857902.960805:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857902.961019:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188298624:0@lo:400:kworker.0 00000100:00100000:2.0:1787857902.961032:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188298496:0@lo:400:kworker.0 00000100:00100000:0.0:1787857902.961139:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188298240:0@lo:400:kworker.0 00000100:00100000:0.0:1787857902.961151:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188298752:0@lo:400:kworker.0 00000100:00100000:0.0:1787857902.961162:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188298368:0@lo:400:kworker.0 00010000:00010000:0.0:1787857903.351285:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857903.472138:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857903.472162:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188299008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857903.472248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857903.472959:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188299008 00000100:00100000:1.0:1787857903.472969:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188299008 00000100:00100000:1.0:1787857903.473016:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787857903.473026:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188299008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857903.473063:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857903.473134:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874704188299008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857903.473142:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787857903.474967:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188299008:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787857903.858119:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857903.858132:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857903.858459:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 45 count 3 00000040:00080000:2.0:1787857903.858467:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857904.366149:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787857904.559553:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968344 is committed 00000001:00080000:0.0:1787857904.559568:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968343 is committed 00000020:00080000:0.0:1787857904.559588:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9998c5a3ca80 refcount 2 committed 0 result 0 batchid 35 00000020:00080000:0.0:1787857904.559593:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99990127a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9998d0946d80 00000020:00080000:0.0:1787857904.559596:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99990127a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff999900d51c00 00000020:00080000:3.0:1787857904.559688:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 35 committed batchid 34 00000020:00080000:3.0:1787857904.559931:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000001:00080000:2.0:1787857905.084446:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967390 is committed 00000001:00080000:2.0:1787857905.084471:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967389 is committed 00000100:00100000:1.0:1787857905.232616:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857905.232667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857905.232700:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857905.232734:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857905.232778:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171852672 00000100:00100000:1.0:1787857905.232792:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171852672 00000100:00100000:1.0:1787857905.232904:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 521 00000100:00100000:1.0:1787857905.232915:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2350:x1874704171852672:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857905.233013:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2350:x1874704171852672:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857905.233024:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 521 00000100:00080000:1.0:1787857905.233049:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857905.233135:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171852160 00000100:00100000:3.0:1787857905.233140:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171852160 00000100:00100000:3.0:1787857905.233180:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 626 00000100:00100000:3.0:1787857905.233188:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171852160:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857905.233226:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171852160:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857905.233232:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 626 00000100:00100000:0.0:1787857905.233470:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171852416 00000100:00100000:0.0:1787857905.233476:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171852416 00000100:00100000:0.0:1787857905.233523:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171852928 00000100:00100000:0.0:1787857905.233526:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171852928 00000100:00100000:0.0:1787857905.233551:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 547 00000100:00100000:0.0:1787857905.233560:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171852416:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857905.233593:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171852416:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857905.233599:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 547 00000100:00100000:0.0:1787857905.233613:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 548 00000100:00100000:0.0:1787857905.233618:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171852928:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857905.233640:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171852928:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857905.233646:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 548 00000100:00080000:3.0:1787857905.233972:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857905.233976:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857905.242950:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857905.243013:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857905.243041:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171852288 00000100:00100000:0.0:1787857905.243044:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857905.243053:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171852288 00000100:00100000:0.0:1787857905.243081:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171852544 00000100:00100000:0.0:1787857905.243086:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171852544 00000100:00100000:0.0:1787857905.243140:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171852800 00000100:00100000:0.0:1787857905.243142:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171852800 00000100:00100000:2.0:1787857905.243145:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 522 00000100:00100000:2.0:1787857905.243155:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+106:2350:x1874704171852288:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857905.243165:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 549 00000100:00100000:0.0:1787857905.243171:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171852544:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857905.243301:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 550 00000100:00100000:2.0:1787857905.243605:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+106:2350:x1874704171852288:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 449us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857905.243613:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 522 00000100:00100000:3.0:1787857905.243801:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171852800:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857905.244575:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171852544:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1400us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857905.244584:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 549 00000100:00080000:2.0:1787857905.252448:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857905.252456:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857905.252459:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857905.253573:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171852800:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 10254us (10517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857905.253588:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 550 00010000:00010000:3.0:1787857905.390055:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857905.985279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857905.986653:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171853056 00000100:00100000:2.0:1787857905.986673:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171853056 00000100:00100000:3.0:1787857905.986947:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1513 00000100:00100000:3.0:1787857905.986959:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32803:x1874704171853056:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787857905.987103:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:32803:x1874704171853056:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 146us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857905.987111:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1513 00010000:00010000:1.0:1787857906.415473:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857906.542865:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857906.542889:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188299136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857906.542959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857906.543154:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188299136 00000100:00100000:3.0:1787857906.543163:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188299136 00000100:00100000:3.0:1787857906.543225:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787857906.543235:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188299136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857906.543273:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 93519872 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857906.543326:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188299136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857906.543334:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787857906.543421:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188299136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787857906.546204:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787857907.438226:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787857907.929507:0:22711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 15:11:45 (1787857905) 00000100:00100000:2.0:1787857908.080837:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857908.081027:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857908.081053:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188299392:0@lo:400:kworker.0 00000100:00100000:3.0:1787857908.081135:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857908.081412:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188299392 00000100:00100000:0.0:1787857908.081421:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188299392 00000100:00100000:0.0:1787857908.081483:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1787857908.081493:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188299392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857908.081553:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874704188299392:12345-0@lo:400:kworker.0 Request processed in 61us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.081560:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1787857908.081724:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874704188299392:0@lo:400:kworker.0 00000100:00100000:2.0:1787857908.081871:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188299264:0@lo:400:kworker.0 00000100:00100000:2.0:1787857908.081910:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857908.082036:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188299264 00000100:00100000:3.0:1787857908.082040:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188299264 00000100:00100000:3.0:1787857908.082073:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1787857908.082080:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188299264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857908.082121:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188299264:12345-0@lo:400:kworker.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857908.082128:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1787857908.082157:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188299264:0@lo:400:kworker.0 00000100:00100000:0.0:1787857908.082781:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188299520:0@lo:400:kworker.0 00000100:00100000:0.0:1787857908.082853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857908.082936:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188299520 00000100:00100000:2.0:1787857908.082942:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188299520 00000100:00100000:2.0:1787857908.082992:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1787857908.083000:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188299520:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787857908.083137:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857908.083273:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188299520:12345-0@lo:400:kworker.0 Request processed in 274us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857908.083281:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1787857908.083481:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188299520:0@lo:400:kworker.0 00000100:00100000:0.0:1787857908.083499:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857908.083505:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188299648:0@lo:400:kworker.0 00000100:00100000:0.0:1787857908.083532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857908.083685:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188299648 00000100:00100000:2.0:1787857908.083690:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188299648 00000100:00100000:2.0:1787857908.083866:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1787857908.083874:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188299648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857908.083920:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188299648:12345-0@lo:400:kworker.0 Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857908.083927:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1787857908.083959:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188299648:0@lo:400:kworker.0 00000100:00100000:2.0:1787857908.087334:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188299776:0@lo:400:kworker.0 00000100:00100000:2.0:1787857908.087410:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857908.087450:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857908.087467:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188299904:0@lo:400:kworker.0 00000100:00100000:2.0:1787857908.087495:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857908.087531:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188299904 00000100:00100000:2.0:1787857908.087538:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188299904 00000100:00100000:1.0:1787857908.087916:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188299776 00000100:00100000:1.0:1787857908.087921:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188299776 00000100:00080000:3.0:1787857908.089981:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857908.090014:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857908.090018:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857908.092915:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1787857908.092935:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188299904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857908.093048:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188299904:12345-0@lo:400:kworker.0 Request processed in 122us (5552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857908.093056:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1787857908.093103:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967390 gen 2 00000004:00080000:2.0:1787857908.093109:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967390 committed transno 4294967390 00000100:00100000:2.0:1787857908.093134:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188299904:0@lo:400:kworker.0 00000100:00100000:1.0:1787857908.094900:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1787857908.094915:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188299776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857908.095016:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188299776:12345-0@lo:400:kworker.0 Request processed in 94us (7593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857908.095025:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1787857908.095086:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188299776:0@lo:400:kworker.0 00000100:00100000:2.0:1787857908.215162:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.215235:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171853184 00000100:00100000:3.0:1787857908.215247:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171853184 00000100:00100000:3.0:1787857908.215378:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1514 00000100:00100000:3.0:1787857908.215390:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:33491:x1874704171853184:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787857908.215519:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:33491:x1874704171853184:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 131us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857908.215527:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1514 00000100:00080000:2.0:1787857908.215640:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857908.226801:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.226902:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171853312 00000100:00100000:2.0:1787857908.226914:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171853312 00000100:00100000:2.0:1787857908.226993:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1515 00000100:00100000:2.0:1787857908.227014:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+106:33492:x1874704171853312:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857908.227037:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.227059:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd442c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227131:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227149:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227163:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227240:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227248:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227256:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227529:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227538:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227544:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227549:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.227553:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227563:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227585:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:2.0:1787857908.227588:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.227593:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227598:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227607:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227613:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227619:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227624:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.227627:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227632:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227640:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff9998c3379c00) 00010000:00010000:2.0:1787857908.227642:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.227645:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227656:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e37f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227686:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e371 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd442c expref: 107 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227696:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:2.0:1787857908.227698:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.227702:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd442c expref: 107 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.227711:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:2.0:1787857908.227781:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+106:33492:x1874704171853312:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 779us (989us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.227789:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1515 00000100:00080000:3.0:1787857908.228540:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857908.234028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.234138:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171853568 00000100:00100000:0.0:1787857908.234150:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171853568 00000100:00100000:0.0:1787857908.234223:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1516 00000100:00100000:0.0:1787857908.234234:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+106:33492:x1874704171853568:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1787857908.234301:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857908.234334:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7dc47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd423b expref: 106 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.234356:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:0.0:1787857908.234362:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857908.234756:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.234773:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.234782:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.234863:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 49 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.234878:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 49 pid: 5856 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857908.234895:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188300032:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857908.235120:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857908.248195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.249092:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171853696 00000100:00100000:0.0:1787857908.249111:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171853696 00010000:00010000:0.0:1787857908.249172:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 50 pid: 5856 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857908.249235:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 444 00000100:00100000:0.0:1787857908.249250:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2349:x1874704171853696:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857908.249273:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857908.249282:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 50 pid: 5856 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.249301:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 50 pid: 5856 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.249338:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:0.0:1787857908.249345:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.249357:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.249366:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.249391:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857908.249475:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:2349:x1874704171853696:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 228us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.249483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 444 00010000:00010000:2.0:1787857908.252037:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7dc86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4250 expref: 49 pid: 5856 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857908.252063:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188300032:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857908.252090:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.252101:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.252107:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.252141:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.252264:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.252278:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857908.254066:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00010000:00010000:2.0:1787857908.254089:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.254101:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.254110:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.254117:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.254122:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.254131:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.254150:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9997c3d03e00) 00010000:00010000:2.0:1787857908.254153:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.254158:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.254170:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e386 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857908.254194:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd17c65b reply state 0000000090d667e3 transno 4294968345 ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857908.254203:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857908.255635:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+107:33492:x1874704171853568:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 21371us (21599us total) trans 4294968345 rc 0/0 00000100:00100000:2.0:1787857908.255651:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1516 00010000:00010000:0.0:1787857908.265492:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.265513:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.265522:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.265530:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857908.265536:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.265545:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.265567:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff9998c3379c00) 00010000:00010000:0.0:1787857908.265571:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857908.265577:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.265584:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e38d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857908.276353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.277371:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171853824 00000100:00100000:3.0:1787857908.277395:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171853824 00000100:00100000:3.0:1787857908.277517:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1517 00000100:00100000:3.0:1787857908.277531:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+106:33493:x1874704171853824:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857908.277578:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.277617:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4433 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.277743:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e39b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.277772:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e39b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.277792:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e39b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857908.277963:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1787857908.277969:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 35 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857908.278021:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e39b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.278061:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4433 expref: 108 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.278090:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53200/0xd3f183cab4a7e39b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4433 expref: 107 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.278102:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12efd00) 00010000:00010000:3.0:1787857908.278105:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857908.278110:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53200, rc 0) 00000100:00100000:3.0:1787857908.278228:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+107:33493:x1874704171853824:12345-192.168.204.36@tcp:101:bash.0 Request processed in 700us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857908.278238:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1517 00000100:00100000:3.0:1787857908.283662:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.284028:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171853952 00000100:00100000:2.0:1787857908.284051:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171853952 00000100:00100000:2.0:1787857908.285648:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1518 00000100:00100000:2.0:1787857908.285678:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+107:33493:x1874704171853952:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857908.285708:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.285736:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7e3a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd443a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.285861:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.285885:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.285902:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.285920:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.285931:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.285939:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286125:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e3b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286135:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286142:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857908.286180:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:2.0:1787857908.286184:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857908.286213:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286229:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286236:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286244:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286250:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.286255:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286264:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286282:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12efd00) 00010000:00010000:2.0:1787857908.286285:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.286292:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286298:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e3a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286315:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286320:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286327:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286332:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.286335:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286340:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286347:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff9998c3379200) 00010000:00010000:2.0:1787857908.286350:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.286353:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286363:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e3b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286398:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7e3a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd443a expref: 109 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286415:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6200/0xd3f183cab4a7e3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd443a expref: 108 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.286423:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.286425:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857908.286429:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6200, rc 0) 00000100:00100000:2.0:1787857908.286541:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:33493:x1874704171853952:12345-192.168.204.36@tcp:101:bash.0 Request processed in 878us (2905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857908.286550:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1518 00000100:00100000:1.0:1787857908.295759:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.295957:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171854080 00000100:00100000:2.0:1787857908.295972:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171854080 00000100:00100000:2.0:1787857908.296069:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1519 00000100:00100000:2.0:1787857908.296084:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:33493:x1874704171854080:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857908.296116:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.296147:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e3be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4441 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296331:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296349:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296362:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296378:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296385:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296392:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296494:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296502:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296509:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296515:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.296520:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296528:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296544:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.296547:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.296554:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296561:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e3c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296577:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296584:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296589:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296594:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.296596:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296602:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296609:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff9998c3379d00) 00010000:00010000:2.0:1787857908.296612:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.296615:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296621:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e3cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296661:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e3be lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4441 expref: 109 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296678:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.296680:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.296684:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e3be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4441 expref: 109 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.296695:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:2.0:1787857908.296780:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:33493:x1874704171854080:12345-192.168.204.36@tcp:101:bash.0 Request processed in 699us (1031us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.296790:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1519 00000100:00100000:1.0:1787857908.320031:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.320245:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171854208 00000100:00100000:3.0:1787857908.320262:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171854208 00000100:00100000:3.0:1787857908.320374:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1520 00000100:00100000:3.0:1787857908.320390:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+49:33495:x1874704171854208:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857908.320436:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.322248:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e3d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4448 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.322379:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e3da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.322399:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.322414:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857908.322781:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1787857908.322787:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 35 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857908.322855:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.323058:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e3d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4448 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.323195:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c52a00/0xd3f183cab4a7e3da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4448 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.323206:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12efd00) 00010000:00010000:3.0:1787857908.323210:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857908.323273:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c52a00, rc 0) 00000100:00100000:3.0:1787857908.323578:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:33495:x1874704171854208:12345-192.168.204.36@tcp:101:rm.0 Request processed in 3187us (3573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857908.323590:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1520 00000100:00100000:2.0:1787857908.338194:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857908.338421:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171854336 00000100:00100000:1.0:1787857908.338438:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171854336 00000100:00100000:1.0:1787857908.338567:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1521 00000100:00100000:1.0:1787857908.338582:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+50:33495:x1874704171854336:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857908.338617:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857908.338655:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e3e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd444f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.338795:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.338841:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.338858:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.338878:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.338885:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.338891:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339087:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7e3f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339098:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7e3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339106:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7e3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857908.339152:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:1.0:1787857908.339158:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857908.339191:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7e3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339222:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339230:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339239:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339247:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857908.339252:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339261:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339277:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9998d12efd00) 00010000:00010000:1.0:1787857908.339281:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857908.339288:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339296:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e3e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339314:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339320:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339326:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339334:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857908.339337:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339343:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339350:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff9998e1a0cf00) 00010000:00010000:1.0:1787857908.339353:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857908.339356:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339362:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e3ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339399:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e3e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd444f expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339414:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0600/0xd3f183cab4a7e3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd444f expref: 51 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.339422:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857908.339424:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857908.339427:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0600, rc 0) 00000100:00100000:1.0:1787857908.339552:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33495:x1874704171854336:12345-192.168.204.36@tcp:101:rm.0 Request processed in 972us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857908.339561:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1521 00000100:00100000:1.0:1787857908.353036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.353192:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171854464 00000100:00100000:3.0:1787857908.353209:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171854464 00000100:00100000:3.0:1787857908.353332:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1522 00000100:00100000:3.0:1787857908.353345:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33495:x1874704171854464:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857908.353379:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.353417:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e3fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4456 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353550:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353571:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353589:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353609:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353616:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353636:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353757:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353765:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353777:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353784:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857908.353789:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353797:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353812:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857908.353878:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.353886:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353894:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353923:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353930:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353937:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353942:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857908.353945:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353956:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353964:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff9998d12ef200) 00010000:00010000:3.0:1787857908.353967:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.353970:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.353976:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e40b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.354039:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e3fd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4456 expref: 52 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.354053:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857908.354056:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.354063:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e3fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4456 expref: 52 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.354075:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2c53e00, rc 0) 00000100:00100000:2.0:1787857908.354327:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33495:x1874704171854464:12345-192.168.204.36@tcp:101:rm.0 Request processed in 980us (1320us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.354339:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1522 00000100:00100000:3.0:1787857908.364872:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.365090:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171854592 00000100:00100000:2.0:1787857908.365105:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171854592 00000100:00100000:2.0:1787857908.365195:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1523 00000100:00100000:2.0:1787857908.365208:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33495:x1874704171854592:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857908.365245:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.365283:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd445d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365385:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365406:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365425:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365444:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365450:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365458:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365581:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365592:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365601:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365609:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.365615:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365626:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365644:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.365648:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.365656:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365665:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365919:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365926:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365933:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365938:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.365942:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365948:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365956:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff9998c3379d00) 00010000:00010000:2.0:1787857908.365959:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.365963:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.365969:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.366021:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e412 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd445d expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.366039:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.366041:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.366046:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd445d expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.366056:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706800, rc 0) 00000100:00100000:2.0:1787857908.366158:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33495:x1874704171854592:12345-192.168.204.36@tcp:101:rm.0 Request processed in 952us (1539us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.366167:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1523 00000100:00100000:3.0:1787857908.396364:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857908.396949:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171854720 00000100:00100000:1.0:1787857908.396967:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171854720 00000100:00100000:1.0:1787857908.397608:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1524 00000100:00100000:1.0:1787857908.397626:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33496:x1874704171854720:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857908.397658:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857908.397690:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e427 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4464 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.397795:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.397851:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.397868:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.397886:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.397894:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.397900:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398019:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398028:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398041:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398048:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857908.398053:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398063:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398079:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857908.398082:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857908.398089:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398096:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e42e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398112:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398118:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398123:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398128:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857908.398131:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398142:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398149:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff9998e1a0cf00) 00010000:00010000:1.0:1787857908.398151:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857908.398155:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398161:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398201:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e427 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4464 expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398215:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857908.398217:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857908.398221:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e427 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4464 expref: 52 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.398231:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0e00, rc 0) 00000100:00100000:1.0:1787857908.401629:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33496:x1874704171854720:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3984us (5320us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857908.401649:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1524 00000100:00100000:1.0:1787857908.411023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.411106:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171854848 00000100:00100000:0.0:1787857908.411123:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171854848 00000100:00100000:0.0:1787857908.411231:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1525 00000100:00100000:0.0:1787857908.411246:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33496:x1874704171854848:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857908.411283:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.411311:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7e43c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd446b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411411:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411435:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411450:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411468:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411476:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411482:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411573:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411582:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411590:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411596:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857908.411601:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411609:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411624:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857908.411628:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857908.411634:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411640:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411657:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411663:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411668:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411673:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fc200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857908.411675:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411681:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411687:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff9997c3d03400) 00010000:00010000:0.0:1787857908.411690:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857908.411692:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411697:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7e44a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411743:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7e43c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd446b expref: 52 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411757:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857908.411760:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857908.411764:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7e43c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd446b expref: 52 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.411776:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd800, rc 0) 00000100:00100000:0.0:1787857908.411918:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33496:x1874704171854848:12345-192.168.204.36@tcp:101:cp.0 Request processed in 674us (927us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857908.411928:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1525 00000100:00100000:3.0:1787857908.417057:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857908.417175:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171855104 00000100:00100000:1.0:1787857908.417190:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171855104 00000100:00100000:1.0:1787857908.417302:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1526 00000100:00100000:1.0:1787857908.417317:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+51:33496:x1874704171855104:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857908.417360:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857908.417396:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e451 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4472 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.417740:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.417764:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.417783:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.417804:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.417811:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.417850:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857908.418940:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:1.0:1787857908.419260:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419277:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419290:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419338:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419346:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419353:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419361:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c1400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857908.419367:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419376:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419392:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857908.419396:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857908.419402:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419409:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e458 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857908.419427:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0aae133 reply state 00000000235357fe transno 4294968346 ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857908.419438:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857908.419567:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0e00/0xd3f183cab4a7e451 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 54 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419592:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 53 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.419600:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857908.419602:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857908.419605:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e95c00, rc 0) 00000100:00100000:1.0:1787857908.419740:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33496:x1874704171855104:12345-192.168.204.36@tcp:101:cp.0 Request processed in 2426us (2703us total) trans 4294968346 rc 0/0 00000100:00100000:1.0:1787857908.419751:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1526 00000100:00100000:3.0:1787857908.424270:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.424783:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171855232 00000100:00100000:0.0:1787857908.424798:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171855232 00000100:00100000:0.0:1787857908.424924:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 420 00000100:00100000:0.0:1787857908.424941:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171855232:12345-192.168.204.36@tcp:101:cp.0 00000100:00080000:3.0:1787857908.424964:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857908.424975:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.425019:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4479 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857908.425074:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857908.425107:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.425112:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787857908.425122:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857908.425125:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.425136:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.425140:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.425146:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c26c0200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857908.425172:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.425202:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd800, rc 0) 00010000:00010000:1.0:1787857908.425222:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.425235:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.425260:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff9998e1a0cf00) 00010000:00010000:1.0:1787857908.425264:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857908.425272:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.425281:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c0200/0xd3f183cab4a7e45f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857908.425326:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2349:x1874704171855232:12345-192.168.204.36@tcp:101:cp.0 Request processed in 389us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.425335:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 420 00000100:00100000:3.0:1787857908.438175:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.438363:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171855360 00000100:00100000:0.0:1787857908.438378:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171855360 00000100:00100000:0.0:1787857908.438467:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 421 00000100:00100000:0.0:1787857908.438483:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:33496:x1874704171855360:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857908.438512:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.438539:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4480 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.438588:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.438600:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857908.438605:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857908.438613:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.438680:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 10 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.438698:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 10 pid: 6713 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857908.438713:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188300160:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857908.438923:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857908.445399:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188300160:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857908.445462:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 10 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.445496:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fc200, rc 0) 00000100:00100000:0.0:1787857908.445588:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:33496:x1874704171855360:12345-192.168.204.36@tcp:101:cp.0 Request processed in 7109us (7430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.445600:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 421 00000100:00100000:3.0:1787857908.446252:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.446339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171855488 00000100:00100000:2.0:1787857908.446351:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171855488 00010000:00010000:2.0:1787857908.446408:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 10 pid: 6713 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857908.446461:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 445 00000100:00100000:2.0:1787857908.446474:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171855488:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857908.446494:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857908.446529:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 10 pid: 6713 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.446546:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 10 pid: 6713 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.446581:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e474 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4479 expref: 10 pid: 6713 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.446610:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857908.446615:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857908.446626:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.446640:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.446704:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857908.446723:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188300288:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857908.446867:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857908.452200:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5843:1874704188300288:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857908.452237:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857908.452323:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2350:x1874704171855488:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5850us (6073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857908.452337:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 445 00000100:00100000:2.0:1787857908.458555:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.458865:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171855744 00000100:00100000:0.0:1787857908.458881:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171855744 00000100:00100000:0.0:1787857908.458979:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 329 00000100:00100000:0.0:1787857908.458994:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:33496:x1874704171855744:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:0.0:1787857908.459544:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33496:x1874704171855744:12345-192.168.204.36@tcp:35:cp.0 Request processed in 552us (1008us total) trans 4294968347 rc 0/0 00000100:00100000:0.0:1787857908.459554:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 329 00010000:00010000:3.0:1787857908.462875:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857908.532266:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.532397:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171855872 00000100:00100000:2.0:1787857908.532414:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171855872 00000100:00100000:2.0:1787857908.532504:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1527 00000100:00100000:2.0:1787857908.532515:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:33499:x1874704171855872:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857908.532541:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.532585:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e482 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4487 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532674:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532691:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532717:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532734:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532740:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532747:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532907:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e497 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532916:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.532923:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857908.532973:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2e:0x0]: returning size 158 00000004:00200000:2.0:1787857908.532980:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857908.533013:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533027:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533035:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533042:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533049:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533056:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.533061:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533070:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533082:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.533086:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.533091:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533098:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533111:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533117:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533124:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533129:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.533132:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533137:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533144:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff9998c3379d00) 00010000:00010000:2.0:1787857908.533146:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.533148:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533167:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533199:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e482 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4487 expref: 110 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533212:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e497 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4487 expref: 109 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.533219:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:2.0:1787857908.533221:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857908.533223:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6400, rc 0) 00000100:00100000:2.0:1787857908.533689:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+109:33499:x1874704171855872:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1174us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857908.533701:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1527 00000100:00100000:3.0:1787857908.545437:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.545741:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171856000 00000100:00100000:2.0:1787857908.545754:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171856000 00000100:00100000:2.0:1787857908.545907:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 422 00000100:00100000:2.0:1787857908.545918:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171856000:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857908.545942:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.546099:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019c08f08/0xd3f183cab4a7e49e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd448e expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857908.546241:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188300416:192.168.204.36@tcp:106: 00000100:00080000:3.0:1787857908.546947:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857908.547138:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3c180 going to sleep for 11 seconds 00002000:00010000:2.0:1787857908.555463:0:8490:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857908.555474:0:8490:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb mtime: 0 -> 1787857908 00002000:00010000:2.0:1787857908.555476:0:8490:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb atime: 0 -> 1787857908 00002000:00010000:2.0:1787857908.555478:0:8490:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb ctime: 0 -> 1787857908 00000100:00100000:2.0:1787857908.555504:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188300416:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857908.555542:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019c08f08/0xd3f183cab4a7e49e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd448e expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.555757:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019c08f08/0xd3f183cab4a7e49e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd448e expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.555773:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6600, rc 0) 00000100:00100000:2.0:1787857908.556422:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171856000:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 10501us (10992us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.556436:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 422 00000100:00100000:3.0:1787857908.561171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.562715:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171856128 00000100:00100000:2.0:1787857908.562735:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171856128 00000100:00100000:2.0:1787857908.563008:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1528 00000100:00100000:2.0:1787857908.563022:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+109:33499:x1874704171856128:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857908.563050:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.563077:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4495 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.563175:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.563191:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.563203:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857908.564407:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:2.0:1787857908.564417:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857908.564468:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.564515:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 111 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.564540:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 110 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.565372:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.565376:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857908.565380:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6e00, rc 0) 00000100:00100000:2.0:1787857908.565558:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+110:33499:x1874704171856128:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2526us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857908.565708:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1528 00000100:00100000:0.0:1787857908.584054:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.584173:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171856256 00000100:00100000:2.0:1787857908.584193:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171856256 00000100:00100000:3.0:1787857908.584405:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 423 00000100:00100000:3.0:1787857908.584423:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171856256:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857908.584453:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.584630:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7e4b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd449c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857908.584726:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188300544:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857908.585071:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2a8ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857908.590234:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857908.590282:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188300672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857908.590433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857908.592645:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188300672 00000100:00100000:1.0:1787857908.592669:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188300672 00000100:00100000:1.0:1787857908.592804:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787857908.592862:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188300672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857908.592923:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857908.593057:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188300672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 240us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857908.593067:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787857908.593641:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188300672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857908.609740:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffaa21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188300544:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857908.609885:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7e4b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd449c expref: 17 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.609933:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be7ac141/0xd3f183cab4a7e4b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd449c expref: 17 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.609955:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090a00, rc 0) 00000100:00100000:0.0:1787857908.610105:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171856256:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 25685us (26067us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857908.610119:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 423 00000100:00100000:3.0:1787857908.622684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.622913:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171856512 00000100:00100000:2.0:1787857908.623361:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171856512 00000100:00100000:2.0:1787857908.623532:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1529 00000100:00100000:2.0:1787857908.623557:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+110:33499:x1874704171856512:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:2.0:1787857908.623905:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].45, 136 off14312 00000100:00100000:2.0:1787857908.624041:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+110:33499:x1874704171856512:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 497us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857908.624049:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1529 00000100:00100000:2.0:1787857908.642395:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857908.647829:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171856640 00000100:00100000:1.0:1787857908.647846:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171856640 00000100:00100000:3.0:1787857908.649390:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1530 00000100:00100000:3.0:1787857908.649415:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+110:33500:x1874704171856640:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1787857908.649438:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.649461:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e4ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44a3 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649560:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649586:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649599:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649658:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649667:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649673:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649740:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649749:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649756:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649763:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857908.649767:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649775:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649788:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857908.649791:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.649796:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649802:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e4c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649868:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649875:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649881:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649886:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857908.649889:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649894:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649901:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff9998d12ef200) 00010000:00010000:3.0:1787857908.649903:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.649906:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649911:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e4c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649960:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e4ba lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44a3 expref: 111 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649971:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857908.649973:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.649977:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e4ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44a3 expref: 111 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.649986:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091a00, rc 0) 00000100:00100000:3.0:1787857908.650073:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+110:33500:x1874704171856640:12345-192.168.204.36@tcp:101:bash.0 Request processed in 670us (7688us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857908.650081:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1530 00000100:00100000:1.0:1787857908.667535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.667793:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171856768 00000100:00100000:2.0:1787857908.667806:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171856768 00000100:00100000:2.0:1787857908.667949:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1531 00000100:00100000:2.0:1787857908.667960:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33501:x1874704171856768:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857908.667988:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.668025:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7e4cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44aa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668136:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668153:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668164:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668181:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668188:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668194:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668502:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668511:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668519:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668525:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999900ce7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.668531:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668686:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668706:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.668709:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.668716:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668721:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce7600/0xd3f183cab4a7e4d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668734:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668741:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668747:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668753:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2706800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.668756:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668762:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668769:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff9998c3379d00) 00010000:00010000:2.0:1787857908.668772:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.668775:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668784:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706800/0xd3f183cab4a7e4dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668841:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7e4cf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44aa expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668851:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.668853:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.668857:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6600/0xd3f183cab4a7e4cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44aa expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.668867:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999900ce6600, rc 0) 00000100:00100000:2.0:1787857908.670785:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33501:x1874704171856768:12345-192.168.204.36@tcp:101:rm.0 Request processed in 2810us (3250us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.670801:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1531 00000100:00100000:1.0:1787857908.673907:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.674126:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171856896 00000100:00100000:2.0:1787857908.674136:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171856896 00000100:00100000:2.0:1787857908.674210:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1532 00000100:00100000:2.0:1787857908.674221:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33501:x1874704171856896:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857908.674242:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.674335:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e4e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44b1 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.674406:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.674420:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.674432:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.674474:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.674483:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.674491:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675088:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675099:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675106:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675113:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2707c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.675117:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675125:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675139:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.675142:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.675146:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675236:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707c00/0xd3f183cab4a7e4eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675262:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675268:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675274:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675279:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.675282:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675288:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675296:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff9998c3379200) 00010000:00010000:2.0:1787857908.675299:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.675302:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675307:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675349:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e4e4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44b1 expref: 55 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675365:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.675367:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.675371:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2706600/0xd3f183cab4a7e4e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44b1 expref: 55 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.675379:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c2706600, rc 0) 00000100:00100000:2.0:1787857908.675455:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33501:x1874704171856896:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1235us (1558us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.675465:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1532 00000100:00100000:3.0:1787857908.693546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.693749:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171857024 00000100:00100000:2.0:1787857908.693766:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171857024 00000100:00100000:2.0:1787857908.693891:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1533 00000100:00100000:2.0:1787857908.693903:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33502:x1874704171857024:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857908.693924:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.693957:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44b8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694205:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694224:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694236:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694320:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694341:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694348:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694424:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694432:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694439:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694445:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.694450:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694457:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694470:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.694473:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.694479:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694485:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e500 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694500:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694507:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694512:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694517:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.694520:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694525:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694532:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff9998c3379200) 00010000:00010000:2.0:1787857908.694535:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.694538:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694543:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e507 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694595:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44b8 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694607:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.694609:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.694613:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e4f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44b8 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.694628:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6600, rc 0) 00000100:00100000:2.0:1787857908.695076:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33502:x1874704171857024:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1174us (1561us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.695086:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1533 00000100:00100000:1.0:1787857908.701130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.704623:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171857152 00000100:00100000:2.0:1787857908.704643:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171857152 00000100:00100000:2.0:1787857908.704774:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1534 00000100:00100000:2.0:1787857908.704786:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33502:x1874704171857152:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857908.704811:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.704860:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e50e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.704943:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.704959:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.704972:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705006:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705014:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705021:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705102:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705110:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705117:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705123:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.705128:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705136:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705162:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.705166:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.705171:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705177:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e515 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705191:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705198:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705203:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705209:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.705212:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705218:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705226:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff9998c3379d00) 00010000:00010000:2.0:1787857908.705228:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.705231:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705237:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e51c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705465:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e50e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44bf expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705477:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.705479:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.705483:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e50e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44bf expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.705494:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6000, rc 0) 00000100:00100000:2.0:1787857908.705701:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33502:x1874704171857152:12345-192.168.204.36@tcp:101:cp.0 Request processed in 916us (4589us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.705709:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1534 00000100:00100000:1.0:1787857908.713944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.714552:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171857408 00000100:00100000:2.0:1787857908.714578:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171857408 00000100:00100000:2.0:1787857908.714664:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1535 00000100:00100000:2.0:1787857908.714678:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:33502:x1874704171857408:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857908.714707:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.714736:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e523 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44c6 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.714939:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.714958:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 109 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.714967:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.715018:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 109 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.715035:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 109 pid: 5858 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857908.715049:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2717c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188300800:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857908.715183:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857908.723796:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2717c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188300800:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857908.723852:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857908.727303:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857908.727450:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171857536 00000100:00100000:1.0:1787857908.727474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171857536 00010000:00010000:1.0:1787857908.727535:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 110 pid: 5858 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857908.727596:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 446 00000100:00100000:1.0:1787857908.727611:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+110:2349:x1874704171857536:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857908.727635:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857908.727644:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 110 pid: 5858 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.727660:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 110 pid: 5858 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.727693:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6e00/0xd3f183cab4a7e4ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4495 expref: 110 pid: 5858 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.727714:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857908.727720:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.727730:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.727738:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.727769:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857908.727884:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+109:2349:x1874704171857536:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 276us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857908.727892:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 446 00010000:00010000:2.0:1787857908.729435:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.729452:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.729485:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.729498:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.729509:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857908.730150:0:7656:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:2.0:1787857908.730927:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.730944:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.730952:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.730989:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.731007:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.731019:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.731026:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.731030:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.731038:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.731052:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.731055:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.731060:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.731067:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e52a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857908.731080:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000987b157 reply state 0000000038beaaea transno 4294968348 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857908.731088:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857908.731131:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e523 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 57 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.731159:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 56 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.731167:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:2.0:1787857908.731170:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857908.731172:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6600, rc 0) 00000100:00100000:2.0:1787857908.732135:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33502:x1874704171857408:12345-192.168.204.36@tcp:101:cp.0 Request processed in 17452us (18197us total) trans 4294968348 rc 0/0 00000100:00100000:2.0:1787857908.732357:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1535 00010000:00010000:0.0:1787857908.736374:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.736391:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.736399:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.736405:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857908.736410:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.736418:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.736449:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff9998c3379d00) 00010000:00010000:0.0:1787857908.736453:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857908.736458:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.736465:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857908.743095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.743237:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171857664 00000100:00100000:0.0:1787857908.743249:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171857664 00000100:00100000:0.0:1787857908.743336:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 424 00000100:00100000:0.0:1787857908.743348:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171857664:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857908.743367:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.743388:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44cd expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787857908.743410:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787857908.743418:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857908.743453:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787857908.743458:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857908.743469:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 11 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.743497:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 11 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.743519:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd400, rc 0) 00000100:00100000:0.0:1787857908.743596:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171857664:12345-192.168.204.36@tcp:101:cp.0 Request processed in 250us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.743609:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 424 00000100:00100000:2.0:1787857908.749634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.749787:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171857792 00000100:00100000:0.0:1787857908.749798:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171857792 00000100:00100000:0.0:1787857908.749896:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 425 00000100:00100000:0.0:1787857908.749907:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:33502:x1874704171857792:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857908.749930:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.749979:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44d4 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.750027:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.750038:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857908.750049:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857908.750055:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.750098:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.750119:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 12 pid: 14028 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857908.750135:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188300928:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857908.750251:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857908.754380:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188300928:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857908.754425:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.754450:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fcc00, rc 0) 00000100:00100000:0.0:1787857908.754530:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:33502:x1874704171857792:12345-192.168.204.36@tcp:101:cp.0 Request processed in 4625us (4906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.754541:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 425 00000100:00100000:1.0:1787857908.761373:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.761488:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171857920 00000100:00100000:3.0:1787857908.761499:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171857920 00010000:00010000:3.0:1787857908.761554:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 12 pid: 14028 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857908.761606:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 447 00000100:00100000:3.0:1787857908.761618:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171857920:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857908.761637:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857908.761672:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 12 pid: 14028 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.761687:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 12 pid: 14028 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.761719:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7e546 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44cd expref: 12 pid: 14028 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.761742:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857908.761748:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857908.761757:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.761769:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.761876:0:17347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857908.761897:0:17347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17347:1874704188301056:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857908.762000:0:17347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2a8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857908.766876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.767348:0:17347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17347:1874704188301056:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857908.767398:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857908.767502:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171857920:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5885us (6142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857908.767515:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 447 00000100:00100000:0.0:1787857908.768600:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171858176 00000100:00100000:0.0:1787857908.768619:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171858176 00000100:00100000:0.0:1787857908.768709:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 330 00000100:00100000:0.0:1787857908.768720:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:33502:x1874704171858176:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:0.0:1787857908.770270:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33502:x1874704171858176:12345-192.168.204.36@tcp:35:cp.0 Request processed in 1537us (3391us total) trans 4294968349 rc 0/0 00000100:00100000:0.0:1787857908.771502:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 330 00000100:00100000:2.0:1787857908.867041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.867164:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171858304 00000100:00100000:3.0:1787857908.867176:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171858304 00000100:00100000:3.0:1787857908.867273:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1536 00000100:00100000:3.0:1787857908.867286:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+109:33505:x1874704171858304:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857908.867314:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.867341:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44db expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.867423:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.867569:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.867587:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.867606:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.867615:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.867622:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.867972:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e569 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.867982:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868009:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857908.868052:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2f:0x0]: returning size 158 00000004:00200000:3.0:1787857908.868057:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857908.868081:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868097:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868110:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868116:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868124:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868129:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857908.868134:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868142:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868778:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857908.868782:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.868787:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868795:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e55b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868934:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868942:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868948:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868954:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857908.868957:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868963:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868972:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff9998d12ef200) 00010000:00010000:3.0:1787857908.868975:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.868977:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.868983:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.869053:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44db expref: 111 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.869069:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44db expref: 110 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.869077:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:3.0:1787857908.869079:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857908.869082:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f8e94c00, rc 0) 00000100:00100000:3.0:1787857908.869368:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+110:33505:x1874704171858304:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2083us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857908.869379:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1536 00000100:00100000:1.0:1787857908.880652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.881168:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171858432 00000100:00100000:0.0:1787857908.881183:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171858432 00000100:00100000:0.0:1787857908.881269:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 426 00000100:00100000:0.0:1787857908.881280:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+18:2347:x1874704171858432:12345-192.168.204.36@tcp:101:lfs.0 00000100:00080000:3.0:1787857908.881369:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857908.881551:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.881591:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7e570 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44e2 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857908.881936:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188301184:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857908.882110:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b0c0 going to sleep for 11 seconds 00002000:00010000:0.0:1787857908.892166:0:6714:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787857908.892177:0:6714:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime: 0 -> 1787857908 00002000:00010000:0.0:1787857908.892179:0:6714:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime: 0 -> 1787857908 00002000:00010000:0.0:1787857908.892181:0:6714:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime: 0 -> 1787857908 00000100:00100000:0.0:1787857908.892211:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188301184:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857908.892252:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7e570 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e2 expref: 19 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.892277:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7e570 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e2 expref: 19 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.892302:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd200, rc 0) 00000100:00100000:0.0:1787857908.892363:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+18:2347:x1874704171858432:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 11084us (11730us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857908.892372:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 426 00000100:00100000:2.0:1787857908.897249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.897901:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171858560 00000100:00100000:3.0:1787857908.897913:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171858560 00000100:00100000:3.0:1787857908.898042:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1537 00000100:00100000:3.0:1787857908.898054:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+110:33505:x1874704171858560:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857908.898081:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.898109:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.898207:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.898222:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.898237:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857908.898309:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:3.0:1787857908.898313:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857908.898338:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.898368:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 112 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.898388:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 111 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.898399:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857908.898402:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857908.898409:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090200, rc 0) 00000100:00100000:3.0:1787857908.898532:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+111:33505:x1874704171858560:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 480us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857908.898540:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1537 00000100:00100000:1.0:1787857908.903668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.904009:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171858688 00000100:00100000:0.0:1787857908.904019:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171858688 00000100:00100000:0.0:1787857908.904103:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 427 00000100:00100000:0.0:1787857908.904116:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171858688:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857908.904141:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.904162:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7e585 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44f0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857908.904237:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188301312:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857908.904722:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857908.909997:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188301312:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857908.910044:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7e585 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44f0 expref: 19 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.910082:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7e585 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44f0 expref: 19 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857908.910097:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd200, rc 0) 00000100:00100000:1.0:1787857908.910211:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171858688:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 6097us (6552us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857908.910222:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 427 00000100:00100000:3.0:1787857908.917536:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857908.918189:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171858944 00000100:00100000:1.0:1787857908.923380:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171858944 00000100:00100000:0.0:1787857908.924055:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1538 00000100:00100000:0.0:1787857908.924067:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:33505:x1874704171858944:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857908.924347:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].46, 136 off14448 00000100:00100000:0.0:1787857908.924451:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:33505:x1874704171858944:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 385us (6929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.924460:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1538 00000100:00100000:3.0:1787857908.938265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857908.938537:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171859072 00000100:00100000:2.0:1787857908.938557:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171859072 00000100:00100000:2.0:1787857908.938620:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1539 00000100:00100000:2.0:1787857908.938631:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+111:33506:x1874704171859072:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857908.938653:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857908.938675:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e58c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44f7 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.938755:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.938769:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.938779:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.938793:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.938799:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.938807:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939069:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939079:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939086:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939092:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.939098:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939107:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939132:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.939135:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.939140:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939146:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e593 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939161:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939168:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939174:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939179:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857908.939181:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939187:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939195:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff9998c3379d00) 00010000:00010000:2.0:1787857908.939197:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.939201:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939206:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e59a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939246:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e58c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44f7 expref: 112 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939256:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857908.939259:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857908.939262:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e58c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44f7 expref: 112 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857908.939271:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7600, rc 0) 00000100:00100000:2.0:1787857908.939536:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+111:33506:x1874704171859072:12345-192.168.204.36@tcp:101:bash.0 Request processed in 905us (1279us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857908.939615:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1539 00000100:00100000:2.0:1787857908.960970:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.961141:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171859200 00000100:00100000:3.0:1787857908.961152:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171859200 00000100:00100000:3.0:1787857908.961213:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1540 00000100:00100000:3.0:1787857908.961224:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33507:x1874704171859200:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857908.961249:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.961269:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e5a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd44fe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961704:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961720:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961732:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961748:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961755:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961762:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961850:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961857:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961863:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961869:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857908.961873:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961881:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961892:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857908.961895:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.961900:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961906:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961920:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961926:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961932:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961938:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857908.961941:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961946:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961953:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff9998d12ef200) 00010000:00010000:3.0:1787857908.961955:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.961958:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.961963:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.962010:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e5a1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44fe expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.962020:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857908.962023:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857908.962027:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e5a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44fe expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.962036:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090a00, rc 0) 00000100:00100000:3.0:1787857908.962171:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33507:x1874704171859200:12345-192.168.204.36@tcp:101:rm.0 Request processed in 948us (1210us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857908.962178:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1540 00000040:00080000:3.0:1787857908.974424:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857908.974436:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857908.974483:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 47 count 5 00000040:00080000:3.0:1787857908.974490:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857908.974862:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188301440:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857908.976159:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857908.976717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.976974:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171859328 00000100:00100000:0.0:1787857908.976983:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171859328 00000100:00100000:0.0:1787857908.977057:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1541 00000100:00100000:0.0:1787857908.977067:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33507:x1874704171859328:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857908.977089:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.977108:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7e5b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4505 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977359:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977375:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977387:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977404:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977411:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977417:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977484:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977492:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977498:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977634:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857908.977640:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977648:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977662:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857908.977665:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857908.977670:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977677:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7e5bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977692:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977698:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977704:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977710:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857908.977713:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977718:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977727:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff9997c3d03b00) 00010000:00010000:0.0:1787857908.977729:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857908.977733:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977739:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977771:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7e5b6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4505 expref: 59 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977781:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857908.977784:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857908.977788:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7e5b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4505 expref: 59 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.977798:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd800, rc 0) 00000100:00100000:2.0:1787857908.981432:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.981616:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188301440:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857908.981876:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171859456 00000100:00100000:3.0:1787857908.981885:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171859456 00000100:00100000:3.0:1787857908.981934:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1542 00000100:00100000:3.0:1787857908.981945:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c30430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33508:x1874704171859456:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000100:00100000:0.0:1787857908.982011:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33507:x1874704171859328:12345-192.168.204.36@tcp:101:rm.0 Request processed in 4943us (5299us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857908.982021:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1541 00000004:00000080:3.0:1787857908.982187:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857908.982254:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.982293:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c30430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33508:x1874704171859456:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 349us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.983247:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171859584 00000100:00100000:0.0:1787857908.983255:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171859584 00000100:00100000:3.0:1787857908.986076:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1542 00000100:00100000:0.0:1787857908.987771:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1543 00000100:00100000:0.0:1787857908.987794:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33509:x1874704171859584:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857908.987859:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857908.988019:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33509:x1874704171859584:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 235us (5764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857908.988027:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1543 00000100:00100000:1.0:1787857908.994627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857908.994961:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171859840 00000100:00100000:0.0:1787857908.994975:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171859840 00000100:00100000:0.0:1787857908.995051:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1544 00000100:00100000:0.0:1787857908.995063:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33508:x1874704171859840:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857908.995088:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857908.995115:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7e5cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd450c expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.995257:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.995278:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.995292:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857908.995306:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2e:0x0]: returning size 158 00010000:00010000:0.0:1787857908.995477:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7e5cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd450c expref: 60 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.995499:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd450c expref: 59 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857908.995509:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:0.0:1787857908.995513:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857908.995517:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd400, rc 0) 00000100:00100000:0.0:1787857908.995623:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:33508:x1874704171859840:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 562us (1013us total) trans 4294968350 rc 0/0 00000100:00100000:0.0:1787857908.995633:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1544 00000100:00100000:2.0:1787857908.999332:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857908.999679:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171860096 00000100:00100000:3.0:1787857908.999698:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171860096 00000100:00100000:3.0:1787857908.999764:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1545 00000100:00100000:3.0:1787857908.999775:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:33509:x1874704171860096:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857908.999796:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857908.999841:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4513 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.999956:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e5e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857908.999970:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.000424:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857909.000438:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2f:0x0]: returning size 158 00010000:00010000:3.0:1787857909.000771:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e5e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4513 expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.000794:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4513 expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.000804:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:3.0:1787857909.000807:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857909.000811:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090a00, rc 0) 00000100:00100000:1.0:1787857909.003430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.003498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.004006:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171860352 00000100:00100000:3.0:1787857909.004018:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171860352 00000100:00100000:3.0:1787857909.004082:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:3.0:1787857909.004092:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:2350:x1874704171860352:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857909.004107:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857909.004131:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7e5d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd450c expref: 62 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.004151:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:3.0:1787857909.004156:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857909.004263:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171860224 00000100:00100000:0.0:1787857909.004270:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171860224 00000100:00100000:0.0:1787857909.004326:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 428 00000100:00100000:0.0:1787857909.004334:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+9:2348:x1874704171860224:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857909.004369:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.004387:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.004396:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787857909.004400:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857909.004404:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.004437:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 9 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.004452:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 9 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.004466:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188301568:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857909.010257:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:2350:x1874704171860352:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 6146us (6740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.010277:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:0.0:1787857909.013700:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.017229:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:33509:x1874704171860096:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 17440us (17894us total) trans 4294968351 rc 0/0 00000100:00100000:2.0:1787857909.017245:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1545 00000100:00100000:2.0:1787857909.029648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.029897:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171860480 00000100:00100000:3.0:1787857909.029909:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171860480 00000100:00100000:3.0:1787857909.029981:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1546 00000100:00100000:3.0:1787857909.030002:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:33510:x1874704171860480:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.030029:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.030051:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd451a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030128:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030149:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030162:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030178:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030186:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030205:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030287:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030295:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030307:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030314:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.030318:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030326:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030339:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.030343:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.030349:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030355:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2c53e00/0xd3f183cab4a7e603 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030368:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030375:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030380:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030386:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999014e3e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.030389:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030398:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030405:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff9998d12ef200) 00010000:00010000:3.0:1787857909.030407:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.030410:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030415:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7e60a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030447:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5fc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd451a expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030469:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.030471:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.030475:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7e5fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd451a expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.030485:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6091a00, rc 0) 00000100:00100000:3.0:1787857909.030561:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:33510:x1874704171860480:12345-192.168.204.36@tcp:101:cp.0 Request processed in 571us (927us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857909.030570:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1546 00000100:00100000:0.0:1787857909.034419:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.034451:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.034493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.034528:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171860864 00000100:00100000:0.0:1787857909.034540:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171860864 00000100:00100000:3.0:1787857909.034638:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171860608 00000100:00100000:3.0:1787857909.034653:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171860608 00000100:00100000:0.0:1787857909.034653:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 74 00000100:00100000:0.0:1787857909.034673:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:2348:x1874704171860864:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857909.034698:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857909.034735:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7e5e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4513 expref: 60 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.034751:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 429 00000100:00100000:3.0:1787857909.034770:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171860608:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857909.034770:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:0.0:1787857909.034785:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857909.034886:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:2348:x1874704171860864:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 216us (388us total) trans 0 rc 0/0 00010000:00010000:3.0:1787857909.034895:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.034895:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 74 00010000:00010000:3.0:1787857909.034931:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.034944:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857909.034950:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857909.034955:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.035015:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.035032:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 11 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.035053:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188301696:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857909.035161:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.035576:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188301568:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857909.035605:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.036230:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171860736 00000100:00100000:1.0:1787857909.036238:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171860736 00002000:00100000:1.0:1787857909.036286:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1d:0x0] (0->157) req@ffff999901222940 x1874704171860736/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:555/0 lens 648/0 e 0 to 0 dl 1787857920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857909.036297:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901222940 with x1874704171860736 ext(0->157) 00010000:00010000:1.0:1787857909.036304:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 10 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.036318:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 10 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857909.036325:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff999901222940 00000100:00100000:1.0:1787857909.036361:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:1.0:1787857909.036372:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2349:x1874704171860736:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857909.036963:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901222940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171860736:12345-192.168.204.36@tcp:4:cp.0 Request processed in 590us (2508us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787857909.036972:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00002000:00100000:1.0:1787857909.036980:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1d:0x0] (0->157) req@ffff999901222940 x1874704171860736/t4294967376(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:555/0 lens 648/448 e 0 to 0 dl 1787857920 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857909.037666:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901222940 with x1874704171860736 ext(0->157) 00010000:00010000:1.0:1787857909.037680:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 12 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.037693:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 12 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857909.037701:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff999901222940 00000100:00100000:0.0:1787857909.044646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.044680:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.045185:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188301696:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857909.045238:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.045313:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171861120 00000100:00100000:2.0:1787857909.045328:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171861120 00002000:00100000:2.0:1787857909.045384:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x20:0x0] (0->157) req@ffff999901221a40 x1874704171861120/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:555/0 lens 648/0 e 0 to 0 dl 1787857920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857909.045396:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901221a40 with x1874704171861120 ext(0->157) 00010000:00010000:2.0:1787857909.045406:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 12 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.045423:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 12 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857909.045438:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff999901221a40 00000100:00100000:2.0:1787857909.045490:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:2.0:1787857909.045501:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171861120:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:2.0:1787857909.046111:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171861120:12345-192.168.204.36@tcp:4:cp.0 Request processed in 608us (1425us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787857909.046121:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00002000:00100000:2.0:1787857909.046130:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x20:0x0] (0->157) req@ffff999901221a40 x1874704171861120/t4294967391(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:555/0 lens 648/448 e 0 to 0 dl 1787857920 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857909.046141:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff999901221a40 with x1874704171861120 ext(0->157) 00010000:00010000:2.0:1787857909.046148:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 14 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.046159:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 14 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857909.046167:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff999901221a40 00000100:00100000:3.0:1787857909.046280:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.046380:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171860992 00000100:00100000:1.0:1787857909.046386:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171860992 00010000:00010000:1.0:1787857909.046418:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 12 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.046459:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 448 00000100:00100000:1.0:1787857909.046470:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171860992:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857909.046483:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857909.046505:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 12 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.046523:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 12 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.046552:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009958475b/0xd3f183cab4a7e47b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4480 expref: 12 pid: 14028 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.046571:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857909.046576:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857909.046582:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.046592:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.046630:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857909.046666:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171860992:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 198us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.046673:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 448 00000100:00100000:2.0:1787857909.047040:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171861248 00000100:00100000:2.0:1787857909.047051:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171861248 00000100:00100000:2.0:1787857909.047117:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1547 00000100:00100000:2.0:1787857909.047126:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:33510:x1874704171861248:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857909.047160:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.047188:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e618 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4521 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.047403:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.047422:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.047437:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.047456:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.047464:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.047471:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.048053:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.048070:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.048176:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.048208:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.048217:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.048225:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857909.048231:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.048241:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.048268:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.048278:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b03c3dee/0xd3f183cab4a7e5f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.048392:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2348:x1874704171860224:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 44054us (44967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.048402:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 428 00010000:00010000:2.0:1787857909.048767:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048779:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048787:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048792:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.048797:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048808:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048847:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.048852:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.048859:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048866:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e61f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048881:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048887:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048894:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048899:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.048901:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048907:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048914:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff9998c3379d00) 00010000:00010000:2.0:1787857909.048917:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.048920:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.048931:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e626 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.049012:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e618 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4521 expref: 60 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.049026:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.049029:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.049033:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4521 expref: 60 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.049045:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6200, rc 0) 00000100:00100000:2.0:1787857909.049111:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:33510:x1874704171861248:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1984us (2834us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857909.049120:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1547 00000100:00100000:0.0:1787857909.056413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.056520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.056999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.057090:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171861504 00000100:00100000:1.0:1787857909.057103:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171861504 00010000:00010000:1.0:1787857909.057160:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 14 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.057217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:1.0:1787857909.057230:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171861504:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857909.057260:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857909.057314:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 14 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057333:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 14 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057369:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7e54d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44d4 expref: 14 pid: 8490 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057393:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857909.057398:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857909.057405:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057417:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057456:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857909.057545:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171861504:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 317us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.057555:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 449 00010000:00010000:1.0:1787857909.057630:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057640:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057675:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057695:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057704:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057711:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857909.057715:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057724:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057737:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.057745:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000475282f7/0xd3f183cab4a7e611 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.057802:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171860608:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 23040us (23394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.057846:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 429 00000100:00100000:2.0:1787857909.058632:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171861888 00000100:00100000:2.0:1787857909.058646:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171861888 00000100:00100000:2.0:1787857909.058862:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171861632 00000100:00100000:2.0:1787857909.058867:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171861632 00000100:00100000:3.0:1787857909.058964:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1548 00000100:00100000:3.0:1787857909.058979:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:33510:x1874704171861888:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.059018:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.059045:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e62d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4528 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.059224:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.059243:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 110 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.059252:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.059316:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 110 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.059334:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 110 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.059352:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c2ca1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188301824:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857909.059446:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857909.062758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.062796:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1549 00000100:00100000:3.0:1787857909.062807:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.062850:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33508:x1874704171861632:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857909.062872:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171862016 00000100:00100000:3.0:1787857909.062885:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171862016 00010000:00010000:3.0:1787857909.062931:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 111 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.062972:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 450 00000100:00100000:3.0:1787857909.062982:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:2349:x1874704171862016:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857909.063015:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857909.063024:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 111 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.063040:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 111 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.063059:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33508:x1874704171861632:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 245us (6535us total) trans 0 rc 0/0 00010000:00010000:3.0:1787857909.063072:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00000100:00100000:1.0:1787857909.063072:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1549 00010000:00010000:3.0:1787857909.063085:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.063099:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.063104:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171862272 00010000:00010000:3.0:1787857909.063109:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.063114:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171862272 00010000:00010000:3.0:1787857909.063145:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857909.063168:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1550 00000100:00100000:3.0:1787857909.063192:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:2349:x1874704171862016:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 209us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.063207:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 450 00000100:00100000:1.0:1787857909.063348:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33509:x1874704171862272:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857909.063406:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33509:x1874704171862272:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 228us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.063413:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1550 00010000:00010000:0.0:1787857909.063560:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7e57e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44e9 expref: 110 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.063586:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c2ca1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188301824:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857909.063611:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.063622:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.063628:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.063657:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.063670:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.063678:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857909.064670:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:0.0:1787857909.065075:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065091:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065102:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065146:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065154:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065161:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065168:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.065173:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065181:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065199:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.065203:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.065209:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.065216:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e634 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857909.065234:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d72c1302 reply state 0000000065fa957e transno 4294968352 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.065244:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857909.069136:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e62d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.069211:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.069225:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:0.0:1787857909.069229:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857909.069234:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4a00, rc 0) 00000100:00100000:0.0:1787857909.069399:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:33510:x1874704171861888:12345-192.168.204.36@tcp:101:cp.0 Request processed in 10422us (12998us total) trans 4294968352 rc 0/0 00000100:00100000:0.0:1787857909.069410:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1548 00000100:00100000:0.0:1787857909.076488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.076551:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.076720:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171862400 00000100:00100000:1.0:1787857909.076733:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171862400 00000100:00100000:1.0:1787857909.076811:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171862528 00000100:00100000:1.0:1787857909.076836:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171862528 00000100:00100000:1.0:1787857909.076866:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 430 00000100:00100000:1.0:1787857909.076879:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2347:x1874704171862400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857909.076910:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.076946:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd452f expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857909.076996:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 158, mtime: 0x6a908bf4, atime: 0x0, ctime: 0x6a908bf4, blocks: 0x1 00010000:00010000:1.0:1787857909.077026:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1787857909.077033:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857909.077046:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.077068:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 11 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.077088:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0200, rc 0) 00000100:00100000:1.0:1787857909.077172:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171862400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 295us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.077180:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 430 00000100:00100000:1.0:1787857909.077204:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 431 00000100:00100000:1.0:1787857909.077212:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171862528:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857909.077221:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.077235:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4536 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857909.077253:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 158, mtime: 0x6a908bf4, atime: 0x0, ctime: 0x6a908bf4, blocks: 0x1 00010000:00010000:1.0:1787857909.077266:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1787857909.077269:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857909.077275:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.077289:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 13 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.077306:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c26c0e00, rc 0) 00000100:00100000:1.0:1787857909.077328:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171862528:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 118us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.077335:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 431 00010000:00010000:3.0:1787857909.078093:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.078107:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.078114:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.078121:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.078127:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.078138:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.078159:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff9997c3d03400) 00010000:00010000:3.0:1787857909.078162:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.078169:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.078176:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7e63b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.082362:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.082459:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171862656 00000100:00100000:3.0:1787857909.082472:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171862656 00000100:00100000:3.0:1787857909.082544:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 432 00000100:00100000:3.0:1787857909.082555:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171862656:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.082579:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.082611:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd453d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857909.082651:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857909.082681:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=733s v=(0 0) 00010000:00010000:3.0:1787857909.082687:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.082699:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.082719:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.082733:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:3.0:1787857909.083130:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171862656:12345-192.168.204.36@tcp:101:cp.0 Request processed in 576us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.083139:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 432 00000100:00100000:1.0:1787857909.084598:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.084646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.084735:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171862912 00000100:00100000:2.0:1787857909.084745:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171862912 00000100:00100000:2.0:1787857909.084812:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171863168 00000100:00100000:2.0:1787857909.084855:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171863168 00000100:00100000:2.0:1787857909.084884:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1551 00000100:00100000:2.0:1787857909.084894:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:33508:x1874704171862912:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857909.085040:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:33508:x1874704171862912:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 147us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857909.085052:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1551 00000100:00100000:2.0:1787857909.085070:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1552 00000100:00100000:2.0:1787857909.085077:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33509:x1874704171863168:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857909.085118:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33509:x1874704171863168:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 41us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857909.085125:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1552 00000100:00100000:1.0:1787857909.091774:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.092002:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171863296 00000100:00100000:3.0:1787857909.092020:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171863296 00000100:00100000:1.0:1787857909.092726:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.092867:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171863424 00000100:00100000:2.0:1787857909.092875:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171863424 00002000:00100000:2.0:1787857909.092947:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1d:0x0] (0->4095) req@ffff9997c2717c00 x1874704171863424/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1787857920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857909.092961:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2717c00 with x1874704171863424 ext(0->4095) 00002000:00010000:2.0:1787857909.092969:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c2717c00 00000100:00100000:2.0:1787857909.093013:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 125 00000100:00100000:2.0:1787857909.093025:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171863424:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787857909.093341:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171863424:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 317us (619us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857909.093352:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 125 00002000:00100000:2.0:1787857909.093360:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1d:0x0] (0->4095) req@ffff9997c2717c00 x1874704171863424/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787857920 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857909.093368:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c2717c00 with x1874704171863424 ext(0->4095) 00002000:00010000:2.0:1787857909.093371:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c2717c00 00002000:00100000:1.0:1787857909.099668:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x20:0x0] (0->4095) req@ffff9998ffaa0b40 x1874704171863296/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:555/0 lens 488/0 e 0 to 0 dl 1787857920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857909.099764:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffaa0b40 with x1874704171863296 ext(0->4095) 00002000:00010000:1.0:1787857909.099774:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffaa0b40 00000100:00100000:1.0:1787857909.099850:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 126 00000100:00100000:1.0:1787857909.099876:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171863296:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857909.100179:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2348:x1874704171863296:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 318us (8491us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857909.100189:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 126 00002000:00100000:1.0:1787857909.100197:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x20:0x0] (0->4095) req@ffff9998ffaa0b40 x1874704171863296/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:555/0 lens 488/4536 e 0 to 0 dl 1787857920 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857909.100206:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998ffaa0b40 with x1874704171863296 ext(0->4095) 00002000:00010000:1.0:1787857909.100210:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998ffaa0b40 00000100:00100000:1.0:1787857909.105160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.105236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.105360:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171863552 00000100:00100000:0.0:1787857909.105375:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171863552 00000100:00100000:0.0:1787857909.105461:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 433 00000100:00100000:0.0:1787857909.105475:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:33510:x1874704171863552:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857909.105505:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.105530:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4544 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.105573:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.105585:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857909.105590:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857909.105597:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.105644:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 13 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.105662:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 13 pid: 6714 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.105681:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188301952:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857909.105973:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.106575:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171863680 00000100:00100000:2.0:1787857909.106583:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171863680 00000100:00100000:2.0:1787857909.106644:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1553 00000100:00100000:2.0:1787857909.106652:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33508:x1874704171863680:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857909.106667:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.106699:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e66c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd454b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.106739:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.106756:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.106770:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.106938:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e66c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 63 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.106960:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.106969:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:2.0:1787857909.106973:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857909.106977:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7c00, rc 0) 00000100:00100000:2.0:1787857909.107055:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:33508:x1874704171863680:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 404us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857909.107063:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1553 00000100:00100000:0.0:1787857909.115758:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188301952:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857909.115812:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.115881:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4600, rc 0) 00000100:00100000:0.0:1787857909.115961:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:33510:x1874704171863552:12345-192.168.204.36@tcp:101:cp.0 Request processed in 10488us (10819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.115973:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 433 00000100:00100000:1.0:1787857909.123561:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.124245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.124671:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171863808 00000100:00100000:3.0:1787857909.124695:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171863808 00000100:00100000:3.0:1787857909.124774:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1554 00000100:00100000:3.0:1787857909.124787:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+62:33509:x1874704171863808:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857909.124848:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.124878:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e67a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4552 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.124928:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.124947:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.124962:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.125119:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e67a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 64 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.125144:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 63 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.125154:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:3.0:1787857909.125157:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857909.125162:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:3.0:1787857909.125475:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+63:33509:x1874704171863808:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 689us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.125483:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1554 00000100:00100000:2.0:1787857909.128525:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171863936 00000100:00100000:2.0:1787857909.128551:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171863936 00010000:00010000:2.0:1787857909.128620:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 13 pid: 6714 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.128805:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 451 00000100:00100000:2.0:1787857909.128839:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171863936:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857909.128861:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857909.128889:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 13 pid: 6714 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.128907:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 13 pid: 6714 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.128938:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7e65e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd453d expref: 13 pid: 6714 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.128962:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857909.128967:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857909.128976:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.128998:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.129048:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.129073:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874704188302080:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857909.129197:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d0946d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857909.149362:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.149455:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.151233:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.151273:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171864448 00000100:00100000:0.0:1787857909.151284:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171864448 00000100:00100000:0.0:1787857909.151358:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 331 00000100:00100000:0.0:1787857909.151370:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+63:33510:x1874704171864448:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:0.0:1787857909.151894:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33510:x1874704171864448:12345-192.168.204.36@tcp:35:cp.0 Request processed in 523us (671us total) trans 4294968353 rc 0/0 00000100:00100000:0.0:1787857909.151904:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 331 00000100:00100000:1.0:1787857909.154125:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874704188302080:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857909.154162:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857909.154263:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171863936:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 25447us (30716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.154276:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 451 00000100:00100000:2.0:1787857909.154808:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171864064 00000100:00100000:2.0:1787857909.154833:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171864064 00000100:00100000:2.0:1787857909.154893:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171864192 00000100:00100000:2.0:1787857909.154897:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171864192 00000100:00100000:2.0:1787857909.154981:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1555 00000100:00100000:2.0:1787857909.155004:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:33508:x1874704171864064:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857909.155060:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857909.155193:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:33508:x1874704171864064:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 193us (5846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857909.155201:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1555 00000100:00100000:0.0:1787857909.163734:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1556 00000100:00100000:0.0:1787857909.163781:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33509:x1874704171864192:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857909.163865:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857909.164345:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33509:x1874704171864192:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 588us (14886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.164357:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1556 00000100:00100000:0.0:1787857909.164497:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.166066:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171864576 00000100:00100000:2.0:1787857909.166086:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171864576 00000100:00100000:2.0:1787857909.166167:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 434 00000100:00100000:2.0:1787857909.166178:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171864576:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857909.166253:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.166279:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857909.166285:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857909.168521:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.168559:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.168611:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.168622:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.168632:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.168640:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857909.168646:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.168656:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.168674:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.168683:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d6487b/0xd3f183cab4a7e688 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.168812:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171864576:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 2629us (4308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857909.168865:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 434 00000100:00100000:0.0:1787857909.170445:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.172531:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171864704 00000100:00100000:3.0:1787857909.172550:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171864704 00000100:00100000:3.0:1787857909.172639:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 435 00000100:00100000:3.0:1787857909.172650:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171864704:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00000100:00100000:0.0:1787857909.174003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857909.174231:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174261:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.174267:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.174278:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174298:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174344:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174355:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174366:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174376:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857909.174381:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174392:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174413:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.174422:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e68f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.174543:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171864704:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 1892us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.174554:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 435 00000100:00100000:3.0:1787857909.174619:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171864960 00000100:00100000:3.0:1787857909.174629:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171864960 00000100:00100000:2.0:1787857909.175727:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1557 00000100:00100000:2.0:1787857909.175746:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33508:x1874704171864960:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857909.175879:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.175900:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 64 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.175910:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.175956:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 64 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.175973:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 64 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.176002:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3043480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188302208:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857909.177162:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d0946d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857909.180542:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.181709:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171865216 00000100:00100000:2.0:1787857909.181728:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171865216 00000100:00100000:2.0:1787857909.181805:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1558 00000100:00100000:2.0:1787857909.181848:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:33509:x1874704171865216:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857909.182099:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.182128:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 65 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.182139:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.182186:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 65 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.182200:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 65 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.182219:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3041680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188302336:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857909.187108:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c70a6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857909.188141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.188408:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171865344 00000100:00100000:1.0:1787857909.188421:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171865344 00010000:00010000:1.0:1787857909.188477:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 66 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.188520:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 452 00000100:00100000:1.0:1787857909.188532:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:2349:x1874704171865344:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857909.188552:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857909.188561:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 66 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.188578:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 66 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.188609:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857909.188616:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.188629:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.188640:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.188663:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857909.188742:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:2349:x1874704171865344:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 211us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.188750:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 452 00010000:00010000:2.0:1787857909.190544:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7e673 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd454b expref: 65 pid: 5858 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.190574:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3043480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188302208:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857909.190604:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.190618:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.190625:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.190957:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.190967:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.190976:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.190994:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.191000:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.191009:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.191029:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:2.0:1787857909.191033:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857909.191040:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.191047:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e696 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.193020:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:33508:x1874704171864960:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 17264us (19023us total) trans 4294968354 rc 0/0 00000100:00100000:2.0:1787857909.193039:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1557 00000100:00100000:3.0:1787857909.196745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.196879:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171865472 00000100:00100000:1.0:1787857909.196894:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171865472 00010000:00010000:1.0:1787857909.196957:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 65 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.197026:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 453 00000100:00100000:1.0:1787857909.197038:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:2349:x1874704171865472:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857909.197060:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857909.197068:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 65 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.197084:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 65 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.197115:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:1.0:1787857909.197122:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.197139:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.197149:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.197172:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857909.197405:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:2349:x1874704171865472:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 367us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.197415:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 453 00010000:00010000:2.0:1787857909.199538:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e681 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4552 expref: 64 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.199574:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3041680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188302336:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857909.199607:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200047:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200058:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200391:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200400:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200408:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200416:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.200421:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200431:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200453:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:1.0:1787857909.200457:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857909.200464:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.200471:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e69d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857909.200906:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857909.200913:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857909.201419:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1787857909.201431:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857909.202194:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.202631:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171865728 00000100:00100000:3.0:1787857909.202644:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171865728 00000100:00100000:3.0:1787857909.202725:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 332 00000100:00100000:3.0:1787857909.202737:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:33508:x1874704171865728:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857909.203077:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33508:x1874704171865728:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 340us (890us total) trans 4294968356 rc 0/0 00000100:00100000:3.0:1787857909.203086:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 332 00000100:00100000:1.0:1787857909.207453:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:33509:x1874704171865216:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 25614us (26905us total) trans 4294968355 rc 0/0 00000100:00100000:1.0:1787857909.207477:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1558 00000100:00100000:0.0:1787857909.219671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.219863:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171865856 00000100:00100000:1.0:1787857909.219879:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171865856 00000100:00100000:1.0:1787857909.219964:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1559 00000100:00100000:1.0:1787857909.219977:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+110:33513:x1874704171865856:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857909.220015:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.220044:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e6a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4559 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220150:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220169:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220185:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220204:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220213:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220220:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220387:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7e6b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220398:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7e6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220405:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7e6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857909.220451:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x30:0x0]: returning size 158 00000004:00200000:1.0:1787857909.220457:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857909.220482:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7e6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220496:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7e6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220506:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220513:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220520:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220532:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.220538:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220547:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220560:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.220564:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.220569:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220576:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494e00/0xd3f183cab4a7e6ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220595:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220602:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220608:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220612:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c1494000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.220615:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220621:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220632:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff9998e1a0cc00) 00010000:00010000:1.0:1787857909.220635:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.220638:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220644:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1494000/0xd3f183cab4a7e6b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.220680:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1400/0xd3f183cab4a7e6a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4559 expref: 112 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.221324:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7e6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4559 expref: 111 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.221333:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:1.0:1787857909.221336:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857909.221338:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaec800, rc 0) 00000100:00100000:1.0:1787857909.221437:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+111:33513:x1874704171865856:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1461us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.221446:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1559 00000100:00100000:0.0:1787857909.228765:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.229596:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171866112 00000100:00100000:3.0:1787857909.229613:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171866112 00000100:00100000:2.0:1787857909.229787:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 333 00000100:00100000:2.0:1787857909.229800:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+65:33509:x1874704171866112:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857909.230255:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33509:x1874704171866112:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 455us (1510us total) trans 4294968357 rc 0/0 00000100:00100000:2.0:1787857909.230265:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 333 00000100:00100000:2.0:1787857909.234006:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.234568:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171866368 00000100:00100000:3.0:1787857909.234583:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171866368 00000100:00100000:3.0:1787857909.234674:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:3.0:1787857909.234697:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+111:2347:x1874704171866368:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:3.0:1787857909.234786:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.234841:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e6c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4560 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.234932:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.234953:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.234968:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.234998:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235006:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235013:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235132:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235141:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235371:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235378:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.235383:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235396:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235412:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.235415:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.235421:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235428:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e6c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235446:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235452:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235458:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235463:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.235466:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235472:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235479:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9998d12ef800) 00010000:00010000:3.0:1787857909.235481:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.235484:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235494:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e6ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235534:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e6c0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4560 expref: 112 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235652:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.235656:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857909.235660:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e6c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4560 expref: 112 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.235671:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc -2) 00000100:00100000:3.0:1787857909.235776:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+111:2347:x1874704171866368:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 1093us (1795us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857909.235786:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:1.0:1787857909.239317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.239526:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171866240 00000100:00100000:0.0:1787857909.239542:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171866240 00000100:00100000:0.0:1787857909.239666:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 436 00000100:00100000:0.0:1787857909.239679:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171866240:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857909.239716:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.239743:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf22c427/0xd3f183cab4a7e6d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd457c expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.239867:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b42940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188302464:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857909.240004:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127ba80 going to sleep for 11 seconds 00002000:00010000:0.0:1787857909.244975:0:6711:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787857909.245001:0:6711:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime: 0 -> 1787857908 00002000:00010000:0.0:1787857909.245004:0:6711:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime: 0 -> 1787857908 00002000:00010000:0.0:1787857909.245006:0:6711:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime: 0 -> 1787857908 00000100:00100000:0.0:1787857909.245045:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b42940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188302464:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857909.245171:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf22c427/0xd3f183cab4a7e6d5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd457c expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.245332:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf22c427/0xd3f183cab4a7e6d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd457c expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.245350:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4e00, rc 0) 00000100:00100000:0.0:1787857909.245444:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171866240:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5767us (6770us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857909.245454:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 436 00000100:00100000:2.0:1787857909.250613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.250756:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171866496 00000100:00100000:0.0:1787857909.250779:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171866496 00000100:00100000:0.0:1787857909.251070:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1560 00000100:00100000:0.0:1787857909.251084:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+111:33513:x1874704171866496:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857909.251111:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.251142:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e6dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd459f expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.251258:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.251276:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.251305:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857909.251387:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:0.0:1787857909.251392:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857909.251434:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.251479:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e6dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 113 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.251503:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 112 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.251514:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.251517:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857909.251522:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc5a00, rc 0) 00000100:00100000:0.0:1787857909.251619:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+112:33513:x1874704171866496:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 538us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.251628:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1560 00000100:00100000:1.0:1787857909.260812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.260924:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171866624 00000100:00100000:2.0:1787857909.260941:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171866624 00000100:00100000:2.0:1787857909.261037:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 437 00000100:00100000:2.0:1787857909.261051:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171866624:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857909.261079:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.261101:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7e6ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45a6 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.261320:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3041a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188302592:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857909.261920:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d0946d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.269651:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3041a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188302592:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857909.269715:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7e6ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45a6 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.269759:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7e6ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45a6 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.269775:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6c00, rc 0) 00000100:00100000:2.0:1787857909.269934:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171866624:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 8885us (9131us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857909.269946:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 437 00000100:00100000:3.0:1787857909.276793:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.277447:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171866880 00000100:00100000:1.0:1787857909.277463:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171866880 00000100:00100000:1.0:1787857909.277563:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1561 00000100:00100000:1.0:1787857909.277576:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+112:33513:x1874704171866880:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1787857909.278012:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].47, 136 off14584 00000100:00100000:1.0:1787857909.278169:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+112:33513:x1874704171866880:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 595us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.278178:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1561 00000100:00100000:1.0:1787857909.292175:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.292434:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171867008 00000100:00100000:0.0:1787857909.292449:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171867008 00000100:00100000:0.0:1787857909.292598:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1562 00000100:00100000:0.0:1787857909.292611:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+112:33516:x1874704171867008:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857909.292641:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.292672:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e6f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45ad expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.292768:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.292789:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.292808:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.292918:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.292928:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.292935:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293598:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293609:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293616:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293623:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c3bc4e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.293628:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293638:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293656:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.293659:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.293666:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293673:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4e00/0xd3f183cab4a7e6f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293703:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293710:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293717:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293723:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.293726:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293731:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293738:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9997c3d03b00) 00010000:00010000:1.0:1787857909.293741:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.293744:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293750:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7e6ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293807:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e6f1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45ad expref: 113 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293897:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.293901:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.293905:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4200/0xd3f183cab4a7e6f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45ad expref: 113 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.293917:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9997c3bc4200, rc 0) 00000100:00100000:1.0:1787857909.294025:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+112:33516:x1874704171867008:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1416us (1867us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857909.294040:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1562 00000100:00100000:3.0:1787857909.295512:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.295648:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171867136 00000100:00100000:2.0:1787857909.295661:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171867136 00000100:00100000:2.0:1787857909.295746:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:2.0:1787857909.295758:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+112:2349:x1874704171867136:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:2.0:1787857909.295809:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.295857:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45b4 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.295933:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.295949:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.295962:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302490:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302520:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302532:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302622:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302629:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302636:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302642:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.302647:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302654:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302668:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.302672:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.302678:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302684:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7400/0xd3f183cab4a7e70d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302695:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302701:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302706:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302712:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.302715:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302720:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302738:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x996ea506 (ffff9998c3379d00) 00010000:00010000:2.0:1787857909.302741:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.302743:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302748:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7e714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302795:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e706 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45b4 expref: 113 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.302806:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.302808:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787857909.302811:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45b4 expref: 113 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.303720:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6c00, rc -2) 00000100:00100000:2.0:1787857909.304615:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+112:2349:x1874704171867136:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 8849us (11316us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857909.304629:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:0.0:1787857909.306585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.306679:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171867264 00000100:00100000:3.0:1787857909.306693:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171867264 00000100:00100000:3.0:1787857909.306775:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1563 00000100:00100000:3.0:1787857909.306789:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33517:x1874704171867264:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857909.306859:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.306892:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e71b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45bb expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307002:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307020:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307034:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307053:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307256:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307266:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307418:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307428:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307436:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307442:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.307447:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307456:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307472:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.307477:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.307483:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307489:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307505:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307510:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307516:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307521:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.307524:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307529:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307537:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9998d12ef800) 00010000:00010000:3.0:1787857909.307539:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.307542:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307547:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307589:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e71b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45bb expref: 67 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307600:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.307602:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.307606:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e71b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45bb expref: 67 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.307615:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:3.0:1787857909.307702:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33517:x1874704171867264:12345-192.168.204.36@tcp:101:rm.0 Request processed in 915us (1130us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857909.307712:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1563 00000100:00100000:1.0:1787857909.313306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.313383:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171867392 00000100:00100000:2.0:1787857909.313398:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171867392 00000100:00100000:2.0:1787857909.313546:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1564 00000100:00100000:2.0:1787857909.313564:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33517:x1874704171867392:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857909.313590:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.313616:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45c2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313687:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313702:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313715:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313731:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313738:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313745:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313870:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313881:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313889:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313898:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.313903:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313928:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313949:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.313955:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.313962:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313969:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7e737 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.313997:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314005:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314011:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314017:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.314020:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314026:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314034:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9998c3379c00) 00010000:00010000:2.0:1787857909.314037:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.314040:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314046:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7e73e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314085:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e730 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45c2 expref: 67 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314096:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.314098:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.314102:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45c2 expref: 67 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.314111:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7800, rc 0) 00000100:00100000:3.0:1787857909.314263:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33517:x1874704171867392:12345-192.168.204.36@tcp:101:rm.0 Request processed in 699us (986us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857909.315886:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1564 00000100:00100000:2.0:1787857909.326292:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.326528:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171867520 00000100:00100000:1.0:1787857909.326550:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171867520 00000100:00100000:1.0:1787857909.326671:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1565 00000100:00100000:1.0:1787857909.326766:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33518:x1874704171867520:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857909.326797:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.326856:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45c9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.326956:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.326976:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327004:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327022:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327030:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327036:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327133:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327143:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327151:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327158:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaeca00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.327164:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327173:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327188:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.327192:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.327199:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327205:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7e74c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327223:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327229:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327235:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327240:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaedc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.327244:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327250:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327258:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9998e1a0cc00) 00010000:00010000:1.0:1787857909.327261:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.327264:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327270:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327377:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e745 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45c9 expref: 67 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327389:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.327391:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.327394:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45c9 expref: 67 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.327404:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaed200, rc 0) 00000100:00100000:1.0:1787857909.327495:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33518:x1874704171867520:12345-192.168.204.36@tcp:101:cp.0 Request processed in 734us (1217us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857909.332553:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1565 00000100:00100000:1.0:1787857909.335663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.335956:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171867648 00000100:00100000:3.0:1787857909.335971:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171867648 00000100:00100000:3.0:1787857909.336098:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1566 00000100:00100000:3.0:1787857909.336110:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33518:x1874704171867648:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.336140:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.336169:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e75a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45d0 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336284:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336304:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336318:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336338:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336346:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336353:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336452:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336460:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336476:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336483:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.336488:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336497:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336513:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.336516:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.336522:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336528:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336546:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336551:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336557:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336562:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.336565:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336570:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336575:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9998d12ef800) 00010000:00010000:3.0:1787857909.336577:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.336580:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336586:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336624:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e75a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d0 expref: 67 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336635:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.336637:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.336642:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e75a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d0 expref: 67 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.336652:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:3.0:1787857909.336754:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33518:x1874704171867648:12345-192.168.204.36@tcp:101:cp.0 Request processed in 645us (1106us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857909.336761:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1566 00000100:00100000:2.0:1787857909.344322:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.344401:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171867904 00000100:00100000:3.0:1787857909.344419:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171867904 00000100:00100000:3.0:1787857909.344553:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1567 00000100:00100000:3.0:1787857909.344567:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33518:x1874704171867904:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.344597:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.344628:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e76f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45d7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.344876:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.344898:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 111 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.344909:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.344960:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 111 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.344977:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 111 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.345013:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188302720:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857909.345145:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857909.355610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.355969:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171868032 00000100:00100000:2.0:1787857909.356102:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171868032 00010000:00010000:2.0:1787857909.356168:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 112 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.356225:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 454 00000100:00100000:2.0:1787857909.356239:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+112:2349:x1874704171868032:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857909.356259:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857909.356267:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 112 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.356282:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 112 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.356309:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.356315:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.356326:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.356334:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.356673:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857909.356751:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+112:2349:x1874704171868032:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 510us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.356763:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 454 00010000:00010000:1.0:1787857909.356941:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc5a00/0xd3f183cab4a7e6e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd459f expref: 112 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.356969:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188302720:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857909.357010:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.357022:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.357029:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.357058:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.357072:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.357085:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857909.358229:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:1.0:1787857909.358558:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.358653:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.358665:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.358719:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.358727:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.358734:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.358740:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.358745:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.358752:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.359007:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.359010:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.359017:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.359023:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e776 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857909.359042:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8850c52 reply state 0000000063dd9181 transno 4294968358 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.359053:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857909.359105:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e76f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 69 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.359122:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 68 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.359137:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:1.0:1787857909.359139:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857909.359142:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaedc00, rc 0) 00000100:00100000:1.0:1787857909.359237:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33518:x1874704171867904:12345-192.168.204.36@tcp:101:cp.0 Request processed in 14674us (14927us total) trans 4294968358 rc 0/0 00000100:00100000:1.0:1787857909.359246:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1567 00010000:00010000:0.0:1787857909.367615:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.367648:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.367657:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.367665:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.367671:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.367681:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.367711:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9998e1a0cc00) 00010000:00010000:0.0:1787857909.367715:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.367721:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.367729:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e77d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.384708:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.384766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.385423:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171868288 00000100:00100000:3.0:1787857909.385437:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171868288 00000100:00100000:3.0:1787857909.385525:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:3.0:1787857909.385538:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:2348:x1874704171868288:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:3.0:1787857909.385620:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.385647:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45e5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385740:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385758:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385772:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385789:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385801:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385808:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385952:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385960:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385969:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385974:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.385988:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.385997:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386011:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.386014:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.386019:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386026:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386042:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386049:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386054:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386058:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.386061:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386067:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386075:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9998d12ef800) 00010000:00010000:3.0:1787857909.386077:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.386080:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386084:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386123:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e792 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45e5 expref: 69 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386134:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.386136:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857909.386139:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7e792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45e5 expref: 69 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.386154:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc -2) 00000100:00100000:3.0:1787857909.386251:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:2348:x1874704171868288:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 715us (1482us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857909.386261:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:1.0:1787857909.386412:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171868160 00000100:00100000:1.0:1787857909.386419:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171868160 00000100:00100000:1.0:1787857909.386475:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 438 00000100:00100000:1.0:1787857909.386486:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171868160:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857909.386500:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.386521:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd45de expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857909.386552:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857909.386569:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=733s v=(0 0) 00010000:00010000:1.0:1787857909.386575:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857909.386586:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 14 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.386602:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 14 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.386615:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaeca00, rc 0) 00000100:00100000:1.0:1787857909.386651:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171868160:12345-192.168.204.36@tcp:101:cp.0 Request processed in 169us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.386659:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 438 00000100:00100000:0.0:1787857909.398546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.398744:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171868416 00000100:00100000:3.0:1787857909.398763:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171868416 00000100:00100000:3.0:1787857909.399144:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 439 00000100:00100000:3.0:1787857909.399159:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:33518:x1874704171868416:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.399185:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.399217:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd461d expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.399267:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 15 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.399280:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.399286:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.399293:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 4/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.399347:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 15 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.399364:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 15 pid: 8490 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.399388:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188302848:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857909.399527:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.407461:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.407557:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188302848:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857909.407602:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.407626:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71200, rc 0) 00000100:00100000:3.0:1787857909.407731:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:33518:x1874704171868416:12345-192.168.204.36@tcp:101:cp.0 Request processed in 8575us (9202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.407743:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 439 00000100:00100000:0.0:1787857909.408313:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171868544 00000100:00100000:0.0:1787857909.408327:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171868544 00010000:00010000:0.0:1787857909.408381:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 15 pid: 8490 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.408431:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 455 00000100:00100000:0.0:1787857909.408445:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171868544:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857909.408471:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857909.408510:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 15 pid: 8490 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.408530:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 15 pid: 8490 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.408564:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7e7a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45de expref: 15 pid: 8490 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.408588:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857909.408593:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857909.408603:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 14 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.409235:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 14 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.409303:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 14 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.409327:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b40000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8468:1874704188302976:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857909.409477:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.417535:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.417633:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171868800 00000100:00100000:3.0:1787857909.417644:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171868800 00000100:00100000:3.0:1787857909.417720:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 334 00000100:00100000:3.0:1787857909.417737:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c600a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:33518:x1874704171868800:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:0.0:1787857909.418191:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b40000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8468:1874704188302976:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857909.418237:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:1.0:1787857909.422731:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968359 00000100:00100000:1.0:1787857909.423675:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c600a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33518:x1874704171868800:12345-192.168.204.36@tcp:35:cp.0 Request processed in 5934us (6140us total) trans 4294968360 rc 0/0 00000100:00100000:1.0:1787857909.423690:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 334 00000020:00080000:1.0:1787857909.423698:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787857909.427011:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171868544:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 18521us (19519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857909.427038:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 455 00000100:00100000:3.0:1787857909.460747:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.467197:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171868928 00000100:00100000:2.0:1787857909.467217:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171868928 00000100:00100000:3.0:1787857909.467735:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:3.0:1787857909.467752:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:2348:x1874704171868928:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:3.0:1787857909.467886:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.467915:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4624 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.468005:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.468028:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.468041:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469334:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469361:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469374:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469739:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469751:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469760:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469767:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.469782:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469793:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.469812:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.470017:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.470026:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470033:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e7bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470134:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470142:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470148:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470154:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.470157:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470164:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470172:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9998d12ef800) 00010000:00010000:3.0:1787857909.470175:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.470178:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470184:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470245:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7b5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4624 expref: 71 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470257:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.470259:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857909.470263:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4624 expref: 71 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.470273:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc -2) 00000100:00100000:3.0:1787857909.470425:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:2348:x1874704171868928:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 2674us (9691us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857909.470437:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 78 00010000:00010000:3.0:1787857909.489203:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857909.496653:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.497517:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171869056 00000100:00100000:1.0:1787857909.497535:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171869056 00000100:00100000:1.0:1787857909.497716:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1568 00000100:00100000:1.0:1787857909.497732:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:33525:x1874704171869056:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857909.497781:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.497849:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7e7ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd465c expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.497964:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.497994:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498011:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498029:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498036:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498046:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498214:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7e7df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498222:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7e7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498229:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7e7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857909.498277:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 158 00000004:00200000:1.0:1787857909.498284:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857909.498329:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7e7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498344:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7e7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498354:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498360:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498367:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498373:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaede00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.498378:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498387:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498402:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.498405:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.498410:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498416:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e7d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498434:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498440:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498447:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498453:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.498456:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498463:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498470:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9998d1291200) 00010000:00010000:1.0:1787857909.498473:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.498476:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498487:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e7d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498528:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7e7ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd465c expref: 113 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498543:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7e7df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd465c expref: 112 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.498552:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:1.0:1787857909.498554:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857909.498556:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaed000, rc 0) 00000100:00100000:1.0:1787857909.498677:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+112:33525:x1874704171869056:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 947us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.498687:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1568 00000100:00100000:1.0:1787857909.505804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.506615:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171869184 00000100:00100000:3.0:1787857909.506630:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171869184 00000100:00100000:0.0:1787857909.507214:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 440 00000100:00100000:0.0:1787857909.507229:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+18:2347:x1874704171869184:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857909.507255:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.507290:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7e7e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4663 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.507375:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188303104:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857909.507505:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127ba80 going to sleep for 11 seconds 00002000:00010000:0.0:1787857909.512394:0:14028:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787857909.512408:0:14028:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime: 0 -> 1787857909 00002000:00010000:0.0:1787857909.512411:0:14028:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime: 0 -> 1787857908 00002000:00010000:0.0:1787857909.512414:0:14028:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime: 0 -> 1787857909 00000100:00100000:0.0:1787857909.512457:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188303104:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857909.512517:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7e7e6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4663 expref: 19 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.512554:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7e7e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4663 expref: 19 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.512574:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7400, rc 0) 00000100:00100000:0.0:1787857909.512668:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+18:2347:x1874704171869184:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5441us (6880us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857909.512691:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 440 00000100:00100000:1.0:1787857909.518315:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.518712:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171869312 00000100:00100000:3.0:1787857909.518728:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171869312 00000100:00100000:3.0:1787857909.518859:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1569 00000100:00100000:3.0:1787857909.518872:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+112:33525:x1874704171869312:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857909.518905:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.518936:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd466a expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.519054:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.519432:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.519447:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857909.519536:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:3.0:1787857909.519540:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857909.519568:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.519606:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e7ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 114 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.519630:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 113 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.519639:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.519642:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857909.519647:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70200, rc 0) 00000100:00100000:3.0:1787857909.520263:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+113:33525:x1874704171869312:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1388us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.520594:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1569 00000100:00100000:3.0:1787857909.529222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.535211:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171869440 00000100:00100000:1.0:1787857909.535234:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171869440 00000100:00100000:1.0:1787857909.535542:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 441 00000100:00100000:1.0:1787857909.535556:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+18:2348:x1874704171869440:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857909.535584:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.535611:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7e7fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4671 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.535722:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188303232:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857909.535889:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857909.543260:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188303232:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857909.543398:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7e7fb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4671 expref: 19 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.543436:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7e7fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4671 expref: 19 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.543456:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaece00, rc 0) 00000100:00100000:1.0:1787857909.543628:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+18:2348:x1874704171869440:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 8073us (14586us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857909.543640:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 441 00000100:00100000:0.0:1787857909.553477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.554155:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171869696 00000100:00100000:1.0:1787857909.554171:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171869696 00000100:00100000:1.0:1787857909.554587:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1570 00000100:00100000:1.0:1787857909.554604:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:33525:x1874704171869696:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1787857909.555045:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].48, 136 off14720 00000100:00100000:1.0:1787857909.555212:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:33525:x1874704171869696:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 610us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.555222:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1570 00000100:00100000:0.0:1787857909.568434:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.568650:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171869824 00000100:00100000:1.0:1787857909.568664:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171869824 00000100:00100000:1.0:1787857909.568758:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1571 00000100:00100000:1.0:1787857909.568782:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+113:33526:x1874704171869824:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1787857909.568810:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.568899:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7e802 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4678 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569047:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569218:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569241:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569265:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569273:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569280:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569523:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569533:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569542:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569549:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.569555:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569570:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569588:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.569592:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.569599:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569605:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e809 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569622:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569628:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569634:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569640:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaede00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.569643:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569648:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569655:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9998d1291200) 00010000:00010000:1.0:1787857909.569657:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.569660:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569670:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e810 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569714:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7e802 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4678 expref: 114 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569725:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.569727:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.569731:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7e802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4678 expref: 114 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.569740:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaece00, rc 0) 00000100:00100000:1.0:1787857909.571568:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+113:33526:x1874704171869824:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1896us (2253us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857909.571587:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1571 00000100:00100000:3.0:1787857909.590629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.591757:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171869952 00000100:00100000:0.0:1787857909.591788:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171869952 00000100:00100000:0.0:1787857909.591942:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1572 00000100:00100000:0.0:1787857909.591954:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33527:x1874704171869952:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857909.591992:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.592025:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e817 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd467f expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592148:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592168:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592184:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592204:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592212:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592220:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592336:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592350:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592358:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592366:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.592372:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592382:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592403:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.592407:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.592415:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592422:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e81e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592446:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592453:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592460:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592465:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.592469:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592476:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592483:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9997c3d03600) 00010000:00010000:0.0:1787857909.592487:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.592490:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592496:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592548:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e817 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd467f expref: 71 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592561:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.592563:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.592567:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e817 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd467f expref: 71 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.592578:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6200, rc 0) 00000100:00100000:0.0:1787857909.592695:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33527:x1874704171869952:12345-192.168.204.36@tcp:101:rm.0 Request processed in 742us (2083us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857909.592706:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1572 00000100:00100000:3.0:1787857909.598525:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.599262:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171870080 00000100:00100000:1.0:1787857909.599277:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171870080 00000100:00100000:1.0:1787857909.599351:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:1.0:1787857909.599361:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:2348:x1874704171870080:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:1.0:1787857909.599407:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.599434:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e82c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4686 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599512:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599530:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599544:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599563:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599571:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599578:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599662:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599668:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599675:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599681:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.599686:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599695:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599706:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.599709:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.599714:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599722:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7e833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599736:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599742:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599748:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599753:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.599755:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599761:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599780:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x36fdbbdd (ffff9998d1291200) 00010000:00010000:1.0:1787857909.599783:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.599786:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.599791:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7e83a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.600204:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e82c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4686 expref: 71 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.600224:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.600226:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857909.600230:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7e82c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4686 expref: 71 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.600242:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaede00, rc -2) 00000100:00100000:2.0:1787857909.600727:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:2348:x1874704171870080:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 1362us (2212us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857909.600739:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:1.0:1787857909.605281:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.606016:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171870208 00000100:00100000:3.0:1787857909.606035:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171870208 00000100:00100000:3.0:1787857909.606126:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1573 00000100:00100000:3.0:1787857909.606138:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33527:x1874704171870208:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857909.606167:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.606194:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd468d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.606645:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.606671:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.607218:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607346:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607356:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607365:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607468:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607477:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607484:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607492:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.607497:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607507:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607525:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.607528:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.607535:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607547:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607568:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607574:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607579:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607585:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.607587:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607594:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607601:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9998c3379c00) 00010000:00010000:2.0:1787857909.607604:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.607607:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607613:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7e84f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.607673:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e841 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd468d expref: 71 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.608408:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.608410:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.608417:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd468d expref: 71 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.608432:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:2.0:1787857909.608549:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33527:x1874704171870208:12345-192.168.204.36@tcp:101:rm.0 Request processed in 2411us (3291us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857909.608560:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1573 00000100:00100000:2.0:1787857909.634926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.643329:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171870336 00000100:00100000:0.0:1787857909.643356:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171870336 00000100:00100000:0.0:1787857909.643460:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1574 00000100:00100000:0.0:1787857909.643474:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33528:x1874704171870336:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857909.643507:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.643539:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4694 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.645399:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.645444:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.645475:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.645499:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.645507:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.645515:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647732:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647755:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647782:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647790:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.647799:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647809:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647863:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.647867:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.647876:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647884:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7e85d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647904:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647911:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647918:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647923:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.647926:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647932:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647940:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9997c3d03600) 00010000:00010000:0.0:1787857909.647942:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.647946:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.647952:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7e864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.648040:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e856 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4694 expref: 71 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.648054:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.648057:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.648061:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4694 expref: 71 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.648072:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6200, rc 0) 00000100:00100000:0.0:1787857909.648192:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3042940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33528:x1874704171870336:12345-192.168.204.36@tcp:101:cp.0 Request processed in 4720us (13281us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857909.648203:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1574 00000100:00100000:2.0:1787857909.657336:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.657596:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171870464 00000100:00100000:3.0:1787857909.657611:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171870464 00000100:00100000:3.0:1787857909.657693:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1575 00000100:00100000:3.0:1787857909.657706:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33528:x1874704171870464:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.657735:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.657765:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e86b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd469b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.657922:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.657940:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.657954:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.657972:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.657992:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658000:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658365:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658375:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658382:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658389:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.658395:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658404:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658420:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.658424:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.658431:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658439:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658455:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658462:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658469:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658474:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.658478:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658484:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658491:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9998d12ef800) 00010000:00010000:3.0:1787857909.658494:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.658497:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658502:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658549:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e86b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd469b expref: 71 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658562:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.658565:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.658569:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e86b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd469b expref: 71 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.658579:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:3.0:1787857909.658669:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33528:x1874704171870464:12345-192.168.204.36@tcp:101:cp.0 Request processed in 965us (1353us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857909.658683:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1575 00000100:00100000:3.0:1787857909.663669:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.663863:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171870720 00000100:00100000:2.0:1787857909.663879:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171870720 00000100:00100000:2.0:1787857909.663969:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1576 00000100:00100000:2.0:1787857909.663994:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33528:x1874704171870720:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857909.664026:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.664059:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e880 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd46a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.664566:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.664593:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 112 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.664605:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.664662:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 112 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.664682:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 112 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.664702:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188303360:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857909.665034:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.670246:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.671198:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171870848 00000100:00100000:2.0:1787857909.671221:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171870848 00000100:00100000:3.0:1787857909.673511:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188303360:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857909.673561:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.674282:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 113 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.674528:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 456 00000100:00100000:2.0:1787857909.674553:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+113:2349:x1874704171870848:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857909.674584:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857909.674596:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 113 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.674612:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 113 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.674648:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7e7f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd466a expref: 113 pid: 19301 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.674685:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.674693:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.674706:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.674717:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.674752:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857909.675436:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.675448:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.675482:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.675495:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.675504:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.676609:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+112:2349:x1874704171870848:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2055us (6367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857909.676630:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 456 00000004:00080000:3.0:1787857909.685475:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:3.0:1787857909.686037:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686070:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686093:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686164:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686173:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686258:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686267:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.686271:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686280:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686298:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.686301:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.686307:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686314:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7e887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857909.686332:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a11ca79 reply state 000000009c7be1dc transno 4294968361 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.686343:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857909.686404:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7e880 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 73 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686428:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 72 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.686436:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:3.0:1787857909.686438:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857909.686440:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71600, rc 0) 00000100:00100000:3.0:1787857909.686620:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+73:33528:x1874704171870720:12345-192.168.204.36@tcp:101:cp.0 Request processed in 22628us (22970us total) trans 4294968361 rc 0/0 00000100:00100000:3.0:1787857909.686632:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1576 00010000:00010000:1.0:1787857909.692530:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.692559:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.692569:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.692578:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.692584:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.692594:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.692620:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9998d12efb00) 00010000:00010000:1.0:1787857909.692623:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.692630:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.692637:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e88e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.700461:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.702042:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171870976 00000100:00100000:0.0:1787857909.702059:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171870976 00000100:00100000:0.0:1787857909.702141:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 442 00000100:00100000:0.0:1787857909.702152:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171870976:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857909.702178:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.702211:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd46a9 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857909.702251:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857909.702289:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1787857909.702295:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857909.702310:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.702336:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 13 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.702356:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6200, rc 0) 00000100:00100000:0.0:1787857909.702475:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171870976:12345-192.168.204.36@tcp:101:cp.0 Request processed in 323us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.702483:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 442 00000100:00100000:3.0:1787857909.708097:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.708250:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171871104 00000100:00100000:0.0:1787857909.708263:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171871104 00000100:00100000:0.0:1787857909.708367:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 443 00000100:00100000:0.0:1787857909.708382:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:33528:x1874704171871104:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857909.708415:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.708446:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd46b0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.708501:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 14 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.708514:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857909.708519:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857909.708526:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 14 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.708589:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 14 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.708608:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 14 pid: 6711 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.708626:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b42d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188303488:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857909.709047:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b000 going to sleep for 11 seconds 00000001:00080000:2.0:1787857909.710220:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968353 is committed 00000001:00080000:2.0:1787857909.710582:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968360 is committed 00000001:00080000:2.0:1787857909.710631:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968345 is committed 00000020:00080000:2.0:1787857909.710660:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 35 batchid updated 00000020:00080000:3.0:1787857909.710785:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 35 00000020:00080000:3.0:1787857909.710803:0:5891:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 35 00000100:00100000:1.0:1787857909.714012:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.714180:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171871232 00000100:00100000:3.0:1787857909.714194:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171871232 00010000:00010000:3.0:1787857909.714250:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 15 pid: 6711 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.714313:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 457 00000100:00100000:3.0:1787857909.714325:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171871232:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857909.714353:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857909.714384:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 15 pid: 6711 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.714399:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 15 pid: 6711 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.714443:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.714449:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.714460:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 15 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.714473:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 15 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.714533:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 15 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.714554:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb2940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874704188303616:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857909.714693:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84540 going to sleep for 11 seconds 00010000:00010000:0.0:1787857909.714898:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7e8a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a9 expref: 15 pid: 6711 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.714916:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b42d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188303488:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857909.714947:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 14 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.714958:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7200, rc 0) 00000100:00100000:0.0:1787857909.715001:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:33528:x1874704171871104:12345-192.168.204.36@tcp:101:cp.0 Request processed in 6623us (7182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.715010:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 443 00000100:00100000:0.0:1787857909.723344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.723556:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb2940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5841:1874704188303616:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857909.723595:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857909.723701:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171871232:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 9376us (9709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.723717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 457 00000100:00100000:2.0:1787857909.725303:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171871488 00000100:00100000:2.0:1787857909.725322:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171871488 00000100:00100000:2.0:1787857909.725410:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 335 00000100:00100000:2.0:1787857909.725423:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:33528:x1874704171871488:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:3.0:1787857909.728590:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33528:x1874704171871488:12345-192.168.204.36@tcp:35:cp.0 Request processed in 3145us (5237us total) trans 4294968362 rc 0/0 00000100:00100000:3.0:1787857909.728614:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 335 00000100:00100000:0.0:1787857909.762278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.766519:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171871616 00000100:00100000:3.0:1787857909.766541:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171871616 00000100:00100000:3.0:1787857909.766640:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:3.0:1787857909.766653:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:2348:x1874704171871616:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:3.0:1787857909.766721:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.766751:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e8b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd46b7 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.766892:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.766910:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.766924:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.766942:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.766949:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.766955:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767067:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767075:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767082:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767093:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.767103:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767111:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767126:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.767129:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.767136:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767142:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e8b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767156:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767161:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767166:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767171:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.767174:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767180:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767190:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x36fdbbdd (ffff9998d12ef700) 00010000:00010000:3.0:1787857909.767192:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.767194:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767200:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e8bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767235:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e8b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b7 expref: 59 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767245:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.767247:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857909.767250:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e8b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b7 expref: 59 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.767259:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc -2) 00000100:00100000:3.0:1787857909.767380:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:2348:x1874704171871616:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 727us (5120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857909.767391:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:2.0:1787857909.775282:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.775641:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171871744 00000100:00100000:0.0:1787857909.775657:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171871744 00000100:00100000:0.0:1787857909.775790:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1577 00000100:00100000:0.0:1787857909.775806:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:33531:x1874704171871744:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857909.775888:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.775922:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e8c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd46be expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776027:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776046:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776060:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776077:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776084:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776091:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776243:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7e00/0xd3f183cab4a7e8db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776252:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7e00/0xd3f183cab4a7e8db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776260:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7e00/0xd3f183cab4a7e8db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857909.776333:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x32:0x0]: returning size 158 00000004:00200000:0.0:1787857909.776339:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857909.776365:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7e00/0xd3f183cab4a7e8db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776380:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7e00/0xd3f183cab4a7e8db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776391:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776398:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776406:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776413:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.776419:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776428:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776442:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.776445:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.776450:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776457:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e8cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776477:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776485:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776491:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776497:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.776499:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776505:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776512:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9997c3d03f00) 00010000:00010000:0.0:1787857909.776514:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.776516:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776522:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e8d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776558:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e8c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46be expref: 113 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776573:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7e00/0xd3f183cab4a7e8db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46be expref: 112 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.776586:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:0.0:1787857909.776589:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857909.776591:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7e00, rc 0) 00000100:00100000:0.0:1787857909.776666:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+112:33531:x1874704171871744:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 864us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.776675:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1577 00000100:00100000:1.0:1787857909.781086:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.781141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.781636:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171871872 00000100:00100000:3.0:1787857909.781652:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171871872 00000100:00100000:3.0:1787857909.781749:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 444 00000100:00100000:3.0:1787857909.781763:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171871872:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857909.781796:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.781861:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e8e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd46c5 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.781964:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dabb2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188303744:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857909.782097:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.782351:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171872000 00000100:00100000:2.0:1787857909.782359:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171872000 00000100:00100000:2.0:1787857909.782480:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:2.0:1787857909.782492:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+112:2347:x1874704171872000:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:2.0:1787857909.782559:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.782579:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e8e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd46cc expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.782658:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.782678:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.782694:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.782712:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.782719:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.782726:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783372:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783388:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783397:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783534:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.783541:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783552:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783570:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.783573:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.783580:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783588:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7e8f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783611:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783618:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783624:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783630:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.783633:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783638:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783645:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9998c3379d00) 00010000:00010000:0.0:1787857909.783648:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.783650:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.783656:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7e8f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.784060:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e8e9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46cc expref: 113 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.784076:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.784079:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857909.784083:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7e8e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46cc expref: 113 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.784097:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7800, rc -2) 00000100:00100000:0.0:1787857909.784205:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+112:2347:x1874704171872000:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 1714us (3060us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857909.784217:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 81 00002000:00010000:3.0:1787857909.789197:0:8490:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787857909.789215:0:8490:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb mtime: 0 -> 1787857909 00002000:00010000:3.0:1787857909.789218:0:8490:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb atime: 0 -> 1787857909 00002000:00010000:3.0:1787857909.789221:0:8490:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb ctime: 0 -> 1787857909 00000100:00100000:3.0:1787857909.789262:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dabb2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188303744:192.168.204.36@tcp:106: 00010000:00010000:3.0:1787857909.789475:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e8e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46c5 expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.789511:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e8e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46c5 expref: 17 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.789531:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:3.0:1787857909.789628:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171871872:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 7867us (8557us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857909.789640:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 444 00000100:00100000:1.0:1787857909.798556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.799253:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171872128 00000100:00100000:2.0:1787857909.799269:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171872128 00000100:00100000:2.0:1787857909.799379:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1578 00000100:00100000:2.0:1787857909.799395:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+112:33531:x1874704171872128:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857909.799434:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.799481:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7e8fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4704 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.799625:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.799651:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.799667:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857909.799772:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:2.0:1787857909.799777:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857909.799810:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.799879:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7e8fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 114 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.799903:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 113 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.799913:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.799916:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857909.799921:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6200, rc 0) 00000100:00100000:2.0:1787857909.800035:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+113:33531:x1874704171872128:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 644us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857909.800044:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1578 00000100:00100000:1.0:1787857909.805026:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.805143:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171872256 00000100:00100000:2.0:1787857909.805158:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171872256 00000100:00100000:2.0:1787857909.805268:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 445 00000100:00100000:2.0:1787857909.805288:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171872256:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857909.805317:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.805345:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029c6e56c/0xd3f183cab4a7e90c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd470b expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.805431:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188303872:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857909.805570:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.810468:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188303872:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857909.810539:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029c6e56c/0xd3f183cab4a7e90c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd470b expref: 17 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.810577:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029c6e56c/0xd3f183cab4a7e90c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd470b expref: 17 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.810597:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7c00, rc 0) 00000100:00100000:2.0:1787857909.810708:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171872256:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5426us (5695us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857909.810721:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 445 00000100:00100000:1.0:1787857909.823341:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.823527:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171872512 00000100:00100000:3.0:1787857909.823547:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171872512 00000100:00100000:3.0:1787857909.823651:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1579 00000100:00100000:3.0:1787857909.823664:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:33531:x1874704171872512:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857909.825668:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].49, 136 off14856 00000100:00100000:0.0:1787857909.826629:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:33531:x1874704171872512:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 2951us (3295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.826649:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1579 00000100:00100000:1.0:1787857909.848931:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.849068:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171872640 00000100:00100000:0.0:1787857909.849084:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171872640 00000100:00100000:0.0:1787857909.849176:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1580 00000100:00100000:0.0:1787857909.849190:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+113:33534:x1874704171872640:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857909.849227:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.849266:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e913 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4712 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849605:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849626:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849643:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849666:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849675:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849683:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849789:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849797:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849805:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849814:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.849947:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849959:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.849989:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.849993:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.850002:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850010:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e91a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850030:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850038:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850044:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850049:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.850052:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850057:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850065:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9997c3d03f00) 00010000:00010000:0.0:1787857909.850067:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.850070:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850077:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850134:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e913 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4712 expref: 114 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850148:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.850151:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.850155:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7e913 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4712 expref: 114 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.850172:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6200, rc 0) 00000100:00100000:2.0:1787857909.852288:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.852762:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171872768 00000100:00100000:3.0:1787857909.852776:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171872768 00000100:00100000:3.0:1787857909.852911:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:3.0:1787857909.852926:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+114:2348:x1874704171872768:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:3.0:1787857909.853002:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.853034:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4719 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853122:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853139:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853154:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853172:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853180:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853187:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853794:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853804:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853813:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853862:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.853867:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853876:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853894:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.853898:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.853904:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853911:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e92f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853931:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853937:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853944:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853950:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.853953:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853959:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853983:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x4b66ad81 (ffff9998d12ef700) 00010000:00010000:3.0:1787857909.853985:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.853988:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.853995:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.854046:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e928 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4719 expref: 115 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.854058:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.854061:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857909.854064:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4719 expref: 115 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.854074:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc -2) 00000100:00100000:3.0:1787857909.854181:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+114:2348:x1874704171872768:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 1258us (1913us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857909.854193:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:1.0:1787857909.854379:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+113:33534:x1874704171872640:12345-192.168.204.36@tcp:101:bash.0 Request processed in 5189us (5468us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857909.854389:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1580 00000100:00100000:2.0:1787857909.877780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.878008:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171872896 00000100:00100000:1.0:1787857909.878024:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171872896 00000100:00100000:1.0:1787857909.878111:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1581 00000100:00100000:1.0:1787857909.878123:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33535:x1874704171872896:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:1.0:1787857909.878153:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.878188:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7e93d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4720 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878308:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878330:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878344:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878369:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878377:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878384:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878495:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878504:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878512:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878518:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.878523:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878532:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878546:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.878549:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.878556:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878562:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878580:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878586:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878591:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878597:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.878600:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878607:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878614:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9998d34a6a00) 00010000:00010000:1.0:1787857909.878617:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.878620:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878626:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e94b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878925:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7e93d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4720 expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878941:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.878944:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.878949:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7e93d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4720 expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.878964:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaec400, rc 0) 00000100:00100000:1.0:1787857909.879068:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33535:x1874704171872896:12345-192.168.204.36@tcp:101:rm.0 Request processed in 946us (1304us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857909.879078:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1581 00000100:00100000:3.0:1787857909.883912:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857909.884325:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171873024 00000100:00100000:0.0:1787857909.884343:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171873024 00000100:00100000:0.0:1787857909.884436:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1582 00000100:00100000:0.0:1787857909.884449:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33535:x1874704171873024:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857909.884495:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857909.884527:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4727 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884639:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884662:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884688:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884709:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884719:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884726:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884878:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884891:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884899:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884906:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.884912:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884921:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884937:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.884940:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.884947:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884954:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7e959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884980:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884986:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884991:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.884996:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857909.885000:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.885005:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.885012:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9997c3d03f00) 00010000:00010000:0.0:1787857909.885015:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.885017:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.885022:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.885061:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e952 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4727 expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.885072:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.885075:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857909.885078:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4727 expref: 59 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.885088:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6600, rc 0) 00000100:00100000:0.0:1787857909.885176:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33535:x1874704171873024:12345-192.168.204.36@tcp:101:rm.0 Request processed in 729us (1288us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857909.885185:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1582 00000100:00100000:0.0:1787857909.913934:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857909.914250:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171873152 00000100:00100000:1.0:1787857909.914276:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171873152 00000100:00100000:1.0:1787857909.914395:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1583 00000100:00100000:1.0:1787857909.914796:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33536:x1874704171873152:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857909.914881:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857909.914923:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7e967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd472e expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915042:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915064:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915083:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915107:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915115:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915122:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915219:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915228:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915236:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915243:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.915249:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915258:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.915276:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.915279:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.915286:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916228:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e96e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916260:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916278:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916285:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916531:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.916536:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916544:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916564:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9998d34a6a00) 00010000:00010000:1.0:1787857909.916568:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.916572:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916579:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7e975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916651:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7e967 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd472e expref: 59 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916664:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857909.916667:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.916797:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7e967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd472e expref: 59 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.916810:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaec400, rc 0) 00000100:00100000:1.0:1787857909.917112:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33536:x1874704171873152:12345-192.168.204.36@tcp:101:cp.0 Request processed in 2705us (3203us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857909.917127:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1583 00000100:00100000:2.0:1787857909.924708:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.924860:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171873280 00000100:00100000:3.0:1787857909.924875:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171873280 00000100:00100000:3.0:1787857909.924966:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1584 00000100:00100000:3.0:1787857909.924992:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33536:x1874704171873280:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.925028:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.925064:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e97c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4735 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925177:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925197:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925216:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925237:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925244:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925251:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925349:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925356:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925363:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925370:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.925376:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925391:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925405:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.925408:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.925413:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925420:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7e983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925447:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925454:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925461:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925599:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857909.925602:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925609:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925617:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9998d12ef700) 00010000:00010000:3.0:1787857909.925620:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.925623:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925635:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7e98a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925676:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e97c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4735 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925687:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857909.925689:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857909.925693:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7e97c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4735 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.925702:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:3.0:1787857909.925793:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33536:x1874704171873280:12345-192.168.204.36@tcp:101:cp.0 Request processed in 804us (1102us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857909.925803:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1584 00000100:00100000:0.0:1787857909.931343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.931576:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171873536 00000100:00100000:3.0:1787857909.931592:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171873536 00000100:00100000:3.0:1787857909.931688:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1585 00000100:00100000:3.0:1787857909.931702:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:33536:x1874704171873536:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.931735:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.931765:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e991 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd473c expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.932073:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.932093:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 112 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.932107:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.932156:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 112 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.932172:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 112 pid: 5856 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.932189:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188304000:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857909.932318:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857909.937758:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188304000:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857909.937812:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.941629:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.944111:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171873664 00000100:00100000:2.0:1787857909.944132:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171873664 00010000:00010000:2.0:1787857909.944208:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 113 pid: 5856 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.944920:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 458 00000100:00100000:0.0:1787857909.944943:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+113:2350:x1874704171873664:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857909.944966:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857909.944990:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 113 pid: 5856 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.945010:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 113 pid: 5856 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.945044:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7e905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4704 expref: 113 pid: 5856 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.945072:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857909.945080:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.945094:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.945105:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857909.945215:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857909.945330:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+112:2350:x1874704171873664:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 396us (3725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857909.945341:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 458 00010000:00010000:3.0:1787857909.951125:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.951155:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.951796:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.951864:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.951883:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857909.953879:0:19301:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787857909.954180:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954202:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954218:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954271:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954278:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954286:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954293:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857909.954298:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954307:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954323:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857909.954325:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857909.954331:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954337:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7e998 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857909.954353:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4b33c32 reply state 00000000f3cbd418 transno 4294968363 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857909.954364:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857909.954414:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7e991 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 61 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954432:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 60 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.954440:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:2.0:1787857909.954443:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857909.954445:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7200, rc 0) 00000100:00100000:2.0:1787857909.954559:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33536:x1874704171873536:12345-192.168.204.36@tcp:101:cp.0 Request processed in 22860us (23231us total) trans 4294968363 rc 0/0 00000100:00100000:2.0:1787857909.954570:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1585 00010000:00010000:1.0:1787857909.960635:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.960678:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.960689:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.960697:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857909.960704:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.960714:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.960740:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9998c3379c00) 00010000:00010000:1.0:1787857909.960745:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857909.960752:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.960760:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7e99f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857909.961101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857909.961191:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171873792 00000100:00100000:2.0:1787857909.961214:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171873792 00000100:00100000:2.0:1787857909.961366:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 446 00000100:00100000:2.0:1787857909.961484:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171873792:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857909.961511:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857909.961544:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4743 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857909.961579:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857909.961608:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1787857909.961612:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857909.961622:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 15 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.961645:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 15 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857909.961659:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6400, rc 0) 00000100:00100000:1.0:1787857909.965412:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2349:x1874704171873792:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3995us (4282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.965523:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 446 00000100:00100000:0.0:1787857909.971122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.971297:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171873920 00000100:00100000:3.0:1787857909.971314:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171873920 00000100:00100000:3.0:1787857909.971483:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 447 00000100:00100000:3.0:1787857909.971500:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:33536:x1874704171873920:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857909.971536:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857909.971568:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd474a expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.971622:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 16 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.971636:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.971643:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857909.971650:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 16 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.971721:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 16 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.971741:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 16 pid: 14028 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857909.971761:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188304128:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857909.971959:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.978752:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.978988:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188304128:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857909.979047:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 16 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857909.979085:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70400, rc 0) 00000100:00100000:3.0:1787857909.979190:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:33536:x1874704171873920:12345-192.168.204.36@tcp:101:cp.0 Request processed in 7695us (8090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857909.979206:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 447 00000100:00100000:1.0:1787857909.979357:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171874048 00000100:00100000:1.0:1787857909.979368:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171874048 00010000:00010000:1.0:1787857909.979556:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 16 pid: 14028 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.979613:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 459 00000100:00100000:1.0:1787857909.979623:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2350:x1874704171874048:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857909.979646:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857909.979807:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 16 pid: 14028 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.979877:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 16 pid: 14028 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.979917:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7e9b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4743 expref: 16 pid: 14028 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.979940:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857909.979946:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857909.979959:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.979983:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857909.980039:0:17347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857909.980061:0:17347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17347:1874704188304256:192.168.204.36@tcp:105: 00000100:00100000:1.0:1787857909.980167:0:17347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857909.993061:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857909.993878:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171874304 00000100:00100000:3.0:1787857909.993897:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171874304 00000100:00100000:3.0:1787857909.994001:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 336 00000100:00100000:3.0:1787857909.994016:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+60:33536:x1874704171874304:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:3.0:1787857909.995608:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33536:x1874704171874304:12345-192.168.204.36@tcp:35:cp.0 Request processed in 1578us (2547us total) trans 4294968364 rc 0/0 00000100:00100000:3.0:1787857909.995626:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 336 00000100:00100000:1.0:1787857909.996050:0:17347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17347:1874704188304256:192.168.204.36@tcp:105: 00010000:00010000:1.0:1787857909.996082:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857909.996118:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171874048:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 16496us (17384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857909.996129:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 459 00000100:00100000:0.0:1787857910.045998:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.046191:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171874432 00000100:00100000:1.0:1787857910.046206:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171874432 00000100:00100000:1.0:1787857910.046350:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1586 00000100:00100000:1.0:1787857910.046367:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+112:33539:x1874704171874432:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857910.046415:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.046448:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e9c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4751 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046594:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046616:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046632:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046652:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046660:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046688:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046904:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e9d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046914:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.046923:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857910.046991:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x33:0x0]: returning size 158 00000004:00200000:1.0:1787857910.046999:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857910.047032:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047052:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047062:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047069:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047077:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047085:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaecc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857910.047090:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047102:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047121:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857910.047125:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857910.047131:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047139:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7e9c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047159:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047166:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047173:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047178:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857910.047181:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047188:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047196:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9998d34a6a00) 00010000:00010000:1.0:1787857910.047199:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857910.047201:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047211:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7e9d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047256:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7e9c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4751 expref: 114 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047273:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4751 expref: 113 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.047283:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:1.0:1787857910.047285:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857910.047288:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaed200, rc 0) 00000100:00100000:1.0:1787857910.047388:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+113:33539:x1874704171874432:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1026us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.047398:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1586 00000100:00080000:3.0:1787857910.048324:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857910.054044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.054754:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171874560 00000100:00100000:2.0:1787857910.054774:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171874560 00000100:00100000:2.0:1787857910.054947:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 448 00000100:00100000:2.0:1787857910.054975:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171874560:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857910.055012:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.055047:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7e9de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4758 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.055169:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa81e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188304384:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857910.055639:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65f00 going to sleep for 11 seconds 00000100:00080000:3.0:1787857910.056532:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1787857910.064346:0:6713:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787857910.064359:0:6713:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime: 0 -> 1787857909 00002000:00010000:1.0:1787857910.064362:0:6713:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime: 0 -> 1787857909 00002000:00010000:1.0:1787857910.064365:0:6713:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime: 0 -> 1787857909 00000100:00100000:1.0:1787857910.064428:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa81e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188304384:192.168.204.36@tcp:106: 00010000:00010000:1.0:1787857910.064493:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7e9de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4758 expref: 19 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.064532:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7e9de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4758 expref: 19 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.064557:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7e00, rc 0) 00000100:00100000:1.0:1787857910.064650:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171874560:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 9691us (10627us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857910.064661:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 448 00000100:00100000:2.0:1787857910.069926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.070104:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171874688 00000100:00100000:0.0:1787857910.070121:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171874688 00000100:00100000:0.0:1787857910.070204:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1587 00000100:00100000:0.0:1787857910.070215:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+113:33539:x1874704171874688:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857910.070243:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.070272:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e9e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd475f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.070385:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.070412:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.070428:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857910.070534:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:0.0:1787857910.070539:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857910.070570:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.070604:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e9e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 115 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.070629:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 114 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.070639:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.070643:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857910.070649:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6600, rc 0) 00000100:00100000:0.0:1787857910.070757:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+114:33539:x1874704171874688:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 541us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.070765:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1587 00000100:00100000:0.0:1787857910.074717:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.075177:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171874816 00000100:00100000:1.0:1787857910.075194:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171874816 00000100:00100000:1.0:1787857910.075594:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:1.0:1787857910.075610:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171874816:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857910.075643:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.075775:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a342ae43/0xd3f183cab4a7e9f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4766 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.075977:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188304512:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857910.076165:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857910.080867:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188304512:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857910.080928:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a342ae43/0xd3f183cab4a7e9f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4766 expref: 19 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.080977:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a342ae43/0xd3f183cab4a7e9f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4766 expref: 19 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.080997:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaec200, rc 0) 00000100:00100000:0.0:1787857910.081134:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171874816:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5528us (6436us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.081149:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 449 00000100:00100000:2.0:1787857910.087758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.087957:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171875072 00000100:00100000:0.0:1787857910.087985:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171875072 00000100:00100000:1.0:1787857910.088563:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1588 00000100:00100000:1.0:1787857910.088585:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+114:33539:x1874704171875072:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:0.0:1787857910.090643:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].50, 136 off14992 00000100:00100000:0.0:1787857910.091288:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+114:33539:x1874704171875072:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 2700us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.091500:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1588 00000100:00100000:1.0:1787857910.101187:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.101538:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171875200 00000100:00100000:0.0:1787857910.101557:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171875200 00000100:00100000:0.0:1787857910.101756:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1589 00000100:00100000:0.0:1787857910.101771:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+114:33540:x1874704171875200:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857910.101845:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.101883:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e9fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd476d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102068:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102090:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102107:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102128:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102135:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102143:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102238:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102248:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102255:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102548:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.102558:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102570:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102589:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.102593:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.102602:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102611:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102635:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102642:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102649:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102654:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.102658:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102718:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102727:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff9997c3d03f00) 00010000:00010000:0.0:1787857910.102730:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.102735:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102742:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102801:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e9fa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd476d expref: 115 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102920:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.102923:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.102928:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7e9fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd476d expref: 115 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.102941:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6000, rc 0) 00000100:00100000:0.0:1787857910.103084:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+114:33540:x1874704171875200:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1315us (1919us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.103095:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1589 00000100:00100000:1.0:1787857910.118133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.118305:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171875328 00000100:00100000:2.0:1787857910.118320:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171875328 00000100:00100000:2.0:1787857910.118591:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1590 00000100:00100000:2.0:1787857910.118608:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33541:x1874704171875328:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857910.118655:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.118695:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ea0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4774 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119207:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119231:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119250:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119275:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119284:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119313:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119503:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119513:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119521:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119529:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.119535:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119543:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119561:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.119564:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.119570:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119576:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7ea16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119594:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119599:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119605:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119611:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.119614:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119620:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119627:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff9998c4eb6200) 00010000:00010000:2.0:1787857910.119630:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.119633:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119639:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119691:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ea0f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4774 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119704:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.119706:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.119710:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ea0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4774 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.119720:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7600, rc 0) 00000100:00100000:2.0:1787857910.119878:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33541:x1874704171875328:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1274us (1768us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857910.119888:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1590 00000100:00080000:3.0:1787857910.120074:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857910.125244:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.129977:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171875456 00000100:00100000:0.0:1787857910.130005:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171875456 00000100:00100000:0.0:1787857910.130800:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1591 00000100:00100000:0.0:1787857910.130843:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33541:x1874704171875456:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857910.130882:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.130919:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7ea24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd477b expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131046:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131076:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131092:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131111:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131118:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131124:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131236:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131245:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131253:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131270:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.131276:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.131287:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132000:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.132004:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.132012:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132020:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132034:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132039:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132046:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132051:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.132054:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132060:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132068:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff9997c3d03b00) 00010000:00010000:0.0:1787857910.132071:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.132074:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132079:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132139:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7ea24 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd477b expref: 62 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132153:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.132156:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.132160:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7ea24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd477b expref: 62 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.132170:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6000, rc 0) 00000100:00100000:0.0:1787857910.132271:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33541:x1874704171875456:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1456us (7049us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.132280:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1591 00000100:00100000:1.0:1787857910.161078:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.162658:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171875584 00000100:00100000:0.0:1787857910.162843:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171875584 00000100:00100000:0.0:1787857910.162954:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1592 00000100:00100000:0.0:1787857910.162980:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33542:x1874704171875584:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857910.163012:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.163046:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7ea39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4782 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.163155:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.163173:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.163189:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.163208:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.163217:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.163224:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167453:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167485:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167496:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167504:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.167511:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167521:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167548:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.167552:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.167561:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167569:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167588:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167595:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167601:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167605:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.167607:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167612:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167619:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff9997c3d03b00) 00010000:00010000:0.0:1787857910.167622:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.167625:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167630:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ea47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167716:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7ea39 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4782 expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167728:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.167730:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.167734:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7ea39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4782 expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.167761:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6000, rc 0) 00000100:00100000:0.0:1787857910.167975:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33542:x1874704171875584:12345-192.168.204.36@tcp:101:cp.0 Request processed in 4998us (6911us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.167988:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1592 00000100:00100000:0.0:1787857910.177074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.177171:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171875712 00000100:00100000:3.0:1787857910.177186:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171875712 00000100:00100000:3.0:1787857910.177267:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1593 00000100:00100000:3.0:1787857910.177280:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33542:x1874704171875712:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857910.177317:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.177350:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7ea4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4789 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177473:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177494:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177512:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177534:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177542:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177549:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177643:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177651:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177660:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177667:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.177672:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177681:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177698:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.177701:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.177707:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177715:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7ea55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177734:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177741:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177747:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177930:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.177934:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177940:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177949:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff9998d12ef700) 00010000:00010000:3.0:1787857910.177952:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.177955:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.177961:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ea5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.178020:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7ea4e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4789 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.178033:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.178036:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.178040:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7ea4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4789 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.178050:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:3.0:1787857910.180858:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33542:x1874704171875712:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3540us (3762us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857910.180876:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1593 00000100:00100000:0.0:1787857910.186168:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.186275:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171875968 00000100:00100000:3.0:1787857910.186291:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171875968 00000100:00100000:3.0:1787857910.186383:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1594 00000100:00100000:3.0:1787857910.186395:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+61:33542:x1874704171875968:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857910.186427:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.186459:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ea63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4790 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.186654:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.186685:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 113 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.186695:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.186744:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 113 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.186763:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 113 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.186789:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188304640:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857910.186998:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857910.192625:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.194211:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188304640:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857910.194279:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.195935:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171876096 00000100:00100000:0.0:1787857910.195952:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171876096 00010000:00010000:0.0:1787857910.196045:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 114 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.196091:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 460 00000100:00100000:0.0:1787857910.196102:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+114:2349:x1874704171876096:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857910.196122:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857910.196131:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 114 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.196146:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 114 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.196181:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7e9ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd475f expref: 114 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.196207:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.196214:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.197238:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.197250:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.197299:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857910.197401:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+113:2349:x1874704171876096:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1296us (4791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.197412:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 460 00010000:00010000:0.0:1787857910.197637:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.197646:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.197683:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.197695:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.197702:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857910.198759:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:2.0:1787857910.205138:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205179:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205198:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205797:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205809:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205849:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205858:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.205864:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205876:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205897:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.205901:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.205910:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.205924:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ea6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857910.205945:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007862a91c reply state 00000000f53ea99d transno 4294968365 ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.205958:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857910.206036:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ea63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.206056:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 63 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.206064:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:2.0:1787857910.206066:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857910.206069:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7a00, rc 0) 00000100:00100000:2.0:1787857910.207043:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33542:x1874704171875968:12345-192.168.204.36@tcp:101:cp.0 Request processed in 20641us (20885us total) trans 4294968365 rc 0/0 00000100:00100000:2.0:1787857910.207059:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1594 00000100:00100000:3.0:1787857910.212004:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857910.212691:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.212709:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.212720:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.212729:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857910.212735:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.212744:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.212767:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff9997c3d03400) 00010000:00010000:1.0:1787857910.212771:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857910.212778:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.212785:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6c00/0xd3f183cab4a7ea71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857910.214578:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967391 is committed 00000100:00100000:0.0:1787857910.214882:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171876224 00000100:00100000:0.0:1787857910.214899:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171876224 00000100:00100000:0.0:1787857910.215007:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 450 00000100:00100000:0.0:1787857910.215022:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171876224:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857910.215054:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.215084:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4797 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.215123:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857910.215157:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1787857910.215165:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.215177:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 14 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.215208:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 14 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.215239:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6600, rc 0) 00000100:00100000:0.0:1787857910.215357:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171876224:12345-192.168.204.36@tcp:101:cp.0 Request processed in 340us (3543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.215365:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 450 00000100:00080000:3.0:1787857910.215622:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857910.218539:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.218894:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171876352 00000100:00100000:1.0:1787857910.218912:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171876352 00000100:00100000:1.0:1787857910.219014:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 451 00000100:00100000:1.0:1787857910.219028:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:33542:x1874704171876352:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857910.219060:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.219095:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd479e expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.219150:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 15 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.219166:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857910.219172:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857910.219178:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 15 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.219426:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 15 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.219446:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 15 pid: 8490 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.219468:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188304768:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857910.219743:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295900 going to sleep for 11 seconds 00000100:00100000:1.0:1787857910.223072:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188304768:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857910.223452:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857910.223546:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 15 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.223585:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaed600, rc 0) 00000100:00100000:1.0:1787857910.223679:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:33542:x1874704171876352:12345-192.168.204.36@tcp:101:cp.0 Request processed in 4654us (5156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.223691:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 451 00000100:00100000:2.0:1787857910.224527:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171876480 00000100:00100000:2.0:1787857910.224544:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171876480 00010000:00010000:2.0:1787857910.224608:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 15 pid: 8490 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.224660:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 461 00000100:00100000:2.0:1787857910.224673:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2349:x1874704171876480:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857910.224697:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857910.224759:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 15 pid: 8490 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.224778:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 15 pid: 8490 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.224911:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ea86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4797 expref: 15 pid: 8490 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.224937:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.224943:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.224954:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 14 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.225047:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 14 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.225193:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 14 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.225214:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188304896:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857910.225495:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857910.230541:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.230636:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171876736 00000100:00100000:0.0:1787857910.230648:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171876736 00000100:00100000:3.0:1787857910.230661:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8468:1874704188304896:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857910.230693:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857910.230861:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 337 00000100:00100000:0.0:1787857910.230876:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+63:33542:x1874704171876736:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:3.0:1787857910.230916:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171876480:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 6245us (7466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.230929:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 461 00000100:00100000:0.0:1787857910.231555:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33542:x1874704171876736:12345-192.168.204.36@tcp:35:cp.0 Request processed in 681us (1037us total) trans 4294968366 rc 0/0 00000100:00100000:0.0:1787857910.231563:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 337 00000040:00080000:2.0:1787857910.254487:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857910.254505:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857910.254582:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 50 count 9 00000040:00080000:2.0:1787857910.254591:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 2 00000100:00100000:2.0:1787857910.255303:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa81e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188305024:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857910.262730:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2f50540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857910.264747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.264892:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171876864 00000100:00100000:0.0:1787857910.264915:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171876864 00000100:00100000:0.0:1787857910.265032:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1595 00000100:00100000:0.0:1787857910.265050:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+113:33545:x1874704171876864:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857910.265090:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.265125:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd47a5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265247:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265270:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265288:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265327:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265336:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265343:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265664:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7eaa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265673:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7eaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265681:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7eaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857910.265737:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x34:0x0]: returning size 158 00000004:00200000:0.0:1787857910.265743:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857910.265769:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7eaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265785:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7eaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265793:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265800:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.265808:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266018:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.266026:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266037:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266054:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.266058:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.266063:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266070:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ea9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266094:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266100:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266107:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266113:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.266116:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266123:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266130:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff9997c3d03400) 00010000:00010000:0.0:1787857910.266133:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.266136:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266141:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eaa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266189:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ea94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47a5 expref: 115 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266206:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7eaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47a5 expref: 114 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.266222:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:0.0:1787857910.266224:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857910.266227:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6800, rc 0) 00000100:00100000:0.0:1787857910.268937:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+114:33545:x1874704171876864:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3869us (4192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.268970:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1595 00000100:00100000:3.0:1787857910.275801:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.275863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.275898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.275931:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171877120 00000100:00100000:2.0:1787857910.275931:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171876992 00000100:00100000:2.0:1787857910.275943:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171876992 00000100:00100000:3.0:1787857910.275944:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171877120 00000100:00100000:2.0:1787857910.276036:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171877248 00000100:00100000:2.0:1787857910.276040:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171877248 00000100:00100000:1.0:1787857910.276060:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1596 00000100:00100000:1.0:1787857910.276078:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33548:x1874704171876992:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857910.276141:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857910.276144:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa81e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188305024:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857910.276295:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33548:x1874704171876992:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 223us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.276305:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1596 00000100:00100000:3.0:1787857910.276361:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1597 00000100:00100000:3.0:1787857910.276371:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33547:x1874704171877120:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857910.276393:0:5857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x31:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857910.276457:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33547:x1874704171877120:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 88us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.278348:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1597 00000100:00100000:2.0:1787857910.283158:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1598 00000100:00100000:2.0:1787857910.283210:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33546:x1874704171877248:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857910.283284:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x30:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857910.283505:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33546:x1874704171877248:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 325us (7604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.283516:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1598 00000100:00100000:2.0:1787857910.286090:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.287115:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171877376 00000100:00100000:0.0:1787857910.287205:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171877376 00000100:00100000:0.0:1787857910.287662:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 452 00000100:00100000:0.0:1787857910.287689:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171877376:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857910.287731:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.287951:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7eab0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd47ac expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.288072:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa81e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188305152:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857910.288351:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857910.288596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00080000:3.0:1787857910.289291:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857910.289596:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171877632 00000100:00100000:0.0:1787857910.289610:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171877632 00000100:00100000:0.0:1787857910.289919:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1599 00000100:00100000:0.0:1787857910.289933:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+64:33547:x1874704171877632:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.289976:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.290008:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eab7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd47b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.291318:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eabe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.291369:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eabe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.291388:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eabe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857910.291410:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 158 00010000:00010000:0.0:1787857910.291693:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7eab7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47b3 expref: 67 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.291726:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eabe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47b3 expref: 66 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.291738:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:0.0:1787857910.291742:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857910.291747:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6400, rc 0) 00000100:00100000:1.0:1787857910.293184:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00002000:00010000:2.0:1787857910.293293:0:14028:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857910.293300:0:14028:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb mtime: 0 -> 1787857909 00002000:00010000:2.0:1787857910.293303:0:14028:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb atime: 0 -> 1787857909 00002000:00010000:2.0:1787857910.293306:0:14028:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb ctime: 0 -> 1787857909 00000100:00100000:2.0:1787857910.293334:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa81e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188305152:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857910.293393:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7eab0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47ac expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.293423:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000761227d8/0xd3f183cab4a7eab0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47ac expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.293438:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6200, rc 0) 00000100:00100000:0.0:1787857910.293852:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33547:x1874704171877632:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3818us (5154us total) trans 4294968367 rc 0/0 00000100:00100000:0.0:1787857910.293867:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1599 00000100:00100000:0.0:1787857910.293921:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171877888 00000100:00100000:0.0:1787857910.293929:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171877888 00000100:00100000:0.0:1787857910.294014:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1600 00000100:00100000:0.0:1787857910.294027:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+66:33548:x1874704171877888:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.294054:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.294082:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7eacc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd47ba expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.294727:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ead3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.294986:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ead3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.295005:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ead3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857910.295025:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x32:0x0]: returning size 158 00010000:00010000:0.0:1787857910.295373:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7eacc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47ba expref: 69 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.295398:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ead3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47ba expref: 68 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.295408:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:0.0:1787857910.295411:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857910.295415:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7a00, rc 0) 00000100:00100000:2.0:1787857910.299110:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171877376:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 11401us (13015us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857910.299117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.299145:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 452 00000100:00100000:1.0:1787857910.299184:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.299230:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171878016 00000100:00100000:1.0:1787857910.299244:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171878016 00000100:00100000:1.0:1787857910.299335:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:1.0:1787857910.299348:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c71a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+114:2347:x1874704171878016:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:1.0:1787857910.299451:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.299486:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7eae1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd47c1 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299591:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299613:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299630:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299654:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299661:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299670:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299786:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299795:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299803:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299809:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaede00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857910.299848:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299858:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.299874:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171878272 00010000:00010000:1.0:1787857910.299874:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857910.299878:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787857910.299880:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171878272 00010000:00010000:1.0:1787857910.299885:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299892:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299907:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.299910:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1601 00010000:00010000:1.0:1787857910.299914:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.299917:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33546:x1874704171878272:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857910.299922:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299927:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.299929:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.299929:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299936:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.299941:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7eaf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd47f9 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299943:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9998d1291200) 00010000:00010000:1.0:1787857910.299945:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857910.299949:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.299954:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eaef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.300001:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7eae1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47c1 expref: 115 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.300015:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857910.300018:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857910.300022:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7eae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47c1 expref: 115 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.300031:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaece00, rc -2) 00010000:00010000:3.0:1787857910.300075:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eafd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.300087:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eafd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.300095:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eafd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857910.300109:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x30:0x0]: returning size 158 00000100:00100000:1.0:1787857910.300111:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c71a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+114:2347:x1874704171878016:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 766us (995us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857910.300121:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 83 00010000:00010000:3.0:1787857910.300844:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71800/0xd3f183cab4a7eaf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47f9 expref: 72 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.300872:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eafd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47f9 expref: 71 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.300887:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:3.0:1787857910.300890:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857910.300894:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70800, rc 0) 00000100:00100000:3.0:1787857910.300953:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+71:33546:x1874704171878272:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1035us (1766us total) trans 4294968369 rc 0/0 00000100:00100000:3.0:1787857910.300974:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1601 00000100:00100000:0.0:1787857910.301480:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33548:x1874704171877888:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 7449us (8303us total) trans 4294968368 rc 0/0 00000100:00100000:0.0:1787857910.301489:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1600 00000100:00100000:3.0:1787857910.304805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.305537:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171878400 00000100:00100000:0.0:1787857910.305560:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171878400 00000100:00100000:0.0:1787857910.305715:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 453 00000100:00100000:0.0:1787857910.305733:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171878400:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.305846:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.305879:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.305892:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787857910.305898:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857910.305904:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.305987:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 13 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.306008:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 13 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.306033:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa81e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188305280:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857910.306182:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127ba80 going to sleep for 11 seconds 00000100:00080000:3.0:1787857910.306771:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857910.320322:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.320517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.320571:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.320604:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171878656 00000100:00100000:2.0:1787857910.320614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.320620:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171878656 00000100:00100000:2.0:1787857910.320633:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.320654:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.320709:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171879168 00000100:00100000:3.0:1787857910.320713:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171879168 00000100:00100000:2.0:1787857910.320742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.320749:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 454 00000100:00100000:3.0:1787857910.320761:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2349:x1874704171878656:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00000100:00100000:2.0:1787857910.320780:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171879296 00000100:00100000:2.0:1787857910.320784:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171879296 00002000:00100000:2.0:1787857910.320850:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (0->157) req@ffff9998efa6e1c0 x1874704171879296/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787857910.320858:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787857910.320862:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6e1c0 with x1874704171879296 ext(0->157) 00010000:00010000:2.0:1787857910.320872:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 14 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.320885:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 15 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.320889:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 14 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.320896:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f:0x0].0x0 since=1s v=(0 0) 00002000:00010000:2.0:1787857910.320897:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998efa6e1c0 00010000:00010000:3.0:1787857910.320901:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857910.320906:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.320916:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:2.0:1787857910.320922:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171879296:12345-192.168.204.36@tcp:4:cp.0 00010000:00010000:3.0:1787857910.320951:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 15 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.320977:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 15 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.320996:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188305408:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857910.321118:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857910.321145:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 455 00000100:00100000:3.0:1787857910.321152:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171879168:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857910.321170:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.321181:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.321188:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857910.321191:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857910.321194:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.321212:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.321220:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 15 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.321238:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188305536:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857910.321266:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857910.321745:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2350:x1874704171879296:12345-192.168.204.36@tcp:4:cp.0 Request processed in 819us (999us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787857910.321755:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00002000:00100000:2.0:1787857910.321766:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x21:0x0] (0->157) req@ffff9998efa6e1c0 x1874704171879296/t4294967392(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/448 e 0 to 0 dl 1787857921 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857910.321776:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6e1c0 with x1874704171879296 ext(0->157) 00010000:00010000:2.0:1787857910.321783:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 16 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.321951:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171878528 00000100:00100000:1.0:1787857910.321959:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171878528 00000100:00100000:1.0:1787857910.322029:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1602 00000100:00100000:1.0:1787857910.322038:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+114:33545:x1874704171878528:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857910.322054:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.322077:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7eb20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4800 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.322155:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.322171:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.322171:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171878784 00000100:00100000:0.0:1787857910.322176:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171878784 00010000:00010000:1.0:1787857910.322188:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857910.322254:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:1.0:1787857910.322260:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857910.322303:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.322316:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171878912 00000100:00100000:3.0:1787857910.322321:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171878912 00010000:00010000:1.0:1787857910.322342:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7eb20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 116 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.322353:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171879040 00000100:00100000:3.0:1787857910.322357:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171879040 00010000:00010000:1.0:1787857910.322370:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 115 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.322375:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:3.0:1787857910.322381:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+72:2348:x1874704171878784:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857910.322389:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857910.322393:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857910.322396:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857910.322397:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaec000, rc 0) 00010000:00010000:3.0:1787857910.322420:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eafd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47f9 expref: 72 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.322428:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+115:33545:x1874704171878528:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 392us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.322434:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1602 00010000:00010000:3.0:1787857910.322436:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:3.0:1787857910.322439:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857910.322456:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+71:2348:x1874704171878784:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 75us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.322463:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:3.0:1787857910.322477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:3.0:1787857910.322483:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:2348:x1874704171878912:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857910.322492:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857910.322502:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ead3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47ba expref: 70 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.322514:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:3.0:1787857910.322519:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857910.322536:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:2348:x1874704171878912:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 53us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.322543:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:3.0:1787857910.322605:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:3.0:1787857910.322613:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:2348:x1874704171879040:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857910.322620:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857910.322630:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eabe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47b3 expref: 68 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.322643:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:3.0:1787857910.322646:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857910.322664:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:2348:x1874704171879040:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 52us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.322671:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:0.0:1787857910.322812:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa81e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188305280:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857910.322873:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.323042:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 16 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857910.323052:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998efa6e1c0 00000100:00100000:1.0:1787857910.326931:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.327230:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188305408:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857910.327409:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188305536:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857910.327437:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.327520:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.327601:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171879424 00000100:00100000:0.0:1787857910.327611:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171879424 00002000:00100000:0.0:1787857910.327692:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1f:0x0] (0->157) req@ffff9997c320c780 x1874704171879424/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.327704:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c320c780 with x1874704171879424 ext(0->157) 00010000:00010000:0.0:1787857910.327713:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 16 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.327728:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 16 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.327737:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9997c320c780 00000100:00100000:0.0:1787857910.327803:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:0.0:1787857910.327837:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2348:x1874704171879424:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857910.328346:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.328435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.328717:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171879552 00000100:00100000:2.0:1787857910.328725:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171879552 00010000:00010000:2.0:1787857910.328779:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 16 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.328844:0:14028:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:2.0:1787857910.328851:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 462 00000100:00100000:3.0:1787857910.328859:0:14028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:2.0:1787857910.328862:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2349:x1874704171879552:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857910.328882:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857910.328920:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 16 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.328933:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 16 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.328981:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdfc2381/0xd3f183cab4a7e7ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd461d expref: 16 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.329011:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857910.329017:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857910.329024:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.329036:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.329040:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171879680 00000100:00100000:3.0:1787857910.329044:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171879680 00010000:00010000:2.0:1787857910.329069:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857910.329156:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2349:x1874704171879552:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 294us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.329165:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 462 00000100:00100000:3.0:1787857910.329169:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 456 00000100:00100000:3.0:1787857910.329176:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171879680:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857910.329192:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.329217:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7eb2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4807 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.329432:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188305664:192.168.204.36@tcp:106: 00000100:00100000:3.0:1787857910.329509:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65540 going to sleep for 11 seconds 00010000:00010000:1.0:1787857910.329883:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.329895:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.329901:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2348:x1874704171879424:12345-192.168.204.36@tcp:4:cp.0 Request processed in 2086us (2990us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787857910.329911:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00002000:00100000:0.0:1787857910.329922:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1f:0x0] (0->157) req@ffff9997c320c780 x1874704171879424/t4294967377(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/448 e 0 to 0 dl 1787857921 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787857910.329927:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787857910.329933:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c320c780 with x1874704171879424 ext(0->157) 00010000:00010000:1.0:1787857910.329937:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.329942:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 18 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.329946:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.329954:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857910.329955:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 18 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.329973:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.329982:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9997c320c780 00010000:00010000:1.0:1787857910.329985:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.330003:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.330010:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002075f2ed/0xd3f183cab4a7eb0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.330069:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171878400:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 24340us (25289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.330076:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 453 00000100:00100000:1.0:1787857910.331785:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.331944:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171879808 00000100:00100000:3.0:1787857910.331971:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171879808 00002000:00100000:0.0:1787857910.332333:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1e:0x0] (0->157) req@ffff9997c320f0c0 x1874704171879808/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.332347:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c320f0c0 with x1874704171879808 ext(0->157) 00010000:00010000:0.0:1787857910.332359:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 18 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.332378:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 18 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.332387:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9997c320f0c0 00000100:00100000:0.0:1787857910.332439:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:0.0:1787857910.332452:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2350:x1874704171879808:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:0.0:1787857910.333393:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2350:x1874704171879808:12345-192.168.204.36@tcp:4:cp.0 Request processed in 935us (1616us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787857910.333406:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 21 00002000:00100000:0.0:1787857910.333418:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1e:0x0] (0->157) req@ffff9997c320f0c0 x1874704171879808/t4294967378(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/448 e 0 to 0 dl 1787857921 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.333428:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c320f0c0 with x1874704171879808 ext(0->157) 00010000:00010000:0.0:1787857910.333438:0:6719:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 20 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.333451:0:6719:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 20 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.333462:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9997c320f0c0 00000100:00100000:0.0:1787857910.338176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.338233:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171880064 00000100:00100000:3.0:1787857910.338248:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171880064 00000100:00100000:0.0:1787857910.338314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.338346:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1603 00000100:00100000:0.0:1787857910.338349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.338360:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33547:x1874704171880064:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857910.338469:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171880192 00000100:00100000:2.0:1787857910.338473:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171880192 00010000:00010000:2.0:1787857910.338512:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 20 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.338545:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171880320 00000100:00100000:2.0:1787857910.338548:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171880320 00000100:00100000:3.0:1787857910.338558:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33547:x1874704171880064:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 201us (397us total) trans 0 rc 0/0 00010000:00010000:2.0:1787857910.338560:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 21 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.338567:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1603 00000100:00100000:2.0:1787857910.338578:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 463 00000100:00100000:2.0:1787857910.338583:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2350:x1874704171880192:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857910.338598:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857910.338635:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 21 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.338643:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188305664:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857910.338648:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 21 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.338679:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000289aeaef/0xd3f183cab4a7e665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4544 expref: 21 pid: 6711 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.338698:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7eb2e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4807 expref: 17 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.338702:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857910.338707:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857910.338715:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.338717:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7eb2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4807 expref: 17 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.338729:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.338731:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00010000:00010000:2.0:1787857910.338757:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857910.338758:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171879680:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 9582us (10414us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857910.338766:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 456 00000100:00100000:2.0:1787857910.338775:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2350:x1874704171880192:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 193us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.338782:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 463 00000100:00100000:2.0:1787857910.338795:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 464 00000100:00100000:2.0:1787857910.338802:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2348:x1874704171880320:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857910.338810:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857910.338863:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 19 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.338880:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 19 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.338892:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7e8aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46b0 expref: 19 pid: 14028 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.338903:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857910.338906:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857910.338911:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.338920:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.338936:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857910.338955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2348:x1874704171880320:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 153us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.338973:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 464 00010000:00010000:2.0:1787857910.339000:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.339010:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.339061:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.339071:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.339080:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.339089:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857910.339094:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.339104:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.339116:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.339125:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087843ee3/0xd3f183cab4a7eb19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.339196:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2350:x1874704171879168:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 18043us (18539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.339206:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 455 00010000:00010000:3.0:1787857910.339383:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.339394:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.339415:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.339423:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.339431:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.339437:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857910.339439:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.339448:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.339459:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.339467:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.339583:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2349:x1874704171878656:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 18824us (19065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.339591:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 454 00000100:00100000:1.0:1787857910.345392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.345896:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171880576 00000100:00100000:0.0:1787857910.345916:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171880576 00000100:00100000:0.0:1787857910.346046:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1604 00000100:00100000:0.0:1787857910.346062:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33548:x1874704171880576:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857910.349116:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33548:x1874704171880576:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 3029us (3717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.349140:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1604 00000100:00100000:0.0:1787857910.357698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.357784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.357850:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.357901:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.357919:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171881216 00000100:00100000:0.0:1787857910.357930:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.357936:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171881216 00000100:00100000:2.0:1787857910.358047:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171881472 00000100:00100000:2.0:1787857910.358053:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171881472 00000100:00100000:1.0:1787857910.358065:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171881344 00000100:00100000:2.0:1787857910.358082:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 457 00000100:00100000:2.0:1787857910.358095:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171881216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857910.358126:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787857910.358153:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171881344 00010000:00010000:2.0:1787857910.358160:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd480e expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.358195:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 628 00002000:00010000:2.0:1787857910.358203:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 158, mtime: 0x6a908bf5, atime: 0x0, ctime: 0x6a908bf5, blocks: 0x1 00000100:00100000:1.0:1787857910.358204:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171881344:12345-192.168.204.36@tcp:400:kworker.0 00010000:00010000:2.0:1787857910.358236:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1787857910.358242:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.358255:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 15 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.358283:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 15 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.358435:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7400, rc 0) 00000100:00100000:0.0:1787857910.358502:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 458 00000100:00100000:1.0:1787857910.358503:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171881344:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 299us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.358512:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 628 00000100:00100000:0.0:1787857910.358513:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2350:x1874704171881472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.358523:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.358538:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4815 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.358560:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 158, mtime: 0x6a908bf5, atime: 0x0, ctime: 0x6a908bf5, blocks: 0x1 00000100:00100000:1.0:1787857910.358569:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171880832 00000100:00100000:1.0:1787857910.358572:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171880832 00010000:00010000:0.0:1787857910.358574:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1787857910.358578:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.358584:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.358597:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.358606:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171881088 00010000:00010000:0.0:1787857910.358607:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6c00, rc 0) 00000100:00100000:1.0:1787857910.358608:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171881088 00000100:00100000:1.0:1787857910.358638:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1605 00000100:00100000:1.0:1787857910.358647:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33546:x1874704171880832:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857910.358748:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171881216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 655us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.358755:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 457 00000100:00100000:3.0:1787857910.358856:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1606 00000100:00100000:3.0:1787857910.358870:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+115:33545:x1874704171881088:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:3.0:1787857910.359754:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].51, 136 off15128 00000100:00100000:3.0:1787857910.359905:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+115:33545:x1874704171881088:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 1034us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.359917:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1606 00000100:00100000:1.0:1787857910.361563:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33546:x1874704171880832:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 2894us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.361582:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1605 00000100:00100000:0.0:1787857910.362050:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2350:x1874704171881472:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3536us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.362061:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 458 00000100:00100000:2.0:1787857910.367287:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.367361:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.367644:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171881728 00000100:00100000:0.0:1787857910.367662:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171881728 00000100:00100000:0.0:1787857910.367767:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171881984 00000100:00100000:0.0:1787857910.367771:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171881984 00000100:00100000:0.0:1787857910.367866:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1607 00000100:00100000:0.0:1787857910.367883:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:33548:x1874704171881728:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857910.367950:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1608 00000100:00100000:3.0:1787857910.367979:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:33547:x1874704171881984:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857910.370925:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:33548:x1874704171881728:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 3017us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.370953:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1607 00000100:00100000:1.0:1787857910.374183:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.374366:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33547:x1874704171881984:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 6398us (6997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.374388:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1608 00000100:00100000:3.0:1787857910.375558:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171882112 00000100:00100000:3.0:1787857910.375594:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171882112 00000100:00100000:3.0:1787857910.375694:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 459 00000100:00100000:3.0:1787857910.375708:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2347:x1874704171882112:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857910.375738:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.376104:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd481c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857910.376159:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 158, mtime: 0x6a908bf4, atime: 0x0, ctime: 0x6a908bf4, blocks: 0x1 00000100:00100000:1.0:1787857910.376367:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857910.376388:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1787857910.376397:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.376415:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 18 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.376453:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 18 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.376476:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71800, rc 0) 00000100:00100000:0.0:1787857910.376613:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171882240 00000100:00100000:0.0:1787857910.376621:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171882240 00000100:00100000:0.0:1787857910.376692:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1609 00000100:00100000:0.0:1787857910.376702:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+115:33552:x1874704171882240:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1787857910.376719:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.376737:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7eb4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4823 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.376857:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.376877:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.376890:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.376908:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.376915:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.376922:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377039:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377048:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377056:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377064:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.377153:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377171:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377186:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.377190:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.377197:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377205:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7eb51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377301:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377309:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377316:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377322:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.377325:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377332:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377340:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9997c3d03600) 00010000:00010000:0.0:1787857910.377343:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.377346:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377357:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7eb58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377398:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7eb4a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4823 expref: 116 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377409:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.377411:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.377415:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7eb4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4823 expref: 116 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.377427:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6000, rc 0) 00000100:00100000:2.0:1787857910.377538:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2347:x1874704171882112:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1831us (3374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.377550:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 459 00000100:00100000:0.0:1787857910.378376:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+115:33552:x1874704171882240:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1666us (2002us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.378388:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1609 00000100:00100000:3.0:1787857910.379256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.379524:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171882368 00000100:00100000:2.0:1787857910.379539:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171882368 00002000:00100000:2.0:1787857910.379612:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f:0x0] (0->4095) req@ffff9997c26e6580 x1874704171882368/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857910.379626:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c26e6580 with x1874704171882368 ext(0->4095) 00002000:00010000:2.0:1787857910.379635:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c26e6580 00000100:00100000:2.0:1787857910.379687:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 127 00000100:00100000:2.0:1787857910.379699:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171882368:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787857910.381436:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171882368:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 372us (819us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787857910.381458:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 127 00002000:00100000:2.0:1787857910.381476:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f:0x0] (0->4095) req@ffff9997c26e6580 x1874704171882368/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787857921 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857910.381488:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c26e6580 with x1874704171882368 ext(0->4095) 00002000:00010000:2.0:1787857910.381502:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9997c26e6580 00000100:00100000:0.0:1787857910.388204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.388533:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171882752 00000100:00100000:2.0:1787857910.388552:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171882752 00000100:00100000:2.0:1787857910.388700:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1610 00000100:00100000:2.0:1787857910.388714:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33546:x1874704171882752:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857910.388957:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33546:x1874704171882752:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 244us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.388977:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1610 00000100:00100000:3.0:1787857910.389123:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.389914:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171882880 00000100:00100000:1.0:1787857910.389925:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171882880 00000100:00100000:1.0:1787857910.390001:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:1.0:1787857910.390010:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+115:2347:x1874704171882880:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:1.0:1787857910.390049:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.390078:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7eb5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd482a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390165:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390185:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390203:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390221:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390236:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390243:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390377:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390387:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390395:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390403:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857910.390409:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390420:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390436:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857910.390440:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857910.390449:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390456:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7eb66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390480:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390488:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390495:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390501:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857910.390504:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390510:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390517:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x71bff0c5 (ffff9998c3379c00) 00010000:00010000:1.0:1787857910.390519:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857910.390521:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390529:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390564:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7eb5f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd482a expref: 116 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390576:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857910.390578:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857910.390582:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7eb5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd482a expref: 116 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.390599:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaec400, rc -2) 00000100:00100000:1.0:1787857910.391980:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+115:2347:x1874704171882880:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 1947us (2833us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857910.391996:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:3.0:1787857910.396019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.396194:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171883136 00000100:00100000:2.0:1787857910.396210:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171883136 00000100:00100000:2.0:1787857910.397322:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1611 00000100:00100000:2.0:1787857910.397339:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+67:33548:x1874704171883136:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857910.397374:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.397412:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7eb74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4831 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.397471:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.397494:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.397513:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.397703:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7eb74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 69 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.397734:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 68 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.397744:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:2.0:1787857910.397748:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857910.397753:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7600, rc 0) 00000100:00100000:2.0:1787857910.397919:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:33548:x1874704171883136:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 581us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.397927:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1611 00000100:00100000:2.0:1787857910.398217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.398261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.398487:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171883008 00000100:00100000:1.0:1787857910.398502:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171883008 00002000:00100000:1.0:1787857910.398568:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1e:0x0] (0->4095) req@ffff9998efa6f840 x1874704171883008/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857910.398582:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6f840 with x1874704171883008 ext(0->4095) 00002000:00010000:1.0:1787857910.398588:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6f840 00000100:00100000:1.0:1787857910.398621:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171882496 00000100:00100000:1.0:1787857910.398625:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171882496 00002000:00100000:1.0:1787857910.398645:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (0->4095) req@ffff9998efa6ed00 x1874704171882496/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787857910.398651:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 128 00002000:00100000:1.0:1787857910.398654:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6ed00 with x1874704171882496 ext(0->4095) 00000100:00100000:0.0:1787857910.398667:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2350:x1874704171883008:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00002000:00010000:1.0:1787857910.398670:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6ed00 00000100:00100000:1.0:1787857910.398694:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 129 00000100:00100000:1.0:1787857910.398702:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171882496:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857910.398984:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171882496:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 281us (720us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857910.398992:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 129 00002000:00100000:1.0:1787857910.398999:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (0->4095) req@ffff9998efa6ed00 x1874704171882496/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787857921 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857910.399015:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6ed00 with x1874704171882496 ext(0->4095) 00002000:00010000:1.0:1787857910.399018:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efa6ed00 00000100:00100000:0.0:1787857910.404348:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2350:x1874704171883008:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 5659us (6105us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857910.404373:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 128 00002000:00100000:0.0:1787857910.404399:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1e:0x0] (0->4095) req@ffff9998efa6f840 x1874704171883008/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787857921 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.404413:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efa6f840 with x1874704171883008 ext(0->4095) 00002000:00010000:0.0:1787857910.404425:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998efa6f840 00000100:00100000:2.0:1787857910.406996:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.407193:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.407375:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171883264 00000100:00100000:0.0:1787857910.407395:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171883264 00000100:00100000:0.0:1787857910.407486:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171883392 00000100:00100000:0.0:1787857910.407490:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171883392 00000100:00100000:3.0:1787857910.407500:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1612 00000100:00100000:3.0:1787857910.407517:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33553:x1874704171883264:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857910.407558:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.407599:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7eb82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4838 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.407612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.407640:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171883520 00000100:00100000:1.0:1787857910.407644:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171883520 00010000:00010000:3.0:1787857910.407981:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408004:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408021:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408042:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408050:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408057:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408165:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408174:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408183:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408193:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.408198:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408208:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408225:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.408229:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.408236:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408242:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7eb89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408260:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408266:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408273:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408279:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.408282:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408972:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.408996:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9998d12ef600) 00010000:00010000:3.0:1787857910.408999:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.409003:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.409011:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7eb90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.409071:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7eb82 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4838 expref: 71 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.409085:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.409088:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.409091:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70e00/0xd3f183cab4a7eb82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4838 expref: 71 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.409103:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa70e00, rc 0) 00000100:00100000:3.0:1787857910.409211:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33553:x1874704171883264:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1695us (2245us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857910.409223:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1612 00000100:00100000:0.0:1787857910.409247:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1613 00000100:00100000:0.0:1787857910.409263:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33548:x1874704171883392:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857910.409302:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857910.409413:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33548:x1874704171883392:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 156us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.409420:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1613 00000100:00100000:1.0:1787857910.410674:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1614 00000100:00100000:1.0:1787857910.410700:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+68:33547:x1874704171883520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857910.410728:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.410758:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7eb97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd483f expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.410812:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.410857:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.410872:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.411045:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7eb97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 70 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.411065:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 69 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.411155:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:1.0:1787857910.411159:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857910.411164:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaed400, rc 0) 00000100:00100000:1.0:1787857910.411275:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33547:x1874704171883520:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 587us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.411284:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1614 00000100:00100000:2.0:1787857910.415708:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.416067:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171883648 00000100:00100000:0.0:1787857910.416082:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171883648 00000100:00100000:0.0:1787857910.416166:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1615 00000100:00100000:0.0:1787857910.416180:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33547:x1874704171883648:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857910.416229:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x31:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857910.417066:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33547:x1874704171883648:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 882us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.417078:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1615 00000100:00100000:2.0:1787857910.421650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.422458:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171883776 00000100:00100000:0.0:1787857910.422473:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171883776 00000100:00100000:0.0:1787857910.422564:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1616 00000100:00100000:0.0:1787857910.422578:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33553:x1874704171883776:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857910.422613:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.422652:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7eba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4846 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.422956:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.422993:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423010:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423032:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423039:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423046:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423154:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423163:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423172:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423179:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.423186:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423201:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423220:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.423224:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.423232:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423238:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423255:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423262:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423268:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423285:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.423297:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423305:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423313:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9997c3d03600) 00010000:00010000:0.0:1787857910.423316:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.423319:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423331:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423378:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7eba5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4846 expref: 70 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423392:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.423394:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.423398:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6000/0xd3f183cab4a7eba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4846 expref: 70 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.423410:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6000, rc 0) 00000100:00100000:0.0:1787857910.425010:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33553:x1874704171883776:12345-192.168.204.36@tcp:101:rm.0 Request processed in 2413us (3364us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.425028:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1616 00000100:00100000:2.0:1787857910.432779:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.432958:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.433021:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.433094:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171884032 00000100:00100000:1.0:1787857910.433109:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171884032 00000100:00100000:1.0:1787857910.433203:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1617 00000100:00100000:1.0:1787857910.433228:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+69:33546:x1874704171884032:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857910.433257:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.433290:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ebba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd484d expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.433347:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.433365:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.433382:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.433532:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ebba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 71 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.433561:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 70 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.433572:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:1.0:1787857910.433576:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857910.433582:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaed800, rc 0) 00000100:00100000:1.0:1787857910.433699:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33546:x1874704171884032:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 484us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.433708:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1617 00000100:00100000:3.0:1787857910.434700:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171883904 00000100:00100000:3.0:1787857910.434714:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171883904 00000100:00100000:0.0:1787857910.434780:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171884160 00000100:00100000:0.0:1787857910.434785:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171884160 00000100:00100000:0.0:1787857910.434866:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 460 00000100:00100000:0.0:1787857910.434878:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2347:x1874704171883904:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.434931:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.434951:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.434956:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.434976:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.434996:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435034:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435042:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435052:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435059:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857910.435064:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435086:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435104:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435111:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7ebc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.435190:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2347:x1874704171883904:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 315us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.435198:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 460 00000100:00100000:0.0:1787857910.435225:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 461 00000100:00100000:0.0:1787857910.435233:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2348:x1874704171884160:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.435257:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435267:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.435270:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.435275:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435284:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435308:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435317:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435325:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435337:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857910.435340:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435348:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435358:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.435365:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ebcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.435401:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2348:x1874704171884160:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 169us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.435408:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 461 00000100:00100000:1.0:1787857910.445032:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.445257:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171884288 00000100:00100000:0.0:1787857910.445271:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171884288 00000100:00100000:0.0:1787857910.445377:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1618 00000100:00100000:0.0:1787857910.445391:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33546:x1874704171884288:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857910.445454:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x30:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857910.445634:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33546:x1874704171884288:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 246us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.445643:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1618 00000100:00100000:2.0:1787857910.448174:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.448343:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171884544 00000100:00100000:0.0:1787857910.448358:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171884544 00000100:00100000:0.0:1787857910.448443:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1619 00000100:00100000:0.0:1787857910.448457:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+70:33547:x1874704171884544:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.449202:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.449240:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 70 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.449250:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.449304:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 70 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.449327:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 70 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.449346:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188305792:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857910.449506:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857910.455190:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.455264:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.455538:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171884800 00000100:00100000:0.0:1787857910.455557:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171884800 00000100:00100000:3.0:1787857910.455634:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171884928 00000100:00100000:3.0:1787857910.455641:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171884928 00000100:00100000:0.0:1787857910.455664:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1620 00000100:00100000:0.0:1787857910.455677:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+71:33548:x1874704171884800:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857910.455692:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 462 00000100:00100000:3.0:1787857910.455699:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171884928:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.455857:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.455895:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 71 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.455907:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.455982:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 71 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.456000:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 71 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456015:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.456020:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188305920:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857910.456034:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857910.456039:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857910.456047:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456063:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456110:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456121:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456133:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456141:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857910.456147:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456158:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456179:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.456190:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49a050d/0xd3f183cab4a7ebe4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.456259:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171884928:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 559us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.456268:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 462 00000100:00100000:0.0:1787857910.456295:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857910.456352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.456710:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171885056 00000100:00100000:0.0:1787857910.456719:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171885056 00000100:00100000:0.0:1787857910.456772:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1621 00000100:00100000:0.0:1787857910.456781:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+72:33554:x1874704171885056:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857910.456797:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.456857:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4854 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.456950:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.456977:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.456990:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.457013:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.457020:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.457027:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458584:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458606:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458615:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458622:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.458630:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458640:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458663:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.458667:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.458674:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458683:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7ebf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458703:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458709:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458714:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458720:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.458722:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458728:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458737:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9997c3d03600) 00010000:00010000:0.0:1787857910.458739:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.458743:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458749:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ebf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458813:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebeb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4854 expref: 73 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458852:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.458855:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.458860:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ebeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4854 expref: 73 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.458871:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7400, rc 0) 00000100:00100000:0.0:1787857910.459028:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+72:33554:x1874704171885056:12345-192.168.204.36@tcp:101:cp.0 Request processed in 2246us (2674us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.459049:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1621 00000100:00100000:0.0:1787857910.463456:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188305792:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857910.463515:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.469725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.469766:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.469806:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.469867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.469915:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188305920:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857910.469937:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171885312 00000100:00100000:3.0:1787857910.469948:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171885312 00010000:00010000:2.0:1787857910.469974:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.470020:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 72 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.470062:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171885184 00000100:00100000:3.0:1787857910.470073:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171885184 00010000:00010000:3.0:1787857910.470090:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 73 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.470098:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 465 00000100:00100000:2.0:1787857910.470113:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+73:2349:x1874704171885312:12345-192.168.204.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787857910.470119:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 466 00000100:00100000:3.0:1787857910.470124:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+73:2349:x1874704171885184:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857910.470137:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857910.470137:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857910.470146:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 73 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.470146:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 73 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.470160:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 73 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.470161:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 73 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.470191:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eb9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd483f expref: 73 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.470191:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7eb7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4831 expref: 73 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.470212:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:2.0:1787857910.470212:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:2.0:1787857910.470218:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.470229:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.470230:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.470237:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.470241:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.470243:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.470270:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857910.470460:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857910.470527:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.470538:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.470934:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.470945:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.470954:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.470973:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.470979:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.470991:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.471005:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:0.0:1787857910.471008:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857910.471014:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.471022:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ebd6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.471195:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171885568 00000100:00100000:1.0:1787857910.471202:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171885568 00000100:00100000:1.0:1787857910.471320:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171885696 00000100:00100000:1.0:1787857910.471325:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171885696 00000100:00100000:1.0:1787857910.471350:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1622 00000100:00100000:1.0:1787857910.471359:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+74:33546:x1874704171885568:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787857910.471461:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.471477:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 74 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.471488:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.471532:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 74 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.471551:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 74 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.471569:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188306048:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857910.471696:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857910.472453:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+74:2349:x1874704171885184:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2318us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.472470:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 466 00000100:00100000:0.0:1787857910.473013:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+73:33547:x1874704171884544:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 24558us (24855us total) trans 4294968370 rc 0/0 00000100:00100000:0.0:1787857910.473024:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1619 00000100:00100000:0.0:1787857910.473051:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1623 00000100:00100000:0.0:1787857910.473148:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+72:33554:x1874704171885696:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857910.473173:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.473202:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd485b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.473434:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.473444:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.473889:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.473908:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.473922:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.473941:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.473952:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.473970:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474044:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474052:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474060:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.474400:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.474409:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.474415:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.474421:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.474427:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.474436:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.474454:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:3.0:1787857910.474458:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857910.474463:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.474470:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7ebdd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474667:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.474671:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474679:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474688:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.474692:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.474696:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474703:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474718:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474725:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474732:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474738:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.474741:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474747:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474755:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9997c3d03800) 00010000:00010000:0.0:1787857910.474759:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.474762:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474768:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474872:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec07 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd485b expref: 74 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474887:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.474890:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.474893:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd485b expref: 74 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.474903:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6600, rc 0) 00000100:00100000:0.0:1787857910.474983:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+73:33554:x1874704171885696:12345-192.168.204.36@tcp:101:cp.0 Request processed in 1921us (5112us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.474997:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1623 00000100:00100000:3.0:1787857910.477610:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+72:33548:x1874704171884800:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 21911us (22415us total) trans 4294968371 rc 0/0 00000100:00100000:3.0:1787857910.477632:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1620 00000100:00100000:1.0:1787857910.478032:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.478200:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171885824 00000100:00100000:0.0:1787857910.478213:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171885824 00010000:00010000:0.0:1787857910.478558:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 72 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.478615:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 467 00000100:00100000:0.0:1787857910.478628:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+72:2349:x1874704171885824:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857910.478651:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857910.478670:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 72 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.478688:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 72 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.478726:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:0.0:1787857910.478734:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.478748:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.478759:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.478786:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857910.478877:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+72:2349:x1874704171885824:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 251us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.478886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 467 00000100:00100000:1.0:1787857910.479057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857910.479570:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed800/0xd3f183cab4a7ebc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd484d expref: 71 pid: 7656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.479598:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188306048:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857910.479637:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.479650:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.479663:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.480027:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.480037:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.480044:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.480051:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.480057:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.480063:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+71:2349:x1874704171885312:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 9950us (10355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.480074:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 465 00000100:00100000:0.0:1787857910.480550:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171886080 00000100:00100000:0.0:1787857910.480560:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171886080 00000100:00100000:0.0:1787857910.481867:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00100000:0.0:1787857910.481892:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+71:33547:x1874704171886080:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00010000:00010000:3.0:1787857910.482432:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.482472:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:3.0:1787857910.482476:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857910.482487:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.482497:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec400/0xd3f183cab4a7ec00 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.483770:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+72:33547:x1874704171886080:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1876us (4699us total) trans 4294968373 rc 0/0 00000100:00100000:0.0:1787857910.483786:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 338 00000100:00100000:1.0:1787857910.483936:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+71:33546:x1874704171885568:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 12576us (14128us total) trans 4294968372 rc 0/0 00000100:00100000:1.0:1787857910.483948:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1622 00000100:00100000:3.0:1787857910.484588:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.484863:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171886336 00000100:00100000:0.0:1787857910.484877:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171886336 00000100:00100000:0.0:1787857910.484955:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1624 00000100:00100000:0.0:1787857910.484978:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+71:33554:x1874704171886336:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857910.485012:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.485043:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ec1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4862 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857910.485527:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857910.485534:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857910.485592:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 52 count 10 00000040:00080000:2.0:1787857910.485600:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857910.486252:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188306176:192.168.204.36@tcp:107:hsm_cdtr.0 00010000:00010000:0.0:1787857910.486757:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.486784:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 114 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.486795:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.486864:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 114 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.486885:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 114 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.486900:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188306304:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857910.488408:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857910.488429:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.488472:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171886592 00000100:00100000:2.0:1787857910.488485:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171886592 00000100:00100000:2.0:1787857910.488570:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 339 00000100:00100000:2.0:1787857910.488583:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+74:33548:x1874704171886592:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857910.488615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.489040:0:5860:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787857910.489053:0:5860:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1787857910.489210:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857910.489375:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171886848 00000100:00100000:0.0:1787857910.489381:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171886848 00000100:00100000:0.0:1787857910.489539:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 340 00000100:00100000:0.0:1787857910.489551:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c613b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+75:33546:x1874704171886848:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857910.489915:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c613b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+76:33546:x1874704171886848:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 365us (1298us total) trans 4294968374 rc 0/0 00000100:00100000:0.0:1787857910.489925:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 340 00000100:00100000:2.0:1787857910.491128:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+76:33548:x1874704171886592:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 2535us (2690us total) trans 4294968375 rc 0/0 00000100:00100000:2.0:1787857910.491143:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 339 00000100:00100000:2.0:1787857910.491411:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188306176:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857910.492205:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.492989:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171886976 00000100:00100000:0.0:1787857910.493004:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171886976 00000100:00100000:0.0:1787857910.493188:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1625 00000100:00100000:0.0:1787857910.493201:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+75:33555:x1874704171886976:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857910.493320:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x33:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857910.493480:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+75:33555:x1874704171886976:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 282us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.493489:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1625 00000100:00100000:1.0:1787857910.496077:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.496210:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171887104 00000100:00100000:2.0:1787857910.496224:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171887104 00000100:00100000:2.0:1787857910.496303:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1626 00000100:00100000:2.0:1787857910.496315:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+75:33556:x1874704171887104:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857910.496365:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x34:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857910.496541:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+75:33556:x1874704171887104:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 228us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.496550:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1626 00000100:00100000:3.0:1787857910.497523:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.497679:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.497720:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171887488 00000100:00100000:3.0:1787857910.497728:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171887488 00010000:00010000:3.0:1787857910.498275:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 115 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.498327:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 468 00000100:00100000:3.0:1787857910.498341:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+115:2348:x1874704171887488:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857910.498363:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857910.498372:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 115 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.498389:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 115 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.498424:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.498431:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.498445:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.498457:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.498490:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857910.498567:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+115:2348:x1874704171887488:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 230us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.498576:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 468 00010000:00010000:0.0:1787857910.499126:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7eb27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4800 expref: 114 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.499155:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188306304:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857910.499189:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.499202:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.499209:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.499243:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.499255:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.499264:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.499990:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171887360 00000100:00100000:2.0:1787857910.500002:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171887360 00000100:00100000:2.0:1787857910.500062:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1627 00000100:00100000:2.0:1787857910.500159:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+75:33555:x1874704171887360:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857910.500189:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.500666:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ec31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4869 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.500800:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7ec38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.500839:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.500852:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857910.500867:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x33:0x0]: returning size 158 00010000:00010000:2.0:1787857910.501141:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ec31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4869 expref: 78 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.501166:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7ec38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4869 expref: 77 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.501176:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:2.0:1787857910.501180:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857910.501185:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6200, rc 0) 00000004:00080000:0.0:1787857910.501396:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:0.0:1787857910.501716:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.501734:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.501744:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.501991:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.501999:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.502007:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.502012:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.502018:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.502026:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.502037:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.502039:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.502043:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.502049:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ec23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857910.502063:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dc4ffe7 reply state 000000006fea8bee transno 4294968377 ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.502074:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857910.502107:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ec1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 79 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.502123:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 78 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.502131:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857910.502133:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857910.502136:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7800, rc 0) 00000100:00100000:2.0:1787857910.502409:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+79:33555:x1874704171887360:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2251us (4891us total) trans 4294968376 rc 0/0 00000100:00100000:2.0:1787857910.502421:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1627 00000100:00100000:0.0:1787857910.502594:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:33554:x1874704171886336:12345-192.168.204.36@tcp:101:cp.0 Request processed in 17617us (18013us total) trans 4294968377 rc 0/0 00000100:00100000:0.0:1787857910.502601:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1624 00000100:00100000:3.0:1787857910.503062:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.503190:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171887744 00000100:00100000:0.0:1787857910.503203:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171887744 00000100:00100000:0.0:1787857910.503394:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1628 00000100:00100000:0.0:1787857910.503409:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:33556:x1874704171887744:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.503440:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.503466:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ec54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4870 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.503616:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ec5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.503633:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ec5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.503652:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ec5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857910.503666:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x34:0x0]: returning size 158 00010000:00010000:0.0:1787857910.503882:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ec54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4870 expref: 81 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.503904:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ec5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4870 expref: 80 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.503913:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:0.0:1787857910.503916:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857910.503919:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6a00, rc 0) 00000100:00100000:0.0:1787857910.503992:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33556:x1874704171887744:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 587us (932us total) trans 4294968378 rc 0/0 00000100:00100000:0.0:1787857910.504001:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1628 00010000:00010000:0.0:1787857910.508697:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.508725:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.508735:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.508743:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.508750:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.508765:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.508792:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9997c3d03800) 00010000:00010000:0.0:1787857910.508795:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.508803:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.508811:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ec2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.509197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.509260:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.509373:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171887872 00000100:00100000:2.0:1787857910.509373:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171888128 00000100:00100000:3.0:1787857910.509387:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171887872 00000100:00100000:2.0:1787857910.509387:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171888128 00000100:00100000:3.0:1787857910.509451:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 463 00000100:00100000:2.0:1787857910.509451:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 85 00000100:00100000:3.0:1787857910.509464:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2349:x1874704171887872:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00000100:00100000:2.0:1787857910.509464:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+79:2350:x1874704171888128:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:3.0:1787857910.509531:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509546:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.509554:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509562:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ec70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd487e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.509565:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857910.509571:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857910.509577:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.509624:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 15 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509636:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.509642:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 15 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509650:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.509661:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c26e61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188306432:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857910.509670:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509687:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509693:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509700:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.509794:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2da7cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787857910.509806:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509814:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509842:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509849:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.509853:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509865:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509877:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.509880:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.509884:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509890:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6a00/0xd3f183cab4a7ec77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509901:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509907:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509913:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509918:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.509920:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509926:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509932:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9998c4eb6c00) 00010000:00010000:2.0:1787857910.509935:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.509938:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509948:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ec7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.509993:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ec70 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd487e expref: 80 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.510002:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.510004:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787857910.510007:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ec70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd487e expref: 80 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.510017:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7600, rc -2) 00000100:00100000:2.0:1787857910.510152:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+79:2350:x1874704171888128:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 689us (889us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857910.510160:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 85 00000100:00100000:0.0:1787857910.511870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857910.511949:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857910.511950:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.512008:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171888256 00000100:00100000:2.0:1787857910.512021:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171888256 00000100:00100000:2.0:1787857910.512182:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:2.0:1787857910.512195:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+79:2348:x1874704171888256:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857910.512230:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857910.512266:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6200/0xd3f183cab4a7ec38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4869 expref: 79 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.512289:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:2.0:1787857910.512295:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857910.512369:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:2348:x1874704171888256:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 177us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.512379:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:1.0:1787857910.513041:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171888000 00000100:00100000:1.0:1787857910.513050:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171888000 00000100:00100000:1.0:1787857910.513102:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 464 00000100:00100000:1.0:1787857910.513111:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2347:x1874704171888000:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857910.513132:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.513160:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4877 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857910.513201:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857910.513224:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1787857910.513230:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857910.513242:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.513262:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.513283:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaecc00, rc 0) 00000100:00100000:1.0:1787857910.513332:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2347:x1874704171888000:12345-192.168.204.36@tcp:101:cp.0 Request processed in 223us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.513339:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 464 00000100:00100000:1.0:1787857910.515933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.515999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.516000:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171888384 00000100:00100000:2.0:1787857910.516015:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171888384 00000100:00100000:0.0:1787857910.516132:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:0.0:1787857910.516151:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:2350:x1874704171888384:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857910.516173:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857910.516216:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6a00/0xd3f183cab4a7ec5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4870 expref: 78 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.516244:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:0.0:1787857910.516250:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857910.516344:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+77:2350:x1874704171888384:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 198us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.516354:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:3.0:1787857910.516399:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171888512 00000100:00100000:3.0:1787857910.516403:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171888512 00000100:00100000:3.0:1787857910.516449:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 465 00000100:00100000:3.0:1787857910.516457:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171888512:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857910.516503:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.516536:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 18 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.516548:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857910.516553:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857910.516559:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.516605:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 18 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.516626:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 18 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.516645:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3040b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188306560:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857910.516952:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857910.519674:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c26e61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188306432:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857910.519721:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.519724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.519849:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171888640 00000100:00100000:0.0:1787857910.519861:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171888640 00002000:00100000:0.0:1787857910.519935:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->157) req@ffff9998f9d1da40 x1874704171888640/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.519947:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d1da40 with x1874704171888640 ext(0->157) 00010000:00010000:0.0:1787857910.519955:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 17 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.519982:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 17 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.519990:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998f9d1da40 00000100:00100000:0.0:1787857910.520026:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:0.0:1787857910.520037:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2347:x1874704171888640:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:2.0:1787857910.520855:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3040b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188306560:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857910.520879:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.521450:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2347:x1874704171888640:12345-192.168.204.36@tcp:4:cp.0 Request processed in 1407us (1794us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1787857910.521463:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 22 00002000:00100000:0.0:1787857910.521476:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->157) req@ffff9998f9d1da40 x1874704171888640/t4294967393(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/448 e 0 to 0 dl 1787857921 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.521486:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d1da40 with x1874704171888640 ext(0->157) 00010000:00010000:0.0:1787857910.521495:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 19 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.521508:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 19 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.521640:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9998f9d1da40 00000100:00100000:1.0:1787857910.521720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.522047:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171888768 00000100:00100000:3.0:1787857910.522058:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171888768 00002000:00100000:3.0:1787857910.522189:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x20:0x0] (0->157) req@ffff9998f9d1c000 x1874704171888768/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857910.522207:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d1c000 with x1874704171888768 ext(0->157) 00010000:00010000:3.0:1787857910.522337:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 19 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.523317:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 19 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857910.523333:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998f9d1c000 00000100:00100000:2.0:1787857910.523408:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.523492:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:0.0:1787857910.523522:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2347:x1874704171888768:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857910.524328:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171888896 00000100:00100000:1.0:1787857910.524340:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171888896 00000100:00100000:1.0:1787857910.524439:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 466 00000100:00100000:1.0:1787857910.524452:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:33554:x1874704171888896:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857910.524470:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.524499:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd48b6 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.524539:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 20 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.524553:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857910.524559:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857910.524566:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 20 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.524621:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 20 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.524630:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857910.524640:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 20 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.524789:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22727:1874704188306688:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857910.524836:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171889024 00000100:00100000:1.0:1787857910.524840:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171889024 00010000:00010000:1.0:1787857910.524865:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 21 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.524891:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 469 00000100:00100000:1.0:1787857910.524898:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2349:x1874704171889024:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857910.524910:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857910.524938:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 21 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.524954:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 21 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.524994:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a5611b/0xd3f183cab4a7e9bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd474a expref: 21 pid: 8490 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525014:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857910.525018:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857910.525025:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525038:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525064:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857910.525132:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2349:x1874704171889024:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 234us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.525141:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 469 00010000:00010000:1.0:1787857910.525174:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525185:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525221:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525231:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525240:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525247:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857910.525252:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525351:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525365:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.525375:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8a53d40/0xd3f183cab4a7ec69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.525434:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2349:x1874704171887872:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 15974us (16246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.525443:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 463 00000100:00100000:0.0:1787857910.525498:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2347:x1874704171888768:12345-192.168.204.36@tcp:4:cp.0 Request processed in 1992us (3778us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787857910.525588:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 23 00002000:00100000:0.0:1787857910.525603:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x20:0x0] (0->157) req@ffff9998f9d1c000 x1874704171888768/t4294967379(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 648/448 e 0 to 0 dl 1787857921 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.525614:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d1c000 with x1874704171888768 ext(0->157) 00010000:00010000:0.0:1787857910.525626:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 21 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.525639:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 21 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.525640:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295780 going to sleep for 11 seconds 00002000:00010000:0.0:1787857910.525647:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998f9d1c000 00000100:00100000:2.0:1787857910.531658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.531700:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.531757:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.531804:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171889280 00000100:00100000:0.0:1787857910.531838:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171889280 00010000:00010000:0.0:1787857910.531898:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 19 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.531942:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171889152 00000100:00100000:0.0:1787857910.531946:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171889152 00010000:00010000:0.0:1787857910.531978:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 21 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.532002:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 470 00000100:00100000:2.0:1787857910.532017:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2348:x1874704171889280:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857910.532043:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857910.532078:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 19 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.532102:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 19 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.532143:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.532149:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.532171:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 19 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.532195:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 19 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.532257:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 19 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.532276:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704a940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188306816:192.168.204.36@tcp:105: 00000100:00100000:2.0:1787857910.532436:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f73cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857910.533656:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 471 00000100:00100000:0.0:1787857910.533691:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2348:x1874704171889152:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857910.533717:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857910.534044:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 21 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.534145:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 21 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.534171:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5895867/0xd3f183cab4a7ea8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd479e expref: 21 pid: 6713 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.534196:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857910.534201:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857910.534208:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.534219:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a608112/0xd3f183cab4a7ec85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4877 expref: 19 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.534236:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22727:1874704188306688:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857910.534275:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 18 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.534347:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.534368:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaece00, rc 0) 00010000:00010000:0.0:1787857910.534381:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857910.534438:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:33554:x1874704171888896:12345-192.168.204.36@tcp:101:cp.0 Request processed in 9991us (11033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.534447:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 466 00010000:00010000:2.0:1787857910.534478:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.534489:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.534545:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.534554:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.534562:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.534570:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857910.534576:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.534585:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.534597:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.534601:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171889536 00010000:00010000:2.0:1787857910.534605:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027defac7/0xd3f183cab4a7ec8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.534610:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171889536 00000100:00100000:0.0:1787857910.534863:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2348:x1874704171889152:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1191us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.534874:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 471 00000100:00100000:1.0:1787857910.534921:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1629 00000100:00100000:1.0:1787857910.534931:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+77:33555:x1874704171889536:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857910.534952:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2349:x1874704171888512:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 18496us (18952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.534970:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 465 00000100:00100000:1.0:1787857910.535048:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+77:33555:x1874704171889536:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 118us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.535055:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1629 00000100:00100000:1.0:1787857910.539136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.539263:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171889792 00000100:00100000:0.0:1787857910.539282:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171889792 00000100:00100000:0.0:1787857910.539381:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1630 00000100:00100000:0.0:1787857910.539396:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+77:33556:x1874704171889792:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857910.539639:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+77:33556:x1874704171889792:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 244us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.539648:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1630 00000100:00100000:3.0:1787857910.544096:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.544191:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171890048 00000100:00100000:0.0:1787857910.544247:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171890048 00000100:00100000:0.0:1787857910.544339:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 341 00000100:00100000:2.0:1787857910.544452:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704a940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188306816:192.168.204.36@tcp:105: 00010000:00010000:2.0:1787857910.544495:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857910.544612:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2348:x1874704171889280:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 12597us (12971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.544627:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 470 00000100:00100000:0.0:1787857910.544871:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+77:33554:x1874704171890048:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:0.0:1787857910.545474:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:33554:x1874704171890048:12345-192.168.204.36@tcp:35:cp.0 Request processed in 1118us (1393us total) trans 4294968379 rc 0/0 00000100:00100000:0.0:1787857910.545485:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 341 00000100:00100000:3.0:1787857910.548967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.549164:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171890176 00000100:00100000:1.0:1787857910.549179:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171890176 00000100:00100000:0.0:1787857910.549332:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 467 00000100:00100000:0.0:1787857910.549350:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+17:2349:x1874704171890176:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.549385:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.549423:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd48bd expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857910.549472:0:6714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 158, mtime: 0x6a908bf5, atime: 0x0, ctime: 0x6a908bf5, blocks: 0x1 00010000:00010000:0.0:1787857910.549507:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1787857910.549597:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.549612:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 18 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.549642:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 18 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.549667:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6a00, rc 0) 00000100:00100000:0.0:1787857910.549895:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171890176:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 550us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.549904:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 467 00000100:00100000:3.0:1787857910.551771:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.551875:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171890304 00000100:00100000:2.0:1787857910.551888:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171890304 00000100:00100000:2.0:1787857910.551955:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 468 00000100:00100000:2.0:1787857910.551978:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2349:x1874704171890304:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857910.552002:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.552032:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd48c4 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857910.552085:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 158, mtime: 0x6a908bf5, atime: 0x0, ctime: 0x6a908bf5, blocks: 0x1 00010000:00010000:2.0:1787857910.552119:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1787857910.552125:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.552139:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 20 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.552161:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 20 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.552180:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6200, rc 0) 00000100:00100000:2.0:1787857910.552278:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2349:x1874704171890304:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 302us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.552286:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 468 00000100:00100000:3.0:1787857910.564620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.564709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.564938:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171890560 00000100:00100000:1.0:1787857910.564954:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171890560 00000100:00100000:1.0:1787857910.565045:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171890816 00000100:00100000:1.0:1787857910.565049:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171890816 00000100:00100000:1.0:1787857910.565081:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1631 00000100:00100000:1.0:1787857910.565093:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+79:33555:x1874704171890560:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857910.565277:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+79:33555:x1874704171890560:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 186us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.565285:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1631 00000100:00100000:1.0:1787857910.565308:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1632 00000100:00100000:1.0:1787857910.565315:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:33556:x1874704171890816:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857910.565352:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:33556:x1874704171890816:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 37us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.565359:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1632 00000100:00100000:3.0:1787857910.572049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.572599:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171890944 00000100:00100000:1.0:1787857910.572619:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171890944 00000100:00100000:1.0:1787857910.572733:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:1.0:1787857910.572748:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:2349:x1874704171890944:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:1.0:1787857910.572884:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.572918:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eca8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd48cb expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573024:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573045:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573061:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573083:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573090:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573098:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573207:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573216:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573224:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573232:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857910.573239:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573248:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573270:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857910.573275:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857910.573283:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573291:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7ecaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573309:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573316:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573323:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573328:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaeda00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857910.573332:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573338:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573346:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9998d1291e00) 00010000:00010000:1.0:1787857910.573349:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857910.573352:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573358:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573403:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eca8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48cb expref: 79 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573416:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857910.573419:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857910.573422:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eca8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48cb expref: 79 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.573433:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaede00, rc -2) 00000100:00100000:1.0:1787857910.573540:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:2349:x1874704171890944:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 795us (1509us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857910.573548:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:1.0:1787857910.578275:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.578400:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171891072 00000100:00100000:0.0:1787857910.578418:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171891072 00002000:00100000:0.0:1787857910.578508:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (0->4095) req@ffff9997c507cf00 x1874704171891072/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.578524:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507cf00 with x1874704171891072 ext(0->4095) 00002000:00010000:0.0:1787857910.578533:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c507cf00 00000100:00100000:0.0:1787857910.578581:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 130 00000100:00100000:0.0:1787857910.578595:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171891072:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787857910.578980:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2349:x1874704171891072:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 385us (730us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857910.578989:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 130 00002000:00100000:0.0:1787857910.578998:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x22:0x0] (0->4095) req@ffff9997c507cf00 x1874704171891072/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787857921 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.579006:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c507cf00 with x1874704171891072 ext(0->4095) 00002000:00010000:0.0:1787857910.579010:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c507cf00 00000100:00100000:3.0:1787857910.586042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.586176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.586303:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171891200 00000100:00100000:0.0:1787857910.586319:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171891200 00002000:00100000:0.0:1787857910.586407:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x20:0x0] (0->4095) req@ffff99990151e940 x1874704171891200/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/0 e 0 to 0 dl 1787857921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.586432:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990151e940 with x1874704171891200 ext(0->4095) 00002000:00010000:0.0:1787857910.586442:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99990151e940 00000100:00100000:0.0:1787857910.586499:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 131 00000100:00100000:0.0:1787857910.586512:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2348:x1874704171891200:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787857910.586901:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2348:x1874704171891200:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 389us (723us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857910.586912:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 131 00002000:00100000:0.0:1787857910.586919:0:6717:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x20:0x0] (0->4095) req@ffff99990151e940 x1874704171891200/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:556/0 lens 488/4536 e 0 to 0 dl 1787857921 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857910.586928:0:6717:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99990151e940 with x1874704171891200 ext(0->4095) 00002000:00010000:0.0:1787857910.586932:0:6717:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99990151e940 00000100:00100000:2.0:1787857910.588245:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171891328 00000100:00100000:2.0:1787857910.588377:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171891328 00000100:00100000:2.0:1787857910.588532:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1633 00000100:00100000:2.0:1787857910.588545:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+78:33555:x1874704171891328:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857910.588574:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.588615:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ecbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4903 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.588705:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.588731:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.588753:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.588994:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ecbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 80 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.589025:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 79 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.589038:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:2.0:1787857910.589042:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857910.589048:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7c00, rc 0) 00000100:00100000:2.0:1787857910.589208:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+79:33555:x1874704171891328:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 666us (3182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.589217:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1633 00000100:00100000:3.0:1787857910.595545:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.596019:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171891456 00000100:00100000:1.0:1787857910.596034:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171891456 00000100:00100000:1.0:1787857910.596121:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1634 00000100:00100000:1.0:1787857910.596136:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+79:33556:x1874704171891456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857910.596167:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.596201:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eccb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd490a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.596264:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.596283:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.596397:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.596571:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eccb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 81 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.596597:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 80 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.596607:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:1.0:1787857910.596611:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857910.596615:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaeda00, rc 0) 00000100:00100000:1.0:1787857910.596715:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33556:x1874704171891456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 582us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.596723:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1634 00000100:00100000:3.0:1787857910.597913:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.598035:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171891584 00000100:00100000:2.0:1787857910.598046:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171891584 00000100:00100000:2.0:1787857910.598111:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1635 00000100:00100000:2.0:1787857910.598124:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33555:x1874704171891584:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787857910.598172:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x33:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787857910.598331:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33555:x1874704171891584:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 209us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.598340:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1635 00000100:00100000:2.0:1787857910.607063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.607303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.608000:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171891712 00000100:00100000:1.0:1787857910.608020:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171891712 00000100:00100000:1.0:1787857910.608123:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 469 00000100:00100000:1.0:1787857910.608138:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2350:x1874704171891712:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857910.608220:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608262:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857910.608270:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857910.608279:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608387:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608443:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608452:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608462:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608471:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaede00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857910.608477:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608490:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608513:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.608522:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee23f803/0xd3f183cab4a7ecd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.608980:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2350:x1874704171891712:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 838us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.608991:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 469 00000100:00100000:3.0:1787857910.610177:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171891840 00000100:00100000:3.0:1787857910.610195:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171891840 00000100:00100000:3.0:1787857910.610406:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1636 00000100:00100000:3.0:1787857910.610422:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33556:x1874704171891840:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857910.610473:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x34:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857910.610632:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33556:x1874704171891840:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 214us (3328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.611754:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1636 00000100:00100000:2.0:1787857910.619521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.619576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.619647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.619872:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171891968 00000100:00100000:3.0:1787857910.619889:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171891968 00000100:00100000:3.0:1787857910.619990:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171892224 00000100:00100000:3.0:1787857910.619994:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171892224 00000100:00100000:3.0:1787857910.620028:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1637 00000100:00100000:3.0:1787857910.620041:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+114:33563:x1874704171891968:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857910.620076:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.620111:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ece0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4911 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620219:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620240:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620255:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620274:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620282:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620295:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620470:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ecf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620481:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ecf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620489:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ecf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857910.620542:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x35:0x0]: returning size 158 00000004:00200000:3.0:1787857910.620548:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857910.620583:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ecf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620599:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ecf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620609:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620617:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620625:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620633:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa71200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.620639:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620648:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620745:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.620749:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.620756:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620764:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71200/0xd3f183cab4a7ece7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620780:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620787:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620792:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620798:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.620801:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620808:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620872:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9998d12ef600) 00010000:00010000:3.0:1787857910.620875:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.620880:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620887:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70800/0xd3f183cab4a7ecee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620940:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70200/0xd3f183cab4a7ece0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4911 expref: 116 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620970:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ecf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4911 expref: 115 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.620979:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857910.620981:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857910.620985:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efa71c00, rc 0) 00000100:00100000:3.0:1787857910.621089:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+115:33563:x1874704171891968:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1050us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.621099:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1637 00000100:00100000:3.0:1787857910.621142:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1638 00000100:00100000:3.0:1787857910.621152:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33555:x1874704171892224:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857910.621218:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.621232:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 80 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.621243:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.621293:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 80 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.621312:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 80 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.621331:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188306944:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857910.621412:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5a3ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857910.622152:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171892352 00000100:00100000:0.0:1787857910.622165:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171892352 00000100:00100000:0.0:1787857910.622230:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 470 00000100:00100000:0.0:1787857910.622240:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2350:x1874704171892352:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857910.622291:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622315:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.622321:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857910.622329:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622346:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622391:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622400:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622409:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622416:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857910.622422:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622430:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622449:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.622458:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5a8384/0xd3f183cab4a7ed03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.622531:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2350:x1874704171892352:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 292us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.622563:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 470 00000100:00100000:2.0:1787857910.632066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.632122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.632214:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171892608 00000100:00100000:3.0:1787857910.632228:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171892608 00000100:00100000:3.0:1787857910.632331:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 471 00000100:00100000:3.0:1787857910.632345:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+18:2348:x1874704171892608:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857910.632373:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.632400:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7ed0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4918 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.632497:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188307072:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857910.635538:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171892480 00000100:00100000:1.0:1787857910.635566:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171892480 00010000:00010000:1.0:1787857910.635644:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 81 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.635713:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 472 00000100:00100000:1.0:1787857910.635728:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+81:2350:x1874704171892480:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857910.635749:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857910.635757:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 81 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.635775:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 81 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.635847:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:1.0:1787857910.635855:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.635870:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.635880:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.635909:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857910.635996:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+81:2350:x1874704171892480:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 270us (3949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.636005:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 472 00000100:00100000:3.0:1787857910.636751:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2da7cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787857910.636869:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ecc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4903 expref: 80 pid: 5856 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.636891:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188306944:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857910.636917:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.636930:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.636937:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.637245:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.637494:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.637504:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.637511:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efa70400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.637518:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.637529:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.637550:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:3.0:1787857910.637554:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857910.637559:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.637567:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa70400/0xd3f183cab4a7ecfc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.637777:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33555:x1874704171892224:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 16625us (18197us total) trans 4294968380 rc 0/0 00000100:00100000:3.0:1787857910.637792:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1638 00000100:00100000:2.0:1787857910.645342:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.645394:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.645432:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171893120 00000100:00100000:2.0:1787857910.645448:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171893120 00000100:00100000:2.0:1787857910.645523:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 342 00000100:00100000:2.0:1787857910.645536:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+80:33555:x1874704171893120:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857910.646382:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171892864 00000100:00100000:3.0:1787857910.646392:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171892864 00000100:00100000:3.0:1787857910.646449:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1639 00000100:00100000:3.0:1787857910.646459:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33556:x1874704171892864:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857910.646550:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.646579:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 82 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.646591:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.646649:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 82 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.646757:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 82 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.646777:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188307200:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857910.646881:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857910.647783:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33555:x1874704171893120:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 718us (855us total) trans 4294968381 rc 0/0 00000100:00100000:2.0:1787857910.647804:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 342 00002000:00010000:3.0:1787857910.648525:0:8490:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787857910.648533:0:8490:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime: 0 -> 1787857910 00002000:00010000:3.0:1787857910.648535:0:8490:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime: 0 -> 1787857910 00002000:00010000:3.0:1787857910.648538:0:8490:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime: 0 -> 1787857910 00000100:00100000:3.0:1787857910.648568:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188307072:192.168.204.36@tcp:106: 00010000:00010000:3.0:1787857910.648621:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7ed0a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4918 expref: 19 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.648786:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7ed0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4918 expref: 19 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.648804:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fcc00, rc 0) 00000100:00100000:3.0:1787857910.648928:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+18:2348:x1874704171892608:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 16585us (16804us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857910.648939:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 471 00000100:00100000:1.0:1787857910.654346:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.654485:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171893248 00000100:00100000:0.0:1787857910.654501:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171893248 00010000:00010000:0.0:1787857910.654570:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 82 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.654629:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 473 00000100:00100000:0.0:1787857910.654643:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:2350:x1874704171893248:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857910.654673:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857910.654682:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 82 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.654698:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 82 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.654731:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:0.0:1787857910.654738:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.654751:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.654761:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.654785:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857910.654897:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:2350:x1874704171893248:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 256us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.654906:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 473 00010000:00010000:3.0:1787857910.656521:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7ecd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd490a expref: 81 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.656558:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5856:1874704188307200:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857910.656595:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.656610:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.656616:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.657943:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.657976:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.657985:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.657993:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.657999:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.658010:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.658037:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:3.0:1787857910.658040:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857910.658046:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.658054:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed11 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.658332:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+81:33556:x1874704171892864:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 11865us (13073us total) trans 4294968382 rc 0/0 00000100:00100000:3.0:1787857910.658347:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1639 00000040:00080000:2.0:1787857910.659630:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857910.659646:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857910.660214:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 10 00000040:00080000:2.0:1787857910.660226:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857910.661759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.661987:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171893504 00000100:00100000:2.0:1787857910.662006:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171893504 00000100:00100000:2.0:1787857910.662096:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00100000:2.0:1787857910.662109:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+81:33556:x1874704171893504:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857910.662521:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33556:x1874704171893504:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 413us (780us total) trans 4294968383 rc 0/0 00000100:00100000:2.0:1787857910.662531:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 343 00000100:00100000:1.0:1787857910.665602:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.666169:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171893632 00000100:00100000:0.0:1787857910.666184:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171893632 00000100:00100000:0.0:1787857910.666280:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1640 00000100:00100000:0.0:1787857910.666303:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+115:33563:x1874704171893632:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857910.666339:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.666373:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ed18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd491f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.666510:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.666529:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.666544:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857910.666629:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:0.0:1787857910.666634:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857910.667126:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.667170:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ed18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 117 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.667194:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 116 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.667204:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.667207:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857910.667212:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6200, rc 0) 00000100:00100000:0.0:1787857910.667585:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+116:33563:x1874704171893632:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1292us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.667595:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1640 00000100:00100000:3.0:1787857910.671333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.671525:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171893760 00000100:00100000:2.0:1787857910.671541:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171893760 00000100:00100000:2.0:1787857910.671701:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 472 00000100:00100000:2.0:1787857910.671717:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+18:2347:x1874704171893760:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857910.671757:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.671790:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7ed26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4926 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.671930:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188307328:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857910.672103:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857910.676271:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188307328:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857910.676421:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7ed26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4926 expref: 19 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.676467:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7ed26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4926 expref: 19 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.676491:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6c00, rc 0) 00000100:00100000:2.0:1787857910.676683:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+18:2347:x1874704171893760:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4958us (5359us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857910.676696:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 472 00000100:00100000:3.0:1787857910.684371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.685160:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171894016 00000100:00100000:2.0:1787857910.685178:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171894016 00000100:00100000:2.0:1787857910.686089:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1641 00000100:00100000:2.0:1787857910.686110:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+116:33563:x1874704171894016:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:2.0:1787857910.686706:0:19301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].52, 136 off15264 00000100:00100000:2.0:1787857910.686919:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+116:33563:x1874704171894016:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 816us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.686933:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1641 00000100:00100000:3.0:1787857910.701052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.701711:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171894144 00000100:00100000:2.0:1787857910.701734:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171894144 00000100:00100000:2.0:1787857910.701938:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1642 00000100:00100000:2.0:1787857910.701949:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+116:33564:x1874704171894144:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857910.701985:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.702010:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7ed2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd492d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702114:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702138:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702153:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702171:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702178:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702185:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702275:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702286:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702303:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702310:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.702314:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702322:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702335:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.702338:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.702343:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702350:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702364:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702369:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702374:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702379:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.702383:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702389:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702394:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9998c4eb6300) 00010000:00010000:2.0:1787857910.702396:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.702398:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702402:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702439:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7ed2d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd492d expref: 117 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702449:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.702451:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.702454:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7ed2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd492d expref: 117 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.702461:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6c00, rc 0) 00000100:00100000:2.0:1787857910.702579:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+116:33564:x1874704171894144:12345-192.168.204.36@tcp:101:bash.0 Request processed in 632us (1554us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857910.702588:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1642 00000100:00100000:1.0:1787857910.721352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.721503:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.721952:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171894272 00000100:00100000:0.0:1787857910.721978:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171894272 00000100:00100000:2.0:1787857910.722166:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171894400 00000100:00100000:2.0:1787857910.722172:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171894400 00000100:00100000:0.0:1787857910.722249:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1643 00000100:00100000:0.0:1787857910.722264:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+83:33565:x1874704171894272:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:0.0:1787857910.722384:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.722415:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ed42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4934 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.722943:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.722977:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.722992:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.723013:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.723021:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.723028:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724170:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724183:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724191:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724198:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.724206:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724215:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724234:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.724238:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.724243:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724250:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7ed49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724267:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724274:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724280:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724286:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.724388:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724395:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724533:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9997c3d03e00) 00010000:00010000:0.0:1787857910.724537:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.724540:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724547:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724624:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ed42 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4934 expref: 84 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724639:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.724641:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.724645:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ed42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4934 expref: 84 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.724669:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7200, rc 0) 00000100:00100000:0.0:1787857910.725071:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+83:33565:x1874704171894272:12345-192.168.204.36@tcp:101:rm.0 Request processed in 2807us (3819us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.725084:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1643 00000100:00100000:3.0:1787857910.725617:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 87 00000100:00100000:3.0:1787857910.725638:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:2348:x1874704171894400:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:3.0:1787857910.726217:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.726250:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7ed57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd493b expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726335:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726355:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726369:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726394:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726401:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726408:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726493:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726501:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726592:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726600:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.726604:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726612:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726628:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.726632:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.726640:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726648:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ed5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726670:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726677:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726683:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726689:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fc200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.726692:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726700:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726969:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x21330256 (ffff9998d12ef600) 00010000:00010000:3.0:1787857910.726972:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.726976:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.726983:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ed65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.727031:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7ed57 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd493b expref: 83 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.727212:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.727216:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857910.727222:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7ed57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd493b expref: 83 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.727234:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fcc00, rc -2) 00000100:00100000:3.0:1787857910.727372:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:2348:x1874704171894400:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 1738us (5865us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857910.727384:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 87 00000100:00100000:1.0:1787857910.728458:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.732712:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171894528 00000100:00100000:2.0:1787857910.732736:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171894528 00000100:00100000:3.0:1787857910.733002:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1644 00000100:00100000:3.0:1787857910.733019:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33565:x1874704171894528:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1787857910.733342:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.733382:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7ed6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4942 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733523:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733548:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733567:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733595:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733603:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733612:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733729:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733738:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733759:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733766:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.733772:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733781:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733796:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.733799:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.733806:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733813:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd400/0xd3f183cab4a7ed73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733879:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733885:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733892:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733900:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.733904:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733911:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733921:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9998d12efc00) 00010000:00010000:3.0:1787857910.733924:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.733927:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733936:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ed7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.733996:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7ed6c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4942 expref: 83 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.734021:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.734024:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.734028:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7ed6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4942 expref: 83 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.734039:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd200, rc 0) 00000100:00100000:1.0:1787857910.734255:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33565:x1874704171894528:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1227us (5798us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857910.734270:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1644 00000100:00100000:1.0:1787857910.761076:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.761281:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171894656 00000100:00100000:2.0:1787857910.761293:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171894656 00000100:00100000:2.0:1787857910.761368:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1645 00000100:00100000:2.0:1787857910.761380:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33566:x1874704171894656:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857910.761408:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.761433:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7ed81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4949 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761514:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761532:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761546:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761563:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761570:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761577:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761671:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761680:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761693:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761699:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.761705:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761713:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761727:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.761731:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.761737:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761743:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ed88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761758:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761765:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761771:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761776:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.761778:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761789:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761796:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9998c4eb6300) 00010000:00010000:2.0:1787857910.761798:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.761801:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761806:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ed8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761894:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7ed81 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4949 expref: 83 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761905:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.761907:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.761911:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7ed81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4949 expref: 83 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.761921:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6c00, rc 0) 00000100:00100000:2.0:1787857910.762004:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33566:x1874704171894656:12345-192.168.204.36@tcp:101:cp.0 Request processed in 626us (943us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857910.762012:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1645 00000100:00100000:3.0:1787857910.774273:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.774691:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171894784 00000100:00100000:0.0:1787857910.774707:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171894784 00000100:00100000:0.0:1787857910.774802:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1646 00000100:00100000:0.0:1787857910.774839:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33566:x1874704171894784:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857910.774876:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.774911:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ed96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4950 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.775043:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.775735:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.775762:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.775788:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.775795:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.775802:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777296:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777320:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777329:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777338:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.777347:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777358:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777382:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.777629:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.777639:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777648:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7ed9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777675:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777682:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777688:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777693:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.777696:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777702:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777712:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9997c3d03e00) 00010000:00010000:0.0:1787857910.777715:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.777719:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777725:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7eda4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.777812:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ed96 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4950 expref: 83 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.778024:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.778027:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.778032:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ed96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4950 expref: 83 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.778046:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7200, rc 0) 00000100:00100000:0.0:1787857910.778162:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33566:x1874704171894784:12345-192.168.204.36@tcp:101:cp.0 Request processed in 3348us (3923us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.778173:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1646 00000100:00100000:3.0:1787857910.797741:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.798212:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171895040 00000100:00100000:1.0:1787857910.798233:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171895040 00000100:00100000:1.0:1787857910.798346:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1647 00000100:00100000:1.0:1787857910.798362:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+82:33566:x1874704171895040:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857910.798399:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.798437:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7edab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4957 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.798736:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.798760:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 115 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.798777:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.798904:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 115 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.798921:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 115 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.798940:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188307456:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857910.799105:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857910.807109:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188307456:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857910.807164:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857910.811103:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.811382:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171895168 00000100:00100000:2.0:1787857910.811575:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171895168 00010000:00010000:2.0:1787857910.811777:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 116 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.811945:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 474 00000100:00100000:2.0:1787857910.811973:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+116:2350:x1874704171895168:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857910.812009:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857910.812019:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 116 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.812037:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 116 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.812072:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ed1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd491f expref: 116 pid: 5857 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.812107:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.812115:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.812129:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.812140:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.812192:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857910.812298:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:365dae28-8203-4526-83a5-01baf5c55d8b+115:2350:x1874704171895168:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 343us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.812307:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 474 00010000:00010000:3.0:1787857910.813112:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.813128:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.813171:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.813187:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.813198:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857910.814752:0:19301:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:3.0:1787857910.815108:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815131:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815144:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815196:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815205:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815218:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815226:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.815231:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815241:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815259:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857910.815262:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.815272:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.815280:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7edb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857910.815301:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a379e49 reply state 00000000c5c53639 transno 4294968384 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.815314:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857910.815793:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7edab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 85 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.816071:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 84 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.816083:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857910.816086:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857910.816089:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090a00, rc 0) 00000100:00100000:2.0:1787857910.816293:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33566:x1874704171895040:12345-192.168.204.36@tcp:101:cp.0 Request processed in 17932us (18562us total) trans 4294968384 rc 0/0 00000100:00100000:2.0:1787857910.816308:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1647 00010000:00010000:3.0:1787857910.824149:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.824176:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.824187:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.824202:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6090200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857910.824209:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.824220:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.824249:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9998d12efc00) 00010000:00010000:3.0:1787857910.824253:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857910.824260:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.824268:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7edb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.829758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857910.830018:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171895296 00000100:00100000:1.0:1787857910.830034:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171895296 00000100:00100000:1.0:1787857910.830131:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 473 00000100:00100000:1.0:1787857910.830146:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2349:x1874704171895296:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857910.830177:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857910.830214:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd495e expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857910.830254:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857910.830287:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1787857910.830293:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857910.830307:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 21 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.830338:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 21 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857910.830357:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaec200, rc 0) 00000100:00100000:1.0:1787857910.830457:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2349:x1874704171895296:12345-192.168.204.36@tcp:101:cp.0 Request processed in 314us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857910.830467:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 473 00000100:00100000:1.0:1787857910.839574:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.840457:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171895424 00000100:00100000:3.0:1787857910.840780:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171895424 00000100:00100000:2.0:1787857910.841196:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 474 00000100:00100000:2.0:1787857910.841214:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:33566:x1874704171895424:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857910.841249:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.841281:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4965 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.841353:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 22 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.841368:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.841375:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857910.841382:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 22 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.841455:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 22 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.841499:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 22 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.841524:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188307584:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857910.841906:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857910.849352:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188307584:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857910.849561:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 22 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.849609:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6c00, rc 0) 00000100:00100000:2.0:1787857910.850242:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:33566:x1874704171895424:12345-192.168.204.36@tcp:101:cp.0 Request processed in 9027us (10855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.850264:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 474 00000100:00100000:1.0:1787857910.851906:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.852928:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171895552 00000100:00100000:3.0:1787857910.852947:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171895552 00010000:00010000:3.0:1787857910.853039:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 22 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.853110:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 475 00000100:00100000:3.0:1787857910.853123:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2349:x1874704171895552:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857910.853148:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857910.853185:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 22 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.853211:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 22 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.853264:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a342ae43/0xd3f183cab4a7edce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd495e expref: 22 pid: 6711 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.853292:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857910.853298:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857910.853311:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 21 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.853324:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 21 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857910.853586:0:17347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 21 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857910.853612:0:17347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990151de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17347:1874704188307712:192.168.204.36@tcp:105: 00000100:00100000:3.0:1787857910.853777:0:17347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857910.858016:0:17347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990151de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17347:1874704188307712:192.168.204.36@tcp:105: 00010000:00010000:3.0:1787857910.858066:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857910.858168:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2349:x1874704171895552:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5047us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857910.858185:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 475 00000100:00100000:1.0:1787857910.862080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.864144:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171895808 00000100:00100000:2.0:1787857910.864174:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171895808 00000100:00100000:2.0:1787857910.864315:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 344 00000100:00100000:2.0:1787857910.864331:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+84:33566:x1874704171895808:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:2.0:1787857910.869105:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33566:x1874704171895808:12345-192.168.204.36@tcp:35:cp.0 Request processed in 4754us (7024us total) trans 4294968385 rc 0/0 00000100:00100000:2.0:1787857910.869129:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 344 00000100:00100000:1.0:1787857910.901541:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.902510:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171895936 00000100:00100000:0.0:1787857910.902532:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171895936 00000100:00100000:0.0:1787857910.902723:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 88 00000100:00100000:0.0:1787857910.902740:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:2348:x1874704171895936:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:0.0:1787857910.902874:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.902909:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7eddc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd496c expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903026:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903053:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903069:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903088:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903096:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903103:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903216:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903226:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903235:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903243:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.903260:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903271:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903291:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.903296:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.903304:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903313:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ede3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903333:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903340:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903346:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903352:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.903356:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903362:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903370:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x21330256 (ffff9997c3d03e00) 00010000:00010000:0.0:1787857910.903373:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.903376:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903381:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7edea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903426:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7eddc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd496c expref: 86 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903440:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.903443:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857910.903447:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6600/0xd3f183cab4a7eddc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd496c expref: 86 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.903460:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6600, rc -2) 00000100:00100000:0.0:1787857910.903578:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:2348:x1874704171895936:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 842us (2057us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857910.903588:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 88 00000100:00100000:1.0:1787857910.925658:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857910.926200:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171896064 00000100:00100000:3.0:1787857910.926223:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171896064 00000100:00100000:3.0:1787857910.926357:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1648 00000100:00100000:3.0:1787857910.926371:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+115:33569:x1874704171896064:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857910.926418:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857910.926451:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7edf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4973 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.927634:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.927741:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.927763:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.927786:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.927794:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.927800:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928045:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7ee06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928054:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7ee06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928061:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7ee06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857910.928117:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x36:0x0]: returning size 158 00000004:00200000:2.0:1787857910.928125:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857910.928157:0:5858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7ee06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928172:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7ee06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928181:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928192:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928200:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928207:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.928212:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928222:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928237:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857910.928240:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.928257:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928264:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7edf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928283:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928297:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928304:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928309:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857910.928313:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928319:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928326:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9998c4eb6300) 00010000:00010000:2.0:1787857910.928329:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857910.928332:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928347:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7edff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928408:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7edf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4973 expref: 117 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928432:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7ee06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4973 expref: 116 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.928440:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857910.928443:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857910.928446:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6800, rc 0) 00000100:00100000:2.0:1787857910.929362:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+116:33569:x1874704171896064:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2980us (3724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.929375:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1648 00000100:00100000:2.0:1787857910.938236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.938428:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.938687:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171896320 00000100:00100000:0.0:1787857910.938703:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171896320 00000100:00100000:0.0:1787857910.938800:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 89 00000100:00100000:0.0:1787857910.938813:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+116:2349:x1874704171896320:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:0.0:1787857910.938926:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.938966:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ee0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4981 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939054:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939076:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939091:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939114:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939123:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939129:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939228:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939237:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939254:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939261:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.939267:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939275:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939290:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.939293:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.939299:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939305:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939322:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939329:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939335:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939339:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857910.939342:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939349:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939356:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff9997c3d03e00) 00010000:00010000:0.0:1787857910.939359:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857910.939362:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939369:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939406:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ee0d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4981 expref: 117 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939419:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.939421:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857910.939425:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ee0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4981 expref: 117 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.939442:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7a00, rc -2) 00000100:00100000:0.0:1787857910.939563:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+116:2349:x1874704171896320:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 751us (1133us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857910.939573:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 89 00000100:00100000:3.0:1787857910.945019:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171896192 00000100:00100000:3.0:1787857910.945043:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171896192 00000100:00100000:2.0:1787857910.945336:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 475 00000100:00100000:2.0:1787857910.945351:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171896192:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1787857910.945381:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857910.945409:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034fde9d0/0xd3f183cab4a7ee22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd497a expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857910.945518:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188307840:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857910.947543:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7b65000 going to sleep for 11 seconds 00002000:00010000:2.0:1787857910.951295:0:22727:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857910.951313:0:22727:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb mtime: 0 -> 1787857910 00002000:00010000:2.0:1787857910.951316:0:22727:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb atime: 0 -> 1787857910 00002000:00010000:2.0:1787857910.951319:0:22727:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb ctime: 0 -> 1787857910 00000100:00100000:2.0:1787857910.951369:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188307840:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857910.951440:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034fde9d0/0xd3f183cab4a7ee22 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd497a expref: 17 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.951482:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034fde9d0/0xd3f183cab4a7ee22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd497a expref: 17 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857910.951504:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6e00, rc 0) 00000100:00100000:2.0:1787857910.951637:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171896192:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 6288us (13422us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857910.952324:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 475 00000100:00100000:1.0:1787857910.960594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.960843:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171896448 00000100:00100000:0.0:1787857910.960861:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171896448 00000100:00100000:0.0:1787857910.960971:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1649 00000100:00100000:0.0:1787857910.960986:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+116:33569:x1874704171896448:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857910.961028:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.961066:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ee29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49b9 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.961219:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.961244:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.961266:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857910.961374:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:0.0:1787857910.961379:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 9 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857910.961410:0:5857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.961456:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ee29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 118 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.961489:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 117 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.961499:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857910.961503:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857910.961508:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7600, rc 0) 00000100:00100000:0.0:1787857910.961620:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3041680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+117:33569:x1874704171896448:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 638us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857910.961630:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1649 00000100:00100000:1.0:1787857910.975280:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857910.975514:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171896576 00000100:00100000:0.0:1787857910.975531:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171896576 00000100:00100000:0.0:1787857910.975926:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 476 00000100:00100000:0.0:1787857910.975944:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171896576:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1787857910.975992:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857910.976027:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ee37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49c0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857910.976156:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188307968:192.168.204.36@tcp:106: 00000100:00100000:0.0:1787857910.976333:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857910.983009:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6711:1874704188307968:192.168.204.36@tcp:106: 00010000:00010000:0.0:1787857910.983098:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ee37 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49c0 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.983141:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ee37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49c0 expref: 17 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857910.983162:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7a00, rc 0) 00000100:00100000:0.0:1787857910.983261:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171896576:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 7320us (8008us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857910.983275:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 476 00000100:00100000:1.0:1787857910.991029:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857910.991600:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171896832 00000100:00100000:2.0:1787857910.991617:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171896832 00000100:00100000:2.0:1787857910.991786:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1650 00000100:00100000:2.0:1787857910.991800:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+117:33569:x1874704171896832:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:2.0:1787857910.992924:0:19301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].53, 136 off15400 00000100:00100000:2.0:1787857910.993122:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+117:33569:x1874704171896832:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 1318us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857910.993137:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1650 00000100:00100000:1.0:1787857911.000905:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.002790:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171896960 00000100:00100000:2.0:1787857911.002858:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171896960 00000100:00100000:2.0:1787857911.003008:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1651 00000100:00100000:2.0:1787857911.003025:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+117:33572:x1874704171896960:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1787857911.003069:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857911.003112:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ee3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49c7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003234:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003257:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003274:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003295:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003302:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003308:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.003390:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857911.003448:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003458:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003549:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003559:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.003565:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003575:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003594:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.003597:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.003604:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003611:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ee45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003631:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003638:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003645:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003652:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.003656:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003662:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003670:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff9998c4eb6300) 00010000:00010000:2.0:1787857911.003673:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.003676:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003683:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ee4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003738:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ee3e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49c7 expref: 118 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003751:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.003753:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.003757:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7ee3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49c7 expref: 118 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.003768:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6e00, rc 0) 00000100:00100000:3.0:1787857911.003840:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171897088 00000100:00100000:3.0:1787857911.003849:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171897088 00000100:00100000:3.0:1787857911.003912:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00100000:2.0:1787857911.003914:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+118:33572:x1874704171896960:12345-192.168.204.36@tcp:101:bash.0 Request processed in 895us (3032us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857911.003921:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+118:2349:x1874704171897088:12345-192.168.204.36@tcp:63:ll_sa.0 00000100:00100000:2.0:1787857911.003924:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1651 00010000:00010000:3.0:1787857911.003967:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857911.003982:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ee53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49ce expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.004027:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.004038:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.004048:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.004068:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.004392:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.004401:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009228:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009261:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009273:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009282:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c6091a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.009290:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009299:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009328:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.009346:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.009354:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009362:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091a00/0xd3f183cab4a7ee5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009386:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009394:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009400:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009406:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c0030200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.009410:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009417:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009426:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xae1c5c33 (ffff9998d12efc00) 00010000:00010000:2.0:1787857911.009429:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.009432:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009439:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0030200/0xd3f183cab4a7ee61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009536:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ee53 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ce expref: 118 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009551:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.009553:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787857911.009558:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090200/0xd3f183cab4a7ee53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ce expref: 118 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.009572:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c6090200, rc -2) 00000100:00100000:2.0:1787857911.009728:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+117:2349:x1874704171897088:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 5806us (6336us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857911.009743:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00100000:1.0:1787857911.014676:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.015916:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171897216 00000100:00100000:2.0:1787857911.015935:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171897216 00000100:00100000:2.0:1787857911.016052:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1652 00000100:00100000:2.0:1787857911.016065:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33573:x1874704171897216:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857911.016104:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857911.016139:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7ee68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49d5 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016285:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016305:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016321:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016354:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016363:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016371:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016486:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016496:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016503:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016510:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.016515:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016526:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016542:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.016545:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.016550:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016558:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016574:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016581:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016587:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016591:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.016594:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016600:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016606:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff9997c3cb1b00) 00010000:00010000:2.0:1787857911.016608:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.016611:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016617:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016662:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7ee68 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49d5 expref: 86 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016673:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.016676:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.016681:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7ee68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49d5 expref: 86 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.016693:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7800, rc 0) 00000100:00100000:2.0:1787857911.016860:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33573:x1874704171897216:12345-192.168.204.36@tcp:101:rm.0 Request processed in 755us (2174us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857911.016870:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1652 00000100:00100000:1.0:1787857911.031208:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.031363:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171897344 00000100:00100000:2.0:1787857911.031382:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171897344 00000100:00100000:2.0:1787857911.031494:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1653 00000100:00100000:2.0:1787857911.031507:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33573:x1874704171897344:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857911.031543:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857911.031575:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7ee7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49dc expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.031766:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.031793:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.031810:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.031888:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.031896:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.031903:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032023:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032032:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032040:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032048:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.032055:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032065:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032084:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.032089:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.032095:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032103:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7ee84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032120:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032127:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032133:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032138:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.032140:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032146:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032154:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff9997c3cb1b00) 00010000:00010000:2.0:1787857911.032156:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.032159:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032164:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ee8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032213:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7ee7d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49dc expref: 86 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032227:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.032230:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.032234:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7ee7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49dc expref: 86 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.032244:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7800, rc 0) 00000100:00100000:2.0:1787857911.032365:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33573:x1874704171897344:12345-192.168.204.36@tcp:101:rm.0 Request processed in 861us (1178us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857911.032374:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1653 00000100:00100000:3.0:1787857911.050779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.051219:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171897472 00000100:00100000:0.0:1787857911.051239:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171897472 00000100:00100000:0.0:1787857911.051364:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1654 00000100:00100000:0.0:1787857911.051380:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33574:x1874704171897472:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857911.051422:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857911.051463:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ee92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49e3 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051593:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051615:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051635:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051673:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051683:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051690:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051809:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051868:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051876:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051883:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857911.051888:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051897:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051916:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857911.051919:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857911.051926:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051932:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7ee99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051960:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051966:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051972:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051979:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857911.051983:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051988:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.051995:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff9997c3d03e00) 00010000:00010000:0.0:1787857911.051997:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857911.052000:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.052006:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6e00/0xd3f183cab4a7eea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.052054:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ee92 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49e3 expref: 86 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.052066:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857911.052069:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857911.052073:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7a00/0xd3f183cab4a7ee92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49e3 expref: 86 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.052083:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7a00, rc 0) 00000100:00100000:0.0:1787857911.052190:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33574:x1874704171897472:12345-192.168.204.36@tcp:101:cp.0 Request processed in 814us (1436us total) trans 0 rc 301/301 00000100:00100000:0.0:1787857911.052199:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1654 00000100:00100000:3.0:1787857911.059628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.059860:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171897600 00000100:00100000:1.0:1787857911.059879:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171897600 00000100:00100000:1.0:1787857911.060002:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1655 00000100:00100000:1.0:1787857911.060020:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33574:x1874704171897600:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:1.0:1787857911.060058:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857911.060093:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7eea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49ea expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060268:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060305:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060323:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060346:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060354:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060363:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060477:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060485:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060493:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060500:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857911.060505:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060519:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060535:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857911.060538:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857911.060545:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060551:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed400/0xd3f183cab4a7eeae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060568:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060575:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060581:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060586:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaede00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857911.060589:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060595:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060602:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff9998c3379d00) 00010000:00010000:1.0:1787857911.060604:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857911.060607:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060618:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7eeb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060666:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7eea7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ea expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060678:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857911.060680:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857911.060684:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7eea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ea expref: 86 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.060696:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaeda00, rc 0) 00000100:00100000:1.0:1787857911.060813:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33574:x1874704171897600:12345-192.168.204.36@tcp:101:cp.0 Request processed in 798us (1204us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857911.060928:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1655 00000100:00100000:1.0:1787857911.066023:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.066171:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171897856 00000100:00100000:2.0:1787857911.066186:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171897856 00000100:00100000:2.0:1787857911.066286:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1656 00000100:00100000:2.0:1787857911.066318:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+85:33574:x1874704171897856:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:2.0:1787857911.066358:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857911.066394:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7eebc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49f1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.066996:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.067021:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 116 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.067032:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.067085:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 116 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.067108:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 116 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857911.067133:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188308096:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857911.067268:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c71a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857911.075192:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.075444:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171897984 00000100:00100000:1.0:1787857911.075462:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171897984 00010000:00010000:1.0:1787857911.075539:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 117 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.075601:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 476 00000100:00100000:1.0:1787857911.075614:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+117:2349:x1874704171897984:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857911.075640:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857911.075764:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 117 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.075788:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 117 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.075957:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857911.075967:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.075982:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.075992:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.076021:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857911.077607:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+117:2349:x1874704171897984:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1979us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857911.077624:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 476 00010000:00010000:2.0:1787857911.078685:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7ee30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49b9 expref: 116 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857911.078724:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188308096:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857911.078781:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.078794:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.078801:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.078895:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.078916:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.078932:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857911.081898:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:2.0:1787857911.082273:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7eed1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082367:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7eed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082385:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7eed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082452:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082461:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082470:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082478:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.082485:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082494:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082513:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:2.0:1787857911.082517:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857911.082524:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082532:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7eec3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857911.082562:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003318ddff reply state 00000000686fb30d transno 4294968386 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857911.082577:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857911.082643:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7800/0xd3f183cab4a7eebc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f1 expref: 88 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082678:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6e00/0xd3f183cab4a7eed1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f1 expref: 87 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.082686:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9997c3cb1900) 00010000:00010000:2.0:1787857911.082689:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857911.082692:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6e00, rc 0) 00000100:00100000:2.0:1787857911.082896:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+88:33574:x1874704171897856:12345-192.168.204.36@tcp:101:cp.0 Request processed in 16582us (16892us total) trans 4294968386 rc 0/0 00000100:00100000:2.0:1787857911.082908:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1656 00010000:00010000:0.0:1787857911.089268:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.089299:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.089308:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.089314:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857911.089321:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.089331:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.089359:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff9997c3cb1b00) 00010000:00010000:0.0:1787857911.089364:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857911.089372:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.089379:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7c00/0xd3f183cab4a7eeca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.093440:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.093853:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171898112 00000100:00100000:3.0:1787857911.093868:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171898112 00000100:00100000:3.0:1787857911.093965:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 477 00000100:00100000:3.0:1787857911.093977:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+18:2347:x1874704171898112:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:3.0:1787857911.094002:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857911.094031:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49f8 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857911.094070:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857911.094100:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1787857911.094106:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857911.094118:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 19 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.094148:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 19 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.094174:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd400, rc 0) 00000100:00100000:3.0:1787857911.094271:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2347:x1874704171898112:12345-192.168.204.36@tcp:101:cp.0 Request processed in 296us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.094280:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 477 00000100:00100000:2.0:1787857911.101737:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.102146:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171898240 00000100:00100000:0.0:1787857911.102164:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171898240 00000100:00100000:0.0:1787857911.102414:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 478 00000100:00100000:0.0:1787857911.102431:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:33574:x1874704171898240:12345-192.168.204.36@tcp:101:cp.0 00010000:00010000:0.0:1787857911.102465:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857911.102500:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd49ff expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.102565:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 20 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.102577:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.102583:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.102590:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 20 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.102659:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 20 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.102677:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 20 pid: 8490 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.102697:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188308224:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857911.102918:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857911.108144:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188308224:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857911.108217:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 20 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.108264:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6e00, rc 0) 00000100:00100000:0.0:1787857911.108389:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:33574:x1874704171898240:12345-192.168.204.36@tcp:101:cp.0 Request processed in 5962us (6747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.108403:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 478 00000100:00100000:1.0:1787857911.108572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.108958:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171898368 00000100:00100000:0.0:1787857911.108969:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171898368 00010000:00010000:0.0:1787857911.109037:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 20 pid: 8490 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.109092:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 477 00000100:00100000:0.0:1787857911.109104:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2350:x1874704171898368:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857911.109128:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857911.109169:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 20 pid: 8490 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.109185:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 20 pid: 8490 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.109230:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7eedf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49f8 expref: 20 pid: 8490 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.109256:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.109262:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.109276:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 19 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.109304:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 19 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.109365:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 19 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.109387:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188308352:192.168.204.36@tcp:105: 00000100:00100000:0.0:1787857911.109503:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857911.128794:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.129053:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171898624 00000100:00100000:2.0:1787857911.129067:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171898624 00000100:00100000:2.0:1787857911.129164:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 345 00000100:00100000:2.0:1787857911.129177:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+87:33574:x1874704171898624:12345-192.168.204.36@tcp:35:cp.0 00000100:00100000:2.0:1787857911.129788:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+88:33574:x1874704171898624:12345-192.168.204.36@tcp:35:cp.0 Request processed in 609us (1008us total) trans 4294968387 rc 0/0 00000100:00100000:2.0:1787857911.129802:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 345 00000100:00100000:0.0:1787857911.130930:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5842:1874704188308352:192.168.204.36@tcp:105: 00010000:00010000:0.0:1787857911.131000:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857911.131076:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2350:x1874704171898368:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 21973us (22506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.131091:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 477 00000100:00100000:1.0:1787857911.195849:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.196568:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171898752 00000100:00100000:3.0:1787857911.196595:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171898752 00000100:00100000:3.0:1787857911.196732:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1657 00000100:00100000:3.0:1787857911.196747:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+116:33577:x1874704171898752:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857911.196785:0:7656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857911.197473:0:7656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7eeed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a06 expref: -99 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.197617:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.197640:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.199068:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.199110:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.199125:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.199132:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.199283:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ef02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.199310:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ef02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.199318:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ef02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857911.201129:0:7656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 158 00000004:00200000:3.0:1787857911.201147:0:7656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857911.201193:0:7656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ef02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201220:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ef02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201235:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201243:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201251:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201258:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857911.201264:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201273:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201310:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857911.201314:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857911.201320:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201711:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7eef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201746:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201753:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201759:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201765:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fc200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857911.201768:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201773:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201784:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff9998d12ef300) 00010000:00010000:3.0:1787857911.201786:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857911.201790:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201796:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7eefb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.201979:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7eeed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a06 expref: 118 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.202007:0:7656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd800/0xd3f183cab4a7ef02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a06 expref: 117 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.202016:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9997c3cb1900) 00010000:00010000:3.0:1787857911.202018:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857911.202021:0:7656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd800, rc 0) 00000100:00100000:3.0:1787857911.202166:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+117:33577:x1874704171898752:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 5420us (6380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.202178:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1657 00000100:00100000:2.0:1787857911.222451:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.222660:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171898880 00000100:00100000:1.0:1787857911.222678:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171898880 00000100:00100000:1.0:1787857911.222767:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 479 00000100:00100000:1.0:1787857911.222780:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171898880:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1787857911.222811:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857911.222865:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7ef09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a0d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.222992:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b012c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188308480:192.168.204.36@tcp:106: 00000100:00100000:1.0:1787857911.223149:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70fecc0 going to sleep for 11 seconds 00002000:00010000:2.0:1787857911.228167:0:6714:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787857911.228185:0:6714:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime: 0 -> 1787857910 00002000:00010000:2.0:1787857911.228188:0:6714:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb atime: 0 -> 1787857910 00002000:00010000:2.0:1787857911.228191:0:6714:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime: 0 -> 1787857910 00000100:00100000:2.0:1787857911.229194:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b012c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6714:1874704188308480:192.168.204.36@tcp:106: 00010000:00010000:2.0:1787857911.229511:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7ef09 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a0d expref: 19 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.229554:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e08b5482/0xd3f183cab4a7ef09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a0d expref: 19 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.229573:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaeca00, rc 0) 00000100:00100000:2.0:1787857911.229714:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171898880:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 6935us (7279us total) trans 0 rc 301/301 00000100:00100000:2.0:1787857911.229727:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 479 00000100:00100000:1.0:1787857911.236582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.236756:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171899008 00000100:00100000:3.0:1787857911.236771:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171899008 00000100:00100000:3.0:1787857911.236890:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1658 00000100:00100000:3.0:1787857911.236902:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+117:33577:x1874704171899008:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857911.236932:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857911.236970:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7ef10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a14 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.237719:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ef17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.237743:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ef17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.237759:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ef17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857911.237883:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:3.0:1787857911.237887:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857911.237916:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ef17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.237966:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7ef10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a14 expref: 119 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.237991:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ef17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a14 expref: 118 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.238002:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857911.238005:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857911.238009:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fc200, rc 0) 00000100:00100000:3.0:1787857911.238104:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+118:33577:x1874704171899008:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1205us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.238113:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1658 00000100:00100000:1.0:1787857911.254518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.254733:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171899136 00000100:00100000:3.0:1787857911.254751:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171899136 00000100:00100000:3.0:1787857911.255496:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00100000:3.0:1787857911.255514:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171899136:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1787857911.255547:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857911.255581:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7ef1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a1b expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.256627:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188308608:192.168.204.36@tcp:106: 00000100:00100000:2.0:1787857911.258087:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84540 going to sleep for 11 seconds 00000001:00080000:1.0:1787857911.276426:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967379 is committed 00000100:00100000:3.0:1787857911.285704:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188308608:192.168.204.36@tcp:106: 00010000:00010000:3.0:1787857911.285760:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7ef1e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a1b expref: 19 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.285794:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002bc5e58/0xd3f183cab4a7ef1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a1b expref: 19 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.285853:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fcc00, rc 0) 00000100:00100000:3.0:1787857911.285980:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+18:2349:x1874704171899136:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 30470us (31480us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857911.285990:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00100000:1.0:1787857911.296224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.296362:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171899392 00000100:00100000:2.0:1787857911.296379:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171899392 00000100:00100000:2.0:1787857911.296466:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1659 00000100:00100000:2.0:1787857911.296480:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+118:33577:x1874704171899392:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:3.0:1787857911.302487:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].54, 136 off15536 00000100:00100000:3.0:1787857911.302795:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+118:33577:x1874704171899392:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 6308us (6722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.302810:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1659 00010000:00010000:2.0:1787857911.535120:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857911.664708:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857911.664749:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188308736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857911.664918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857911.665028:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188308736 00000100:00100000:3.0:1787857911.665039:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188308736 00000100:00100000:3.0:1787857911.665135:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787857911.665148:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188308736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857911.665206:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 100335616 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857911.665271:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188308736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.665284:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:3.0:1787857911.665313:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857911.665372:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188308736:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787857911.668581:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857911.668595:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857911.671234:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 13 00000040:00080000:3.0:1787857911.671260:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857911.671912:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188308864:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857911.672065:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857911.675451:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac1a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11703:1874704188308864:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857911.681396:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.681437:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.681481:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.681521:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171899520 00000100:00100000:3.0:1787857911.681535:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171899520 00000100:00100000:3.0:1787857911.681619:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171899648 00000100:00100000:3.0:1787857911.681622:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171899648 00000100:00100000:3.0:1787857911.681644:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1660 00000100:00100000:3.0:1787857911.681666:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+89:33587:x1874704171899520:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857911.681734:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857911.681934:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+89:33587:x1874704171899520:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 280us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.681956:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1660 00000100:00100000:3.0:1787857911.681977:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171899776 00000100:00100000:3.0:1787857911.681980:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171899776 00000100:00100000:3.0:1787857911.681998:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1661 00000100:00100000:3.0:1787857911.682005:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+89:33588:x1874704171899648:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857911.682019:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x36:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857911.682061:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+89:33588:x1874704171899648:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 56us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.682067:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1661 00000100:00100000:3.0:1787857911.682078:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1662 00000100:00100000:3.0:1787857911.682085:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+88:33589:x1874704171899776:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857911.682098:0:7656:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857911.682137:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+88:33589:x1874704171899776:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 52us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.682143:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1662 00000100:00100000:3.0:1787857911.690230:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.690291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.691334:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171900032 00000100:00100000:2.0:1787857911.691350:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171900032 00000100:00100000:2.0:1787857911.691510:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171900288 00000100:00100000:2.0:1787857911.691516:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171900288 00000100:00100000:2.0:1787857911.691550:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1663 00000100:00100000:2.0:1787857911.691563:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+89:33588:x1874704171900032:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857911.691600:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787857911.691952:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1664 00000100:00100000:3.0:1787857911.691965:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+89:33589:x1874704171900288:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857911.691975:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857911.691988:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7ef2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a29 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.692606:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7ef33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.692644:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7ef33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.692660:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7ef33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857911.692676:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 158 00010000:00010000:3.0:1787857911.692908:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fd200/0xd3f183cab4a7ef2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a29 expref: 92 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.692931:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7ef33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a29 expref: 91 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.692952:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9997c3cb1900) 00010000:00010000:3.0:1787857911.692956:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857911.692959:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fcc00, rc 0) 00000100:00100000:3.0:1787857911.693046:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+91:33589:x1874704171900288:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1085us (2754us total) trans 4294968388 rc 0/0 00000100:00100000:3.0:1787857911.693069:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1664 00000100:00100000:3.0:1787857911.693201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1787857911.694010:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ef25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a22 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.694226:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ef41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.694244:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ef41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.694259:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ef41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857911.694270:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x36:0x0]: returning size 158 00010000:00010000:2.0:1787857911.695233:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6400/0xd3f183cab4a7ef25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a22 expref: 93 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.695264:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ef41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a22 expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.695275:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857911.695278:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857911.695283:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6000, rc 0) 00000100:00100000:2.0:1787857911.695377:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33588:x1874704171900032:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3815us (5162us total) trans 4294968389 rc 0/0 00000100:00100000:2.0:1787857911.695388:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1663 00000100:00100000:2.0:1787857911.697052:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171900544 00000100:00100000:2.0:1787857911.697987:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171900544 00000100:00100000:2.0:1787857911.699491:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1665 00000100:00100000:2.0:1787857911.699515:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33587:x1874704171900544:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857911.699550:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857911.699589:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ef4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a30 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.699846:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ef56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.699865:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ef56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.702146:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ef56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857911.702180:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x35:0x0]: returning size 158 00010000:00010000:2.0:1787857911.703792:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7e00/0xd3f183cab4a7ef4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a30 expref: 95 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.703853:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ef56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a30 expref: 94 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.703876:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:2.0:1787857911.703880:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857911.703886:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7600, rc 0) 00000100:00100000:2.0:1787857911.704020:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:33587:x1874704171900544:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 4512us (10817us total) trans 4294968390 rc 0/0 00000100:00100000:2.0:1787857911.704032:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1665 00000100:00100000:3.0:1787857911.705343:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.705396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.705433:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171900672 00000100:00100000:0.0:1787857911.705445:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171900672 00000100:00100000:0.0:1787857911.705521:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:0.0:1787857911.705535:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:2350:x1874704171900672:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857911.705556:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857911.705590:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7ef33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a29 expref: 94 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.705616:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9997c3cb1900) 00010000:00010000:0.0:1787857911.705622:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857911.705808:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+93:2350:x1874704171900672:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 275us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.705841:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:2.0:1787857911.705842:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171900800 00000100:00100000:2.0:1787857911.705848:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171900800 00000100:00100000:2.0:1787857911.705899:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:2.0:1787857911.705908:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+19:2348:x1874704171900800:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857911.705971:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.705996:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 19 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.706007:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857911.706012:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857911.706017:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.706074:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 19 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.706092:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 19 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857911.706111:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22727:1874704188308992:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857911.706201:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff999900e199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857911.712299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.712350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.712369:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.712500:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171900928 00000100:00100000:2.0:1787857911.712513:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171900928 00000100:00100000:2.0:1787857911.712599:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:2.0:1787857911.712612:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+20:2347:x1874704171900928:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787857911.712707:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.712739:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 20 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.712751:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787857911.712757:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857911.712762:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.712786:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171901056 00000100:00100000:1.0:1787857911.712791:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171901056 00010000:00010000:2.0:1787857911.712848:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 20 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.712858:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171901184 00000100:00100000:1.0:1787857911.712861:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171901184 00010000:00010000:2.0:1787857911.712865:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 20 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.712882:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:1.0:1787857911.712890:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:2347:x1874704171901056:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857911.712903:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857911.712947:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7ef56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a30 expref: 94 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.712971:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857911.712978:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857911.713029:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188309120:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857911.713063:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+93:2347:x1874704171901056:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 174us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857911.713071:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:2.0:1787857911.713100:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6e36a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857911.713135:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:1.0:1787857911.713143:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:2349:x1874704171901184:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857911.713152:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857911.713164:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7ef41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a22 expref: 92 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.713176:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:1.0:1787857911.713179:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857911.713199:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+91:2349:x1874704171901184:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 58us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857911.713205:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:1.0:1787857911.713627:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.713741:0:18391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171901312 00000100:00100000:0.0:1787857911.713748:0:18391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171901312 00002000:00100000:0.0:1787857911.713795:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24:0x0] (0->157) req@ffff9997c5b00f00 x1874704171901312/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 648/0 e 0 to 0 dl 1787857922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857911.713808:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5b00f00 with x1874704171901312 ext(0->157) 00010000:00010000:0.0:1787857911.713835:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 21 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.713849:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 21 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857911.713856:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9997c5b00f00 00000100:00100000:3.0:1787857911.713866:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22727:1874704188308992:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857911.713880:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:0.0:1787857911.713887:0:18391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2348:x1874704171901312:12345-192.168.204.36@tcp:4:cp.0 00010000:00010000:3.0:1787857911.713908:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.714602:0:18391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2348:x1874704171901312:12345-192.168.204.36@tcp:4:cp.0 Request processed in 708us (971us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787857911.714615:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00002000:00100000:0.0:1787857911.714625:0:18391:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24:0x0] (0->157) req@ffff9997c5b00f00 x1874704171901312/t4294967394(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 648/448 e 0 to 0 dl 1787857922 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857911.714634:0:18391:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5b00f00 with x1874704171901312 ext(0->157) 00010000:00010000:0.0:1787857911.714643:0:18391:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 23 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.714667:0:18391:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 23 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857911.714681:0:18391:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9997c5b00f00 00000100:00100000:1.0:1787857911.729966:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.730119:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171901440 00000100:00100000:3.0:1787857911.730134:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171901440 00000100:00100000:3.0:1787857911.730223:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 483 00000100:00100000:3.0:1787857911.730237:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171901440:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857911.730315:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.730327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857911.730346:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.730357:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857911.730362:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857911.730368:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.730409:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:3.0:1787857911.730436:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 13 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.730453:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 13 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.730472:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188309248:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857911.730611:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857911.730644:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171901568 00000100:00100000:3.0:1787857911.730648:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171901568 00010000:00010000:3.0:1787857911.730677:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 23 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.730707:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 478 00000100:00100000:3.0:1787857911.730713:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2347:x1874704171901568:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857911.730729:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857911.730764:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 23 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.730778:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 23 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.730807:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7eee6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd49ff expref: 23 pid: 6713 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.730862:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857911.730877:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857911.730884:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.730895:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.730921:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857911.730964:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2347:x1874704171901568:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 250us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.730973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 478 00010000:00010000:3.0:1787857911.731013:0:22727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.731023:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.731059:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.731068:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.731078:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.731086:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857911.731091:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.731102:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.731117:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.731126:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003738cf89/0xd3f183cab4a7ef64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.731177:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2348:x1874704171900800:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 25271us (25780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.731189:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:2.0:1787857911.731778:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6711:1874704188309120:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857911.731811:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.733706:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874704188309248:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857911.733746:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.733954:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171901696 00000100:00100000:0.0:1787857911.733966:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171901696 00002000:00100000:1.0:1787857911.734238:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (0->157) req@ffff9997c5b030c0 x1874704171901696/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 648/0 e 0 to 0 dl 1787857922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857911.734250:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5b030c0 with x1874704171901696 ext(0->157) 00010000:00010000:1.0:1787857911.734263:0:6718:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 21 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.734279:0:6718:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 21 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857911.734288:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9997c5b030c0 00000100:00100000:1.0:1787857911.734340:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:1.0:1787857911.734355:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+21:2347:x1874704171901696:12345-192.168.204.36@tcp:4:cp.0 00000100:00100000:1.0:1787857911.736469:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2347:x1874704171901696:12345-192.168.204.36@tcp:4:cp.0 Request processed in 2096us (6121us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787857911.736489:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 25 00002000:00100000:1.0:1787857911.736507:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (0->157) req@ffff9997c5b030c0 x1874704171901696/t4294967395(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 648/448 e 0 to 0 dl 1787857922 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857911.736519:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5b030c0 with x1874704171901696 ext(0->157) 00010000:00010000:1.0:1787857911.736532:0:6718:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 23 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.736549:0:6718:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 23 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857911.736558:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9997c5b030c0 00000100:00100000:1.0:1787857911.743019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.743294:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171901952 00000100:00100000:2.0:1787857911.743309:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171901952 00000100:00100000:2.0:1787857911.743401:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1666 00000100:00100000:2.0:1787857911.743415:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+91:33589:x1874704171901952:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857911.743624:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+91:33589:x1874704171901952:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 211us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857911.743634:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1666 00000100:00100000:2.0:1787857911.746359:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.746792:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171902080 00000100:00100000:1.0:1787857911.746808:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171902080 00000100:00100000:3.0:1787857911.747505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.747776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171902208 00000100:00100000:0.0:1787857911.747784:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171902208 00010000:00010000:0.0:1787857911.747859:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 23 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.747906:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.747923:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 479 00000100:00100000:0.0:1787857911.747947:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2347:x1874704171902208:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857911.747971:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857911.748006:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 23 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.748022:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 23 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.748066:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235f797a/0xd3f183cab4a7ec93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48b6 expref: 23 pid: 22727 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.748093:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857911.748100:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857911.748108:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.748127:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.748168:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857911.748245:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2347:x1874704171902208:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 312us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.748254:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 479 00000100:00100000:0.0:1787857911.748287:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171902336 00000100:00100000:0.0:1787857911.748291:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171902336 00000100:00100000:0.0:1787857911.748318:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 484 00000100:00100000:0.0:1787857911.748325:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2347:x1874704171902336:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.748340:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857911.748361:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000626c3d40/0xd3f183cab4a7ef79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a37 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857911.748380:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 158, mtime: 0x6a908bf6, atime: 0x0, ctime: 0x6a908bf6, blocks: 0x1 00010000:00010000:0.0:1787857911.748395:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1787857911.748399:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.748405:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000626c3d40/0xd3f183cab4a7ef79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a37 expref: 23 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.748421:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000626c3d40/0xd3f183cab4a7ef79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a37 expref: 23 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.748434:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6000, rc 0) 00000100:00100000:0.0:1787857911.748458:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2347:x1874704171902336:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 134us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.748464:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 484 00002000:00100000:1.0:1787857911.748834:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x21:0x0] (0->157) req@ffff9998efab5e00 x1874704171902080/t0(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 648/0 e 0 to 0 dl 1787857922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857911.748850:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab5e00 with x1874704171902080 ext(0->157) 00010000:00010000:1.0:1787857911.748863:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 14 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.748882:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 14 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857911.748892:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998efab5e00 00000100:00100000:1.0:1787857911.748925:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:1.0:1787857911.748946:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171902080:12345-192.168.204.36@tcp:4:cp.0 00010000:00010000:3.0:1787857911.749304:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.749317:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.749361:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.749369:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.749377:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.749385:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7800 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857911.749390:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.749479:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.749504:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.749515:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7ef6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.749604:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2347:x1874704171900928:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 36993us (37318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.749612:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:3.0:1787857911.751328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.751866:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171902592 00000100:00100000:2.0:1787857911.751881:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171902592 00000100:00100000:2.0:1787857911.751969:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1667 00000100:00100000:2.0:1787857911.751984:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+91:33589:x1874704171902592:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857911.752605:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.752670:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2349:x1874704171902080:12345-192.168.204.36@tcp:4:cp.0 Request processed in 3735us (6327us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1787857911.752685:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 26 00002000:00100000:1.0:1787857911.752704:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x21:0x0] (0->157) req@ffff9998efab5e00 x1874704171902080/t4294967380(0) o4->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 648/448 e 0 to 0 dl 1787857922 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857911.752716:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab5e00 with x1874704171902080 ext(0->157) 00010000:00010000:1.0:1787857911.752731:0:18392:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 16 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.752756:0:18392:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 16 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857911.752766:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9998efab5e00 00000100:00100000:3.0:1787857911.754006:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171902848 00000100:00100000:3.0:1787857911.754022:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171902848 00000100:00100000:3.0:1787857911.755854:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1668 00000100:00100000:3.0:1787857911.756154:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33587:x1874704171902848:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857911.758517:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33589:x1874704171902592:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 6513us (7181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857911.758542:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1667 00000100:00100000:3.0:1787857911.768454:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+91:33587:x1874704171902848:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 12294us (15827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.768479:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1668 00000100:00100000:2.0:1787857911.787683:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.787754:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.787761:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171902976 00000100:00100000:1.0:1787857911.787778:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171902976 00010000:00010000:1.0:1787857911.787866:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 16 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.787918:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 480 00000100:00100000:1.0:1787857911.787930:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+16:2348:x1874704171902976:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857911.787972:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857911.788005:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 16 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788024:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 16 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788056:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7edd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4965 expref: 16 pid: 14028 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788075:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857911.788080:0:17347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857911.788087:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788099:0:17347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788133:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857911.788200:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2348:x1874704171902976:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 271us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857911.788210:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 480 00010000:00010000:1.0:1787857911.788244:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788254:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788289:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788298:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788306:0:8490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788313:0:8490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9997c2c53e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857911.788318:0:8490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788327:0:8490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788339:0:8490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.788347:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000539d806/0xd3f183cab4a7ef72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.788398:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171901440:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 58165us (58463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857911.788412:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 483 00000100:00100000:3.0:1787857911.791213:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171903104 00000100:00100000:3.0:1787857911.791244:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171903104 00002000:00100000:3.0:1787857911.791344:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff9998efab7840 x1874704171903104/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1787857922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857911.791359:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab7840 with x1874704171903104 ext(0->4095) 00002000:00010000:3.0:1787857911.791367:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efab7840 00000100:00100000:3.0:1787857911.791444:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 132 00000100:00100000:3.0:1787857911.791458:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2350:x1874704171903104:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787857911.791971:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2350:x1874704171903104:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 512us (4213us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787857911.791980:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 132 00002000:00100000:3.0:1787857911.791993:0:6719:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff9998efab7840 x1874704171903104/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787857922 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857911.792001:0:6719:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998efab7840 with x1874704171903104 ext(0->4095) 00002000:00010000:3.0:1787857911.792005:0:6719:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9998efab7840 00000100:00100000:0.0:1787857911.801495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.801565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.801608:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171903488 00000100:00100000:0.0:1787857911.801619:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171903488 00000100:00100000:0.0:1787857911.801694:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 485 00000100:00100000:0.0:1787857911.801707:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+22:2349:x1874704171903488:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.801737:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857911.801769:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a3e expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857911.801812:0:14028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 158, mtime: 0x6a908bf6, atime: 0x0, ctime: 0x6a908bf6, blocks: 0x1 00010000:00010000:0.0:1787857911.801874:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1787857911.801881:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.801895:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 23 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.801922:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 23 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.801953:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7a00, rc 0) 00000100:00100000:0.0:1787857911.802036:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2349:x1874704171903488:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 332us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.802044:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 485 00000100:00100000:0.0:1787857911.802496:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171903360 00000100:00100000:0.0:1787857911.802502:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171903360 00000100:00100000:0.0:1787857911.802542:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1669 00000100:00100000:0.0:1787857911.802549:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+91:33588:x1874704171903360:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857911.802634:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+91:33588:x1874704171903360:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 85us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.802642:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1669 00000100:00100000:3.0:1787857911.811660:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.813766:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171903616 00000100:00100000:2.0:1787857911.813787:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171903616 00000100:00100000:3.0:1787857911.819272:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.819366:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.819762:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171903744 00000100:00100000:0.0:1787857911.819776:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171903744 00000100:00100000:0.0:1787857911.819871:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 486 00000100:00100000:0.0:1787857911.819885:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171903744:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.819909:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857911.819947:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a4c expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857911.819986:0:6713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 158, mtime: 0x6a908bf6, atime: 0x0, ctime: 0x6a908bf6, blocks: 0x1 00010000:00010000:0.0:1787857911.820014:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=735s v=(0 0) 00010000:00010000:0.0:1787857911.820019:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.820032:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 15 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.820053:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 15 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.820071:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6600, rc 0) 00000100:00100000:0.0:1787857911.820155:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171903744:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 273us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.820163:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 486 00000100:00100000:0.0:1787857911.820329:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171904000 00000100:00100000:0.0:1787857911.820334:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171904000 00000100:00100000:0.0:1787857911.820360:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1670 00000100:00100000:0.0:1787857911.820367:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33589:x1874704171903616:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.820381:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857911.820397:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ef8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.820439:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.820456:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.820472:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857911.821128:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1671 00000100:00100000:2.0:1787857911.821144:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+93:33587:x1874704171904000:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857911.821238:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+93:33587:x1874704171904000:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 100us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857911.821247:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1671 00010000:00010000:0.0:1787857911.821540:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7ef8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 93 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.821566:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 92 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.821576:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9997c3cb1900) 00010000:00010000:0.0:1787857911.821579:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857911.821583:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6200, rc 0) 00000100:00100000:0.0:1787857911.821623:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33589:x1874704171903616:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1256us (9981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.821630:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1670 00000100:00100000:3.0:1787857911.829186:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.829251:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171904256 00000100:00100000:3.0:1787857911.829264:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171904256 00000100:00100000:3.0:1787857911.829338:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1672 00000100:00100000:3.0:1787857911.829349:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33588:x1874704171904256:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857911.829513:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33588:x1874704171904256:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 165us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.829521:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1672 00000100:00100000:1.0:1787857911.837072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.837192:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.837233:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171904512 00000100:00100000:1.0:1787857911.837246:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171904512 00002000:00100000:1.0:1787857911.837314:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (0->4095) req@ffff9997c5b003c0 x1874704171904512/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1787857922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857911.837326:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5b003c0 with x1874704171904512 ext(0->4095) 00002000:00010000:1.0:1787857911.837332:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c5b003c0 00000100:00100000:1.0:1787857911.837367:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 133 00000100:00100000:1.0:1787857911.837378:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2349:x1874704171904512:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787857911.837658:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2349:x1874704171904512:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 280us (464us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857911.837670:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 133 00002000:00100000:1.0:1787857911.837679:0:6718:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (0->4095) req@ffff9997c5b003c0 x1874704171904512/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787857922 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857911.837687:0:6718:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9997c5b003c0 with x1874704171904512 ext(0->4095) 00002000:00010000:1.0:1787857911.837691:0:6718:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9997c5b003c0 00000100:00100000:0.0:1787857911.846062:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171904384 00000100:00100000:0.0:1787857911.846091:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171904384 00000100:00100000:1.0:1787857911.846374:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1673 00000100:00100000:1.0:1787857911.846391:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33589:x1874704171904384:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857911.846470:0:5858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857911.850179:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33589:x1874704171904384:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 3769us (13102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857911.850207:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1673 00000100:00100000:3.0:1787857911.852478:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.852605:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.853373:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.853531:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171904896 00000100:00100000:3.0:1787857911.853552:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171904896 00000100:00100000:3.0:1787857911.853810:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00100000:3.0:1787857911.853849:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2349:x1874704171904896:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787857911.854015:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854042:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857911.854048:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857911.854126:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854148:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854198:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854207:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854216:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854225:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999014e3e00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857911.854309:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854319:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854349:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.854360:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade388f6/0xd3f183cab4a7ef9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.854575:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2349:x1874704171904896:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 730us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.854586:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00100000:0.0:1787857911.857492:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171904768 00000100:00100000:0.0:1787857911.857518:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171904768 00000100:00100000:1.0:1787857911.858124:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171904640 00000100:00100000:1.0:1787857911.858134:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171904640 00002000:00100000:1.0:1787857911.858199:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x21:0x0] (0->4095) req@ffff9998f9d12580 x1874704171904640/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 488/0 e 0 to 0 dl 1787857922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857911.858215:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d12580 with x1874704171904640 ext(0->4095) 00002000:00010000:1.0:1787857911.858222:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f9d12580 00000100:00100000:1.0:1787857911.858253:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 134 00000100:00100000:1.0:1787857911.858265:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171904640:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787857911.858360:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1674 00000100:00100000:0.0:1787857911.858372:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+92:33587:x1874704171904768:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.858389:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857911.858558:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7efa3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a53 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857911.858579:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171904640:12345-192.168.204.36@tcp:3:lhsmtool_posix.0 Request processed in 317us (6355us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857911.858589:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 134 00002000:00100000:1.0:1787857911.858596:0:18392:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x21:0x0] (0->4095) req@ffff9998f9d12580 x1874704171904640/t0(0) o3->dd883d04-1f86-4100-8fde-ccbf466b6b53@192.168.204.36@tcp:557/0 lens 488/4536 e 0 to 0 dl 1787857922 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857911.858605:0:18392:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9998f9d12580 with x1874704171904640 ext(0->4095) 00002000:00010000:1.0:1787857911.858609:0:18392:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9998f9d12580 00010000:00010000:0.0:1787857911.858616:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.859036:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.859353:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.859835:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7efa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.859858:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 93 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.860410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.860465:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171905152 00000100:00100000:3.0:1787857911.860475:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171905152 00000100:00100000:3.0:1787857911.860528:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1675 00000100:00100000:3.0:1787857911.860539:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:33589:x1874704171905152:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857911.860643:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.860730:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:0.0:1787857911.860735:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857911.860742:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6400, rc 0) 00000100:00100000:0.0:1787857911.860810:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:33587:x1874704171904768:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2440us (8204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.860837:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1674 00010000:00010000:3.0:1787857911.864363:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 93 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.864384:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.864550:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 93 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.864579:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 93 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.864602:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188309376:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857911.865505:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857911.870302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.870376:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171905280 00000100:00100000:1.0:1787857911.870394:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171905280 00000100:00100000:1.0:1787857911.870491:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1676 00000100:00100000:1.0:1787857911.870504:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:33588:x1874704171905280:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857911.870537:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857911.870574:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7efb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a5a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.870631:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.870653:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.870671:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.870896:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7efb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.870922:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 95 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857911.870943:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:1.0:1787857911.870946:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857911.870952:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaece00, rc 0) 00000100:00100000:1.0:1787857911.871054:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33588:x1874704171905280:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 544us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857911.871062:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1676 00000100:00100000:3.0:1787857911.884152:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.884256:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171905408 00000100:00100000:0.0:1787857911.884271:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171905408 00000100:00100000:0.0:1787857911.884350:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1677 00000100:00100000:0.0:1787857911.884363:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33587:x1874704171905408:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857911.884485:0:5856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857911.884643:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33587:x1874704171905408:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 282us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.885753:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1677 00000100:00100000:3.0:1787857911.891225:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.893010:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188309376:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857911.893052:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.893458:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171905536 00000100:00100000:0.0:1787857911.893470:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171905536 00000100:00100000:0.0:1787857911.893552:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1678 00000100:00100000:0.0:1787857911.893565:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33588:x1874704171905536:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857911.893613:0:19301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x36:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857911.893781:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33588:x1874704171905536:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 218us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.893790:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1678 00000100:00100000:3.0:1787857911.896152:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.896203:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.896853:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171905792 00000100:00100000:0.0:1787857911.896876:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171905792 00000100:00100000:0.0:1787857911.896955:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 488 00000100:00100000:0.0:1787857911.896967:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2350:x1874704171905792:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.897023:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897051:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.897057:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.897065:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897083:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897124:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897134:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897144:0:14028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897152:0:14028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7400 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857911.897157:0:14028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897166:0:14028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897183:0:14028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897192:0:14028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000745d7bcf/0xd3f183cab4a7efc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.897280:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2350:x1874704171905792:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 316us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.897289:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 488 00000100:00100000:0.0:1787857911.897339:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171905664 00000100:00100000:0.0:1787857911.897343:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171905664 00010000:00010000:0.0:1787857911.897367:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 95 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.897394:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 481 00000100:00100000:0.0:1787857911.897414:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:2349:x1874704171905664:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857911.897427:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857911.897434:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 95 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897447:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 95 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897467:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7ef95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a45 expref: 95 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897481:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9997c3cb1900) 00010000:00010000:0.0:1787857911.897486:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897497:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897504:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897533:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857911.897553:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:2349:x1874704171905664:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 142us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.897560:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 481 00010000:00010000:0.0:1787857911.897588:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.897596:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.899316:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.899336:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.899344:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.899352:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857911.899358:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.899367:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.899388:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff9997c3cb1900) 00010000:00010000:0.0:1787857911.899391:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1787857911.899848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:0.0:1787857911.900796:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.900812:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7efb1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.902861:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:33589:x1874704171905152:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 42275us (42417us total) trans 4294968391 rc 0/0 00000100:00100000:0.0:1787857911.902892:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1675 00000100:00100000:0.0:1787857911.902980:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171905920 00000100:00100000:0.0:1787857911.902991:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171905920 00000100:00100000:0.0:1787857911.903057:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 489 00000100:00100000:0.0:1787857911.903069:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171905920:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.903132:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903158:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.903164:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857911.903172:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903191:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903233:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903243:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903251:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903260:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857911.903265:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903276:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903295:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.903304:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb68c122/0xd3f183cab4a7efcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.903374:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171905920:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 307us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857911.903381:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 489 00000100:00100000:3.0:1787857911.913200:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.913425:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171906176 00000100:00100000:0.0:1787857911.913438:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171906176 00000100:00100000:0.0:1787857911.913527:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1679 00000100:00100000:0.0:1787857911.913541:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+94:33587:x1874704171906176:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.915023:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.915060:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.915074:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.915145:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 94 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.915166:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 94 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.915187:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188309504:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857911.915325:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857911.921502:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.921658:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857911.926151:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188309504:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857911.926202:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.926318:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857911.926859:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171906816 00000100:00100000:0.0:1787857911.926879:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171906816 00000100:00100000:0.0:1787857911.926968:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1680 00000100:00100000:0.0:1787857911.926980:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33588:x1874704171906816:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857911.927104:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.927126:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 95 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.927138:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.927183:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 95 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857911.927198:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 95 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.927216:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188309632:192.168.204.36@tcp:104: 00000100:00100000:0.0:1787857911.927340:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857911.929027:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171906560 00000100:00100000:3.0:1787857911.929053:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171906560 00010000:00010000:3.0:1787857911.929124:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 96 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.929190:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 482 00000100:00100000:3.0:1787857911.929203:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+96:2349:x1874704171906560:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857911.929225:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857911.929234:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 96 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.929251:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 96 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.929284:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6400/0xd3f183cab4a7efaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a53 expref: 96 pid: 5857 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.929309:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857911.929316:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.929327:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.929338:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.929384:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857911.930356:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:2349:x1874704171906560:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1145us (8695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857911.930370:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 482 00010000:00010000:3.0:1787857911.930859:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.931278:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857911.931586:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171906432 00000100:00100000:2.0:1787857911.931600:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171906432 00000100:00100000:2.0:1787857911.931756:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 346 00000100:00100000:2.0:1787857911.931769:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c613a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33589:x1874704171906432:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857911.932325:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c613a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+96:33589:x1874704171906432:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 556us (10837us total) trans 4294968392 rc 0/0 00000100:00100000:2.0:1787857911.932336:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 346 00010000:00010000:3.0:1787857911.933440:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.933462:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.933472:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.933480:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857911.933487:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.933497:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.933522:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857911.933526:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857911.933533:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857911.933540:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7efd4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857911.933744:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+96:33587:x1874704171906176:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 20200us (20554us total) trans 4294968393 rc 0/0 00000100:00100000:3.0:1787857911.933757:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1679 00000100:00100000:0.0:1787857911.934779:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70470c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188309632:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857911.934841:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857911.935466:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857911.935941:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171906944 00000100:00100000:2.0:1787857911.935953:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171906944 00010000:00010000:2.0:1787857911.936005:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 96 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857911.936053:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 483 00000100:00100000:2.0:1787857911.936064:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d02a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+96:2349:x1874704171906944:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857911.936087:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857911.936095:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 96 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.936111:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 96 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.936147:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaece00/0xd3f183cab4a7efbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a5a expref: 96 pid: 5858 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.936169:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857911.936175:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.936187:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.936202:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.936245:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857911.936308:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d02a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:2349:x1874704171906944:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 245us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857911.936316:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 483 00010000:00010000:2.0:1787857911.936398:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.936419:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.937177:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.937189:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.937195:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.937200:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857911.937205:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.937212:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.937284:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857911.937289:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857911.937295:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857911.937302:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7600/0xd3f183cab4a7efdb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857911.938218:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33588:x1874704171906816:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 11228us (11889us total) trans 4294968394 rc 0/0 00000100:00100000:2.0:1787857911.938314:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1680 00000040:00080000:2.0:1787857911.938610:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857911.938616:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857911.942262:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 13 00000040:00080000:2.0:1787857911.942294:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857911.943137:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.946615:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171907200 00000100:00100000:1.0:1787857911.947509:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171907200 00000100:00100000:1.0:1787857911.947616:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 347 00000100:00100000:3.0:1787857911.948330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857911.948501:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+95:33587:x1874704171907200:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857911.948975:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171907456 00000100:00100000:2.0:1787857911.948984:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171907456 00000100:00100000:2.0:1787857911.949023:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 348 00000100:00100000:2.0:1787857911.949031:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+96:33588:x1874704171907456:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857911.949296:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+97:33588:x1874704171907456:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 265us (971us total) trans 4294968395 rc 0/0 00000100:00100000:2.0:1787857911.949305:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 348 00000100:00100000:1.0:1787857911.950110:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+97:33587:x1874704171907200:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 2480us (6984us total) trans 4294968396 rc 0/0 00000100:00100000:1.0:1787857911.950125:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 347 00010000:00010000:0.0:1787857912.561859:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857912.575311:0:22766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857912.575331:0:22766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857912.575451:0:22766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 13 00000040:00080000:3.0:1787857912.575460:0:22766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857912.651440:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.651493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.651519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.651554:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.657685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857912.662175:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171907712 00000100:00100000:0.0:1787857912.662199:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171907712 00000100:00100000:0.0:1787857912.662330:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171907968 00000100:00100000:0.0:1787857912.662334:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171907968 00000100:00100000:0.0:1787857912.662367:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171908224 00000100:00100000:0.0:1787857912.662371:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171908224 00000100:00100000:0.0:1787857912.662394:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171908480 00000100:00100000:0.0:1787857912.662397:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171908480 00000100:00100000:0.0:1787857912.662424:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 490 00000100:00100000:0.0:1787857912.662437:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+21:2349:x1874704171907712:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:0.0:1787857912.662469:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787857912.664653:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.664670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.664681:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.664700:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.664742:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171907840 00000100:00100000:3.0:1787857912.664753:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171907840 00000100:00100000:3.0:1787857912.664806:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171908096 00000100:00100000:3.0:1787857912.664809:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171908096 00000100:00100000:3.0:1787857912.664833:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171908352 00000100:00100000:3.0:1787857912.664835:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171908352 00000100:00100000:3.0:1787857912.664846:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171908608 00000100:00100000:3.0:1787857912.664848:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171908608 00000100:00100000:3.0:1787857912.664857:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171907584 00000100:00100000:3.0:1787857912.664859:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171907584 00000100:00100000:3.0:1787857912.664874:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 491 00000100:00100000:3.0:1787857912.664884:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+21:2349:x1874704171907968:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:3.0:1787857912.664909:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857912.664938:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a76 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.664980:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787857912.664985:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857912.664999:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 22 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.665100:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 22 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.665119:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd400, rc 0) 00010000:00010000:0.0:1787857912.665200:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a68 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.665238:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787857912.665243:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857912.665256:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 23 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.665279:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 23 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.665295:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6400, rc 0) 00000100:00100000:2.0:1787857912.665306:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 492 00000100:00100000:2.0:1787857912.665334:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+23:2349:x1874704171908224:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:2.0:1787857912.665350:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857912.665367:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a84 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857912.665369:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+23:2349:x1874704171907712:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 2930us (13943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857912.665371:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+23:2349:x1874704171907968:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 481us (13869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857912.665407:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 491 00010000:00010000:2.0:1787857912.665433:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787857912.665439:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1787857912.665450:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 493 00010000:00010000:2.0:1787857912.665457:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 23 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857912.665465:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 490 00000100:00100000:3.0:1787857912.665473:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+23:2349:x1874704171908480:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:3.0:1787857912.665502:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857912.665503:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 23 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.665516:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a92 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.665519:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7800, rc 0) 00010000:00010000:3.0:1787857912.665541:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787857912.665546:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857912.665560:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 24 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857912.665561:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+24:2349:x1874704171908224:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 235us (14033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857912.665589:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 494 00010000:00010000:3.0:1787857912.665608:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 23 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857912.665617:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+20:2349:x1874704171907840:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:3.0:1787857912.665645:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998c13fd200, rc 0) 00010000:00010000:0.0:1787857912.665646:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857912.665665:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a6f expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857912.665682:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+23:2349:x1874704171908480:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 217us (14124us total) trans 0 rc 0/0 00010000:00010000:0.0:1787857912.665687:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787857912.665693:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857912.665702:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 21 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.665723:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 21 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.665734:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c6e00, rc 0) 00000100:00100000:0.0:1787857912.665765:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+21:2349:x1874704171907840:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 157us (8091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857912.667272:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 492 00000100:00100000:2.0:1787857912.667339:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 495 00000100:00100000:2.0:1787857912.667361:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+21:2349:x1874704171908096:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:2.0:1787857912.667386:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857912.667410:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a7d expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.667442:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787857912.667447:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857912.667458:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 22 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.667478:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 22 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.667496:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6400, rc 0) 00000100:00100000:2.0:1787857912.667568:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+22:2349:x1874704171908096:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 220us (2931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857912.667575:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 495 00000100:00100000:2.0:1787857912.667597:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 496 00000100:00100000:2.0:1787857912.667604:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+21:2349:x1874704171908352:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:2.0:1787857912.667611:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857912.668125:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a8b expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668146:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787857912.668150:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857912.668158:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 22 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668171:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 22 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668182:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b7e00, rc 0) 00000100:00100000:2.0:1787857912.668274:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+22:2349:x1874704171908352:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 668us (3600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857912.668281:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 496 00000100:00100000:2.0:1787857912.668308:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 497 00000100:00100000:2.0:1787857912.668317:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+21:2349:x1874704171908608:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:2.0:1787857912.668328:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857912.668338:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a99 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668353:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787857912.668356:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857912.668362:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 22 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668373:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 22 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668383:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6a00, rc 0) 00000100:00100000:2.0:1787857912.668404:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+22:2349:x1874704171908608:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 90us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857912.668411:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 497 00000100:00100000:2.0:1787857912.668425:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 498 00000100:00100000:2.0:1787857912.668432:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+21:2347:x1874704171907584:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1787857912.668439:0:14028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857912.668447:0:14028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4a61 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668462:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1787857912.668465:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857912.668470:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 22 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668485:0:14028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 22 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857912.668494:0:14028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998f72b6000, rc 0) 00000100:00100000:2.0:1787857912.668509:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+22:2347:x1874704171907584:12345-192.168.204.36@tcp:101:rm.0 Request processed in 78us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857912.668515:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 498 00000100:00100000:3.0:1787857912.668773:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 493 00000100:00080000:3.0:1787857912.668891:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857912.668899:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857912.674936:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 494 00000100:00100000:2.0:1787857912.681075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857912.684489:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171908864 00000100:00100000:3.0:1787857912.684522:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171908864 00000100:00100000:3.0:1787857912.684808:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1681 00000100:00100000:3.0:1787857912.684852:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+118:33590:x1874704171908864:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:3.0:1787857912.684974:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787857912.685042:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999900ce6400/0xd3f183cab4a7e497 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4487 expref: 118 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.685079:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:3.0:1787857912.685094:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fc200/0xd3f183cab4a7ef17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a14 expref: 117 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.685109:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857912.685113:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857912.685167:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.685189:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.685210:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.685454:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.685464:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.685473:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.686058:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.686076:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.686087:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.686156:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 96 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.686176:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 96 pid: 7656 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857912.686196:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188309760:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857912.686581:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f7295900 going to sleep for 11 seconds 00000100:00080000:2.0:1787857912.688640:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857912.700623:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857912.701016:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171908992 00000100:00100000:0.0:1787857912.701032:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171908992 00010000:00010000:0.0:1787857912.701131:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 97 pid: 7656 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857912.701184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 484 00000100:00100000:0.0:1787857912.701201:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+97:2349:x1874704171908992:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857912.701229:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857912.701239:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 97 pid: 7656 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.701262:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 97 pid: 7656 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.701300:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:0.0:1787857912.701308:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.701326:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.701339:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.701374:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857912.701618:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+97:2349:x1874704171908992:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 421us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857912.701631:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 484 00000100:00080000:1.0:1787857912.701702:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857912.701865:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95c00/0xd3f183cab4a7e466 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4472 expref: 96 pid: 7656 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857912.701891:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188309760:192.168.204.36@tcp:104: 00010000:00010000:0.0:1787857912.701934:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.701948:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857912.701955:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857912.704893:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9176 00000004:00080000:1.0:1787857912.704914:0:7656:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736755096500ns, next at 737755090701ns, rc = 0 00010000:00010000:1.0:1787857912.705049:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705078:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705097:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705110:0:7656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705119:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705127:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705151:0:7656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857912.705183:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705190:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705197:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705205:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857912.705211:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705221:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705238:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:1.0:1787857912.705242:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857912.705249:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705256:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5c00/0xd3f183cab4a7f02f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705288:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705293:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705298:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705301:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998c13fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857912.705304:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705308:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705320:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857912.705322:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857912.705325:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857912.705330:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fcc00/0xd3f183cab4a7f021 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857912.705345:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1415b2a reply state 0000000048b0780f transno 4294968397 ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857912.705358:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857912.707871:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857912.707891:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.707906:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaeca00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857912.707911:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.707932:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.707957:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff9998e1a0cb00) 00010000:00010000:3.0:1787857912.707960:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857912.707966:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.707973:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f036 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.708569:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857912.708573:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857912.708576:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857912.710225:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+118:33590:x1874704171908864:12345-192.168.204.36@tcp:36:rm.0 Request processed in 25364us (29149us total) trans 4294968397 rc 0/0 00000100:00100000:1.0:1787857912.710242:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1681 00010000:00010000:3.0:1787857912.715935:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.715965:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.715976:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.715985:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999014e3e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857912.715993:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.716018:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.716049:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff9998d12ef100) 00010000:00010000:3.0:1787857912.716053:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857912.716063:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857912.716073:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3e00/0xd3f183cab4a7f028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857913.021045:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857913.021064:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857913.021550:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:3.0:1787857913.021559:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857913.199127:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188310016:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.199241:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857913.199317:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b00780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188310528:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.199351:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857913.199382:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787857913.199389:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188309888:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.199425:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857913.199456:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188310400:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.199485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857913.199528:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188310144:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.199566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857913.199589:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857913.199594:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188310272:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.199621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857913.199671:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188310016 00000100:00100000:1.0:1787857913.199685:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188310016 00000100:00100000:1.0:1787857913.199761:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188310400 00000100:00100000:1.0:1787857913.199765:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188310400 00000100:00100000:1.0:1787857913.199801:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188310144 00000100:00100000:1.0:1787857913.199804:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188310144 00000100:00100000:1.0:1787857913.199856:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1787857913.199867:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188310016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.199951:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874704188310016:12345-0@lo:400:kworker.0 Request processed in 85us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857913.199959:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1787857913.199986:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1787857913.199992:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188310400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.200022:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188310400:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857913.200029:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1787857913.200041:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1787857913.200048:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188310144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.200080:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188310144:12345-0@lo:400:kworker.0 Request processed in 33us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857913.200087:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1787857913.200110:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188310528 00000100:00100000:1.0:1787857913.200114:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188310528 00000100:00100000:1.0:1787857913.200148:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188310272 00000100:00100000:1.0:1787857913.200151:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188310272 00000100:00100000:1.0:1787857913.200176:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1787857913.200183:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188310528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.200219:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188310528:12345-0@lo:400:kworker.0 Request processed in 37us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857913.200226:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1787857913.200237:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1787857913.200243:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188310272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.200275:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188310272:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857913.200281:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00080000:1.0:1787857913.200305:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857913.200310:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857913.200313:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857913.200376:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188310272:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.200390:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188310144:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.200433:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188310400:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.200445:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874704188310016:0@lo:400:kworker.0 00000100:00100000:1.0:1787857913.200456:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b00780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188310528:0@lo:400:kworker.0 00000100:00100000:0.0:1787857913.204878:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188309888 00000100:00100000:0.0:1787857913.204905:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188309888 00000100:00100000:0.0:1787857913.205191:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1787857913.205220:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188309888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857913.205418:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188309888:12345-0@lo:400:kworker.0 Request processed in 214us (5990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857913.205428:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1787857913.205597:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188309888:0@lo:400:kworker.0 00010000:00010000:3.0:1787857913.583489:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857913.721581:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857913.721635:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188310656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857913.721743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857913.722046:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188310656 00000100:00100000:2.0:1787857913.722059:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188310656 00000100:00100000:2.0:1787857913.722129:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787857913.722141:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188310656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857913.722205:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 103743488 pending 6815744 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857913.722272:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188310656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857913.722281:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787857913.722713:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188310656:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787857913.884540:0:22817:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857913.884558:0:22817:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857913.884840:0:22817:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:0.0:1787857913.884848:0:22817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857913.954499:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857913.954592:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171909248 00000100:00100000:1.0:1787857913.954610:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171909248 00000100:00100000:1.0:1787857913.954712:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1682 00000100:00100000:1.0:1787857913.954725:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+117:33602:x1874704171909248:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:1.0:1787857913.954849:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857913.954908:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e94c00/0xd3f183cab4a7e569 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44db expref: 117 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.954932:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:1.0:1787857913.954940:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857913.954986:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955005:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955016:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955034:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955041:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955048:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955203:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955216:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 95 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955226:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955280:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 95 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.955299:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 95 pid: 7656 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857913.955319:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188310784:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857913.955469:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c7085300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857913.965589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857913.965677:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171909376 00000100:00100000:0.0:1787857913.965692:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171909376 00010000:00010000:0.0:1787857913.965755:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 96 pid: 7656 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857913.965843:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 485 00000100:00100000:0.0:1787857913.965858:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+96:2350:x1874704171909376:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857913.965882:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857913.965902:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 96 pid: 7656 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857913.965922:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 96 pid: 7656 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857913.965959:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:0.0:1787857913.965967:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857913.965997:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857913.966008:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857913.966033:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857913.966104:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+96:2350:x1874704171909376:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 250us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857913.966113:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 485 00010000:00010000:3.0:1787857913.970126:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6600/0xd3f183cab4a7e538 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd44c6 expref: 95 pid: 7656 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857913.970159:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188310784:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857913.970446:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.970460:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.970467:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857913.971939:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9592 00000004:00080000:3.0:1787857913.971956:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 738022138863ns, next at 739022134268ns, rc = 0 00010000:00010000:3.0:1787857913.972054:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972077:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972093:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972101:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972108:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972114:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972133:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857913.972164:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972171:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972179:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972270:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857913.972278:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972288:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972305:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:3.0:1787857913.972310:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857913.972317:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972325:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f04b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972350:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972357:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972363:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972369:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857913.972372:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972378:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972386:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857913.972389:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857913.972393:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.972399:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f03d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857913.972413:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071f4dbdd reply state 000000004028d9d4 transno 4294968398 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857913.972427:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857913.972728:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+118:33602:x1874704171909248:12345-192.168.204.36@tcp:36:rm.0 Request processed in 17998us (18242us total) trans 4294968398 rc 0/0 00000100:00100000:3.0:1787857913.972740:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1682 00010000:00010000:2.0:1787857913.972804:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857913.972844:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857913.972852:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857913.972856:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857913.972869:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857913.972880:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff9998c3379200) 00010000:00010000:2.0:1787857913.972882:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787857913.972885:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857913.972900:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f052 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857913.973272:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857913.973275:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857913.973277:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857913.981135:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.981160:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.981168:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.981174:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaecc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857913.981180:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.981188:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.981211:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff9998c2d27b00) 00010000:00010000:1.0:1787857913.981215:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857913.981220:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857913.981227:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f044 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.609870:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787857914.821077:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968391 is committed 00000001:00080000:2.0:1787857914.821134:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968397 is committed 00000004:00080000:2.0:1787857914.821143:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000001:00080000:2.0:1787857914.821154:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968396 is committed 00000100:00100000:1.0:1787857914.821530:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857914.821561:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188310912:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787857914.821689:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968398 is committed 00000004:00080000:2.0:1787857914.821694:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 23 committed 00000100:00100000:3.0:1787857914.821893:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857914.821906:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188311040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787857914.822005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857914.822279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857914.826708:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188311040 00000100:00100000:2.0:1787857914.826732:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188311040 00000100:00100000:3.0:1787857914.827768:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188310912 00000100:00100000:3.0:1787857914.827778:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188310912 00000100:00100000:3.0:1787857914.827839:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1787857914.827851:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188311040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787857914.827906:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:32 count 1 00010000:00010000:3.0:1787857914.827941:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.827972:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 22 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.827988:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 21 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.827996:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787857914.828001:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857914.828007:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.828054:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 21 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.828073:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 21 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857914.828095:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188311168:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857914.828301:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1787857914.828313:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188310912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787857914.828331:0:22727:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:29 count 1 00010000:00010000:2.0:1787857914.828350:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.828364:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 14 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.828374:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 20 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.828383:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787857914.828386:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857914.828390:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.828415:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 20 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.828426:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 20 pid: 14028 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857914.828437:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188311296:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857914.828557:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 22 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.828568:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 22 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857914.828591:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188311424:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857914.829569:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 14 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.830866:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 14 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857914.830901:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188311552:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857914.831008:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2a97480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857914.831673:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c6eb3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857914.832332:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857914.832373:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171909504 00000100:00100000:2.0:1787857914.832385:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171909504 00010000:00010000:2.0:1787857914.832474:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 22 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857914.832530:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 486 00000100:00100000:2.0:1787857914.832542:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+22:2350:x1874704171909504:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857914.832561:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857914.832569:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 22 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.832602:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 22 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.832639:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857914.832684:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:365dae28-8203-4526-83a5-01baf5c55d8b+22:2350:x1874704171909504:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 145us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857914.832692:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 486 00010000:00010000:3.0:1787857914.833265:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000461209d3/0xd3f183cab4a7efe9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a68 expref: 21 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857914.833287:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188311168:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857914.837250:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857914.837413:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188311552:192.168.204.36@tcp:104: 00000100:00080000:1.0:1787857914.837644:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857914.837924:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171909632 00000100:00100000:2.0:1787857914.837933:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171909632 00010000:00010000:2.0:1787857914.838002:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 15 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857914.838053:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00100000:2.0:1787857914.838065:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+15:2350:x1874704171909632:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857914.838085:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857914.838092:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 15 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.838107:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 15 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.838139:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5172ee/0xd3f183cab4a7e650 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd452f expref: 15 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.838160:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857914.838244:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171909632:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 180us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857914.838252:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 487 00000100:00080000:1.0:1787857914.839038:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857914.844694:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857914.844752:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857914.844789:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171909760 00000100:00100000:0.0:1787857914.844800:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171909760 00010000:00010000:0.0:1787857914.844900:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 23 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857914.844940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171909888 00000100:00100000:0.0:1787857914.844943:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171909888 00010000:00010000:0.0:1787857914.844964:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 21 pid: 14028 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857914.844987:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 488 00000100:00100000:0.0:1787857914.844999:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2350:x1874704171909760:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857914.845022:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857914.845030:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 23 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857914.845050:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 23 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857914.845096:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857914.845102:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857914.845111:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857914.845124:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857914.845151:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857914.845226:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+23:2350:x1874704171909760:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 228us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857914.845235:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 488 00000100:00100000:0.0:1787857914.845265:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 489 00000100:00100000:0.0:1787857914.845273:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+21:2348:x1874704171909888:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857914.845283:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857914.845288:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 21 pid: 14028 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857914.845301:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 21 pid: 14028 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857914.845325:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857914.845329:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857914.845334:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857914.845342:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857914.845356:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857914.845377:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:365dae28-8203-4526-83a5-01baf5c55d8b+21:2348:x1874704171909888:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 104us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857914.845384:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 489 00000100:00080000:0.0:1787857914.845411:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857914.845417:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857914.846991:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c43b6f7/0xd3f183cab4a7e657 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4536 expref: 22 pid: 6713 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857914.847015:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188311424:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857914.847049:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.847062:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.847070:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.847082:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.847092:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.847134:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857914.847684:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857914.847694:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857914.847705:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857914.847710:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857914.847721:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857914.847749:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857914.847757:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939d11e8/0xd3f183cab4a7f059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857914.847780:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857914.847782:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857914.847784:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857914.851850:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188311040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23990us (29834us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787857914.851868:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00010000:00010000:3.0:1787857914.852206:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ca8234a/0xd3f183cab4a7f01a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a61 expref: 20 pid: 14028 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857914.852229:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188311296:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857914.852274:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.852288:0:22727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.852295:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.852307:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.852315:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857914.852346:0:22727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857914.852975:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188310912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24663us (30694us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1787857914.852986:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00010000:00010000:2.0:1787857914.853112:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857914.853122:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.853134:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857914.853139:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.853149:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.853173:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.853181:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ce97b17/0xd3f183cab4a7f060 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857914.853205:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857914.853208:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857914.853209:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787857914.853341:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c5c6d680/2, rc 0, transno 4294967396 00000100:00100000:0.0:1787857914.853350:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188311040:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787857914.853528:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c5c6da40/2, rc 0, transno 4294967381 00000100:00100000:1.0:1787857914.853536:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188310912:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1787857915.055281:0:22870:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857915.055294:0:22870:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857915.055384:0:22870:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:2.0:1787857915.055391:0:22870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857915.177164:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857915.183756:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171910144 00000100:00100000:3.0:1787857915.183785:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171910144 00000100:00100000:2.0:1787857915.184204:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1683 00000100:00100000:2.0:1787857915.184221:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+115:33613:x1874704171910144:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:2.0:1787857915.184311:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857915.184357:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7e6b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4559 expref: 115 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.184380:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:2.0:1787857915.184387:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857915.184424:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.184442:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.184453:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.184471:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.184477:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.184482:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.185051:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.185068:0:19301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.185077:0:19301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.185125:0:19301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857915.185142:0:19301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 58 pid: 5856 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857915.185161:0:19301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188311680:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857915.185297:0:19301:0:(client.c:2715:ptlrpc_set_wait()) set ffff99990127b0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787857915.185468:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857915.199019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857915.199167:0:19301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19301:1874704188311680:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857915.199219:0:19301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857915.202270:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171910272 00000100:00100000:3.0:1787857915.202291:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171910272 00010000:00010000:3.0:1787857915.202403:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 59 pid: 5856 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857915.202463:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 490 00000100:00100000:3.0:1787857915.202478:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d0399450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+59:2349:x1874704171910272:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857915.202503:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857915.202512:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 59 pid: 5856 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.202532:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 59 pid: 5856 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.202570:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c3bc4a00/0xd3f183cab4a7e642 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4528 expref: 59 pid: 5856 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.202594:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:3.0:1787857915.202601:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.202614:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.202630:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.202661:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857915.202755:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d0399450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:2349:x1874704171910272:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 280us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857915.202764:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 490 00010000:00010000:1.0:1787857915.204163:0:19301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.204182:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857915.205476:0:19301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9240 00000004:00080000:1.0:1787857915.205491:0:19301:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739255672801ns, next at 740255669840ns, rc = 0 00010000:00010000:1.0:1787857915.205589:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205609:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205624:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205634:0:19301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205641:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205647:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205674:0:19301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857915.205702:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205708:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205715:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205720:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857915.205725:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205732:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205746:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:1.0:1787857915.205750:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857915.205755:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205761:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6000/0xd3f183cab4a7f075 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205786:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205793:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205799:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205809:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857915.205812:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205845:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205853:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857915.205855:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857915.205858:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857915.205863:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7000/0xd3f183cab4a7f067 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857915.205891:0:19301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa6d9046 reply state 000000002a74c1a2 transno 4294968399 ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857915.205901:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857915.206016:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+116:33613:x1874704171910144:12345-192.168.204.36@tcp:36:rm.0 Request processed in 21793us (28867us total) trans 4294968399 rc 0/0 00000100:00100000:1.0:1787857915.206026:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1683 00010000:00010000:3.0:1787857915.207040:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857915.207054:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.207065:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaeca00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857915.207068:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.207076:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.207092:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff9997c3d03500) 00010000:00010000:3.0:1787857915.207094:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857915.207098:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.207105:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f07c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.207133:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857915.207135:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857915.207137:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787857915.207311:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857915.213293:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.213314:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.213322:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.213328:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857915.213332:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.213341:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.213362:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff9997c3cb1a00) 00010000:00010000:3.0:1787857915.213365:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857915.213371:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857915.213377:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6c00/0xd3f183cab4a7f06e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857915.367426:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967394 is committed 00000001:00080000:1.0:1787857915.367465:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967395 is committed 00000001:00080000:1.0:1787857915.367482:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967396 is committed 00000100:00100000:2.0:1787857915.482022:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857915.484949:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171910400 00000100:00100000:3.0:1787857915.484971:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171910400 00000100:00100000:3.0:1787857915.485108:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 630 00000100:00100000:3.0:1787857915.485123:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171910400:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857915.485251:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171910400:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 131us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857915.485260:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 630 00010000:00010000:0.0:1787857915.630109:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787857916.369109:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967380 is committed 00000001:00080000:0.0:1787857916.369150:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967381 is committed 00000040:00080000:3.0:1787857916.441275:0:22924:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857916.441290:0:22924:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857916.441420:0:22924:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:3.0:1787857916.441427:0:22924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857916.519414:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857916.519508:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171910656 00000100:00100000:0.0:1787857916.519521:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171910656 00000100:00100000:0.0:1787857916.519607:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1684 00000100:00100000:0.0:1787857916.519619:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+115:33623:x1874704171910656:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:0.0:1787857916.519715:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857916.519755:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7e7df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd465c expref: 115 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.519783:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:0.0:1787857916.519790:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857916.520028:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520049:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520062:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520081:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520089:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520096:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520240:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520253:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520263:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520305:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.520324:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 57 pid: 5858 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857916.520344:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188311808:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857916.520475:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d14ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857916.530224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857916.530411:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188311808:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857916.530647:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857916.530803:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171910784 00000100:00100000:0.0:1787857916.530832:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171910784 00010000:00010000:0.0:1787857916.530910:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 58 pid: 5858 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857916.531434:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 491 00000100:00100000:0.0:1787857916.531449:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+58:2350:x1874704171910784:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857916.531472:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857916.531481:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 58 pid: 5858 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.531499:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 58 pid: 5858 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.531540:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7e784 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd45d7 expref: 58 pid: 5858 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.531567:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:0.0:1787857916.531574:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.531586:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.531603:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.534140:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857916.534271:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:2350:x1874704171910784:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 2812us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857916.534288:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 491 00010000:00010000:2.0:1787857916.543774:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857916.543801:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857916.546368:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9656 00000004:00080000:3.0:1787857916.546387:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740596568887ns, next at 741596564448ns, rc = 0 00010000:00010000:3.0:1787857916.548664:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548704:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548722:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548736:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548744:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548752:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548797:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857916.548861:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548869:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548875:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548882:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857916.548886:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.548895:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.549068:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857916.549081:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.555298:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857916.555326:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.555352:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.555356:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:3.0:1787857916.555364:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857916.555376:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.555387:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f091 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.555389:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff9998e1a0cd00) 00010000:00010000:0.0:1787857916.555396:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857916.555401:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.555408:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f098 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.555436:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857916.555438:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857916.555442:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857916.555507:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.555516:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.555528:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.555534:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857916.555538:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.555621:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.555632:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857916.555635:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857916.555639:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857916.555646:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f083 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857916.555659:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000812417fa reply state 00000000a529a98c transno 4294968400 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857916.555671:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857916.555878:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+116:33623:x1874704171910656:12345-192.168.204.36@tcp:36:rm.0 Request processed in 36252us (36470us total) trans 4294968400 rc 0/0 00000100:00100000:3.0:1787857916.555890:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1684 00010000:00010000:0.0:1787857916.572180:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.572207:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.572216:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.572223:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857916.572332:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.572343:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.572368:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff9998d12efe00) 00010000:00010000:0.0:1787857916.572372:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857916.572379:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857916.572386:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f08a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857916.662031:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857916.791132:0:6899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740841311045ns, next at 741841307695ns, rc = 0 00000100:00100000:2.0:1787857916.791166:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857916.791196:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188311936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857916.791287:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857916.791374:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188311936 00000100:00100000:2.0:1787857916.791385:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188311936 00000100:00100000:2.0:1787857916.791451:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787857916.791461:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188311936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857916.791513:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857916.791575:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188311936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857916.791584:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787857916.792033:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967381 gen 2 00000004:00080000:2.0:1787857916.792040:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c5c6da40, transno 4294967381 00000100:00100000:2.0:1787857916.792074:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188311936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787857916.792966:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857917.679748:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857917.792356:0:22976:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857917.792376:0:22976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857917.793006:0:22976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:0.0:1787857917.793016:0:22976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857917.926554:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857917.928374:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171911040 00000100:00100000:3.0:1787857917.928402:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171911040 00000100:00100000:3.0:1787857917.928542:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1685 00000100:00100000:3.0:1787857917.928556:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+115:33633:x1874704171911040:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:3.0:1787857917.928641:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857917.928680:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7e00/0xd3f183cab4a7e8db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46be expref: 115 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.928708:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:3.0:1787857917.928716:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1787857917.928720:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857917.928769:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.928788:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.928801:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.928849:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.928858:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.928865:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.929026:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.929039:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.929048:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 4/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.929095:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.929111:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 56 pid: 5858 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857917.929130:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188312064:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857917.929275:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c5b84540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857917.937585:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188312064:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857917.937630:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857917.941881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857917.941962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857917.942007:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171911424 00000100:00100000:3.0:1787857917.942020:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171911424 00000100:00100000:3.0:1787857917.942104:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 501 00000100:00100000:3.0:1787857917.942117:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+21:2347:x1874704171911424:12345-192.168.204.36@tcp:101:ll_sa.0 00010000:00010000:3.0:1787857917.942143:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857917.942168:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7f0b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4ab5 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.942248:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1787857917.942254:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857917.942266:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7f0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4ab5 expref: 22 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.942294:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022f7dd9b/0xd3f183cab4a7f0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4ab5 expref: 22 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857917.942551:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998da8f5c00, rc 0) 00000100:00100000:3.0:1787857917.942664:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+22:2347:x1874704171911424:12345-192.168.204.36@tcp:101:ll_sa.0 Request processed in 549us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857917.942672:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 501 00000100:00080000:3.0:1787857917.942705:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857917.944550:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171911296 00000100:00100000:1.0:1787857917.944571:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171911296 00000100:00100000:1.0:1787857917.944658:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 91 00000100:00100000:1.0:1787857917.944671:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+115:2347:x1874704171911296:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:1.0:1787857917.944726:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857917.944750:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7f0bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4aa0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.944856:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.944877:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.944892:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.944912:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.944920:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.944928:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945020:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945028:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945036:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945044:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857917.945050:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945059:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945075:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857917.945079:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857917.945085:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945093:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945109:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945139:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945145:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945151:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaeda00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857917.945155:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945161:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945169:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xbb834312 (ffff9998c2d27000) 00010000:00010000:1.0:1787857917.945172:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857917.945176:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945183:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeda00/0xd3f183cab4a7f0c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945222:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7f0bb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4aa0 expref: 116 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945233:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857917.945236:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857917.945240:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaedc00/0xd3f183cab4a7f0bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4aa0 expref: 116 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.945250:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaedc00, rc -2) 00000100:00100000:1.0:1787857917.949275:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+115:2347:x1874704171911296:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 4586us (7391us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857917.949419:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 91 00000100:00100000:1.0:1787857917.953082:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857917.953157:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171911168 00000100:00100000:0.0:1787857917.953171:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171911168 00010000:00010000:0.0:1787857917.953247:0:17347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 57 pid: 5858 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857917.953298:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 492 00000100:00080000:1.0:1787857917.953396:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857917.953422:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+57:2349:x1874704171911168:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857917.953445:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857917.953454:0:17347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 57 pid: 5858 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857917.953473:0:17347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 57 pid: 5858 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857917.953508:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71600/0xd3f183cab4a7e895 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd46a2 expref: 57 pid: 5858 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857917.953540:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:0.0:1787857917.953548:0:17347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857917.953561:0:17347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857917.953569:0:17347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857917.953602:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857917.953664:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:2349:x1874704171911168:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 354us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857917.953676:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 492 00010000:00010000:1.0:1787857917.954051:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.954062:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857917.954931:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9304 00000004:00080000:1.0:1787857917.954942:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742005124770ns, next at 743005121976ns, rc = 0 00010000:00010000:1.0:1787857917.955025:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955047:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955058:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955066:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955074:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955081:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955108:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857917.955137:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955143:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955149:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955155:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857917.955160:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955169:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955185:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:1.0:1787857917.955188:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857917.955194:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955201:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f0ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955223:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955228:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955234:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955240:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857917.955243:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955248:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955254:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857917.955256:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857917.955259:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955264:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f09f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857917.955279:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f27f358d reply state 00000000c405ec59 transno 4294968401 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857917.955288:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857917.955373:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+116:33633:x1874704171911040:12345-192.168.204.36@tcp:36:rm.0 Request processed in 26816us (28831us total) trans 4294968401 rc 0/0 00000100:00100000:1.0:1787857917.955382:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1685 00010000:00010000:1.0:1787857917.955427:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857917.955434:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955440:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaede00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857917.955443:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955450:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955458:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff9998d12ef800) 00010000:00010000:1.0:1787857917.955460:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857917.955463:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955469:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaede00/0xd3f183cab4a7f0d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.955483:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857917.955485:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857917.955487:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857917.965676:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.965707:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.965716:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.965738:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857917.965746:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.965756:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.965782:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff9998d12ef300) 00010000:00010000:1.0:1787857917.965786:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857917.965792:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857917.965800:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f0a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857918.318196:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188312320:0@lo:400:kworker.0 00000100:00100000:0.0:1787857918.318246:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188312192:0@lo:400:kworker.0 00000100:00100000:1.0:1787857918.324378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857918.324583:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188312832:0@lo:400:kworker.0 00000100:00100000:1.0:1787857918.324678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857918.324753:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188312448:0@lo:400:kworker.0 00000100:00100000:1.0:1787857918.324793:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857918.324876:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857918.324887:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b00780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188312576:0@lo:400:kworker.0 00000100:00100000:0.0:1787857918.324901:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188312320 00000100:00100000:1.0:1787857918.324919:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857918.324922:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188312320 00000100:00100000:1.0:1787857918.324973:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188312448 00000100:00100000:1.0:1787857918.324981:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188312448 00000100:00100000:3.0:1787857918.326520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857918.327460:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1787857918.327491:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188312320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857918.327667:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188312320:12345-0@lo:400:kworker.0 Request processed in 191us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857918.327675:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1787857918.327698:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1787857918.327706:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188312448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857918.327748:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874704188312448:12345-0@lo:400:kworker.0 Request processed in 44us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857918.327755:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1787857918.328947:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188312704:0@lo:400:kworker.0 00000100:00100000:2.0:1787857918.329039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857918.329726:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188312704 00000100:00100000:1.0:1787857918.329750:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188312704 00000100:00100000:1.0:1787857918.329901:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188312832 00000100:00100000:1.0:1787857918.329907:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188312832 00000100:00100000:2.0:1787857918.329915:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1787857918.329939:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188312704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857918.329959:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188312576 00000100:00100000:1.0:1787857918.329964:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188312576 00000100:00100000:2.0:1787857918.330023:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874704188312704:12345-0@lo:400:kworker.0 Request processed in 95us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857918.330031:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1787857918.330125:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188312192 00000100:00100000:0.0:1787857918.330135:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188312192 00000100:00100000:0.0:1787857918.330201:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1787857918.330209:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188312192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857918.330268:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1787857918.330270:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3304:x1874704188312192:12345-0@lo:400:kworker.0 Request processed in 58us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857918.330284:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:1.0:1787857918.330301:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188312832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857918.330404:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188312832:12345-0@lo:400:kworker.0 Request processed in 123us (5724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857918.330413:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1787857918.330431:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1787857918.330440:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188312576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857918.330492:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188312576:12345-0@lo:400:kworker.0 Request processed in 55us (5574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857918.330499:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1787857918.331046:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188312320:0@lo:400:kworker.0 00000100:00100000:0.0:1787857918.331157:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967396 gen 2 00000004:00080000:0.0:1787857918.331221:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c5c6d680, transno 4294967396 00000100:00100000:0.0:1787857918.331237:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188312832:0@lo:400:kworker.0 00000100:00100000:2.0:1787857918.332074:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3304:1874704188312192:0@lo:400:kworker.0 00000100:00100000:2.0:1787857918.332104:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874704188312704:0@lo:400:kworker.0 00000100:00080000:1.0:1787857918.334977:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857918.335218:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857918.335227:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857918.335443:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b00780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188312576:0@lo:400:kworker.0 00000100:00100000:1.0:1787857918.335471:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874704188312448:0@lo:400:kworker.0 00010000:00010000:0.0:1787857918.702353:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787857918.833023:0:7958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742883202095ns, next at 743883198203ns, rc = 0 00000100:00100000:1.0:1787857918.833112:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188312960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857918.833205:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857918.833414:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188312960 00000100:00100000:0.0:1787857918.833426:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188312960 00000100:00100000:0.0:1787857918.833487:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787857918.833507:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188312960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857918.833545:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857918.833594:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188312960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857918.833601:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787857918.833814:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188312960:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787857918.974698:0:23027:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857918.974709:0:23027:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857918.974779:0:23027:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:1.0:1787857918.974790:0:23027:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857919.077758:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857919.078544:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171911552 00000100:00100000:0.0:1787857919.078558:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171911552 00000100:00100000:0.0:1787857919.078638:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 92 00000100:00100000:0.0:1787857919.078650:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+115:2348:x1874704171911552:12345-192.168.204.36@tcp:63:ll_sa.0 00000100:00080000:3.0:1787857919.078673:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857919.078695:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857919.078720:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7f0d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4abc expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078789:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078834:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078848:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078864:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078871:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078876:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078952:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078960:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078968:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078975:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857919.078980:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.078988:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079000:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857919.079004:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857919.079009:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079014:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7200/0xd3f183cab4a7f0de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079027:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079034:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079040:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079045:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857919.079049:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079055:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079063:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x4b66ad81 (ffff9998c4ea6700) 00010000:00010000:0.0:1787857919.079066:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857919.079069:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079075:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6200/0xd3f183cab4a7f0e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079119:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7f0d7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4abc expref: 116 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079130:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857919.079132:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857919.079136:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7c00/0xd3f183cab4a7f0d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4abc expref: 116 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.079162:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7c00, rc -2) 00000100:00100000:0.0:1787857919.079238:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+115:2348:x1874704171911552:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 589us (1491us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857919.079246:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 92 00000100:00100000:2.0:1787857919.084845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857919.085876:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171911808 00000100:00100000:1.0:1787857919.085889:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171911808 00000100:00100000:1.0:1787857919.085952:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1686 00000100:00100000:1.0:1787857919.085965:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+115:33645:x1874704171911808:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:1.0:1787857919.086042:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857919.086076:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7e9d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4751 expref: 115 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086109:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:1.0:1787857919.086115:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857919.086143:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086159:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086626:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086645:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086654:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086666:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086775:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086787:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 55 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086807:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 4/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086907:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 55 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.086924:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 55 pid: 19301 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857919.086942:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188313088:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857919.087050:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f8eee480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857919.095369:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857919.095581:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188313088:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857919.095616:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.095770:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171911936 00000100:00100000:3.0:1787857919.095779:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171911936 00010000:00010000:3.0:1787857919.095880:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 56 pid: 19301 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.095923:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 493 00000100:00100000:3.0:1787857919.095932:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+56:2349:x1874704171911936:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857919.095946:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857919.095953:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 56 pid: 19301 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.095965:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 56 pid: 19301 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.095992:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7200/0xd3f183cab4a7e9a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd473c expref: 56 pid: 19301 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096011:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:3.0:1787857919.096016:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096026:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096033:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096057:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857919.096105:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:2349:x1874704171911936:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 174us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857919.096113:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 493 00010000:00010000:3.0:1787857919.096139:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096145:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857919.096864:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9720 00010000:00010000:3.0:1787857919.096928:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096941:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096955:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096963:0:7656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096969:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096976:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.096999:0:7656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857919.097024:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097031:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097038:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097044:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857919.097049:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097057:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097068:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:3.0:1787857919.097071:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857919.097077:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097083:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec800/0xd3f183cab4a7f0fa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097103:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097109:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097115:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097119:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857919.097122:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097128:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097135:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857919.097137:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857919.097140:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.097145:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f0ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857919.097156:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cabbed52 reply state 00000000be1b8d79 transno 4294968402 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.097170:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857919.097242:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+116:33645:x1874704171911808:12345-192.168.204.36@tcp:36:rm.0 Request processed in 11277us (12421us total) trans 4294968402 rc 0/0 00000100:00100000:3.0:1787857919.097250:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1686 00000100:00080000:1.0:1787857919.097409:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857919.097536:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857919.097544:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.097551:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857919.097554:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.097559:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.097568:0:17404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff9998c3379300) 00010000:00010000:2.0:1787857919.097570:0:17404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787857919.097573:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.097578:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4000/0xd3f183cab4a7f101 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.097595:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857919.097596:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857919.097598:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857919.102518:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.102543:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.102550:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.102557:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaeca00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857919.102562:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.102570:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.102588:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff9998c2d27900) 00010000:00010000:1.0:1787857919.102591:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857919.102597:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857919.102602:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f0f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857919.736021:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787857919.957685:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 25 committed 00000001:00080000:0.0:1787857919.957720:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968401 is committed 00000004:00080000:0.0:1787857919.957730:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000004:00080000:0.0:1787857919.957751:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:0.0:1787857919.957758:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000001:00080000:0.0:1787857919.957784:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968402 is committed 00000004:00080000:0.0:1787857919.957795:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 24 committed 00000100:00100000:3.0:1787857919.958076:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188313344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787857919.958227:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188313216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787857919.958313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857919.958760:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188313216 00000100:00100000:2.0:1787857919.958789:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188313216 00000100:00100000:2.0:1787857919.958868:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1787857919.958880:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188313216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787857919.958912:0:8490:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:33 count 1 00010000:00010000:2.0:1787857919.958939:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.959199:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 13 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.959219:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 21 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.959227:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=8s v=(0 0) 00010000:00010000:2.0:1787857919.959232:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857919.959238:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.959276:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 21 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.959291:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 21 pid: 22727 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857919.959306:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188313600:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857919.959375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787857919.959399:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 13 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.959410:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787857919.959412:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 13 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.959420:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188313472:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787857919.959427:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188313728:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857919.959458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857919.959463:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d13f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787857919.959511:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188313344 00000100:00100000:3.0:1787857919.959516:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188313344 00000100:00100000:3.0:1787857919.959543:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188313472 00000100:00100000:3.0:1787857919.959546:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188313472 00000100:00100000:3.0:1787857919.959563:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1787857919.959569:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188313344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787857919.959585:0:14028:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:30 count 1 00010000:00010000:3.0:1787857919.959602:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959616:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959626:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 19 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959633:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=8s v=(0 0) 00010000:00010000:3.0:1787857919.959637:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857919.959641:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959661:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 19 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959671:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 19 pid: 6713 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.959683:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188313856:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857919.959715:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 11 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959726:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 11 pid: 6714 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.959736:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188313984:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857919.959756:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c78fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857919.959773:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1787857919.959791:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188313472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787857919.959803:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:31 count 1 00010000:00010000:3.0:1787857919.959841:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959859:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959866:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 19 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959873:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=8s v=(0 0) 00010000:00010000:3.0:1787857919.959876:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857919.959880:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959898:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 19 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959907:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 19 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.959918:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188314112:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857919.959959:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.959968:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 11 pid: 6711 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.959982:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188314240:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857919.960001:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c78fe480 going to sleep for 11 seconds 00000100:00100000:1.0:1787857919.962574:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188313856:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857919.962591:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14028:1874704188313984:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857919.962622:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857919.962723:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188313600:192.168.204.36@tcp:104: 00000100:00100000:2.0:1787857919.962734:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8490:1874704188313728:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857919.962756:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857919.969009:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188314112:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857919.975349:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6713:1874704188314240:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857919.975409:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.977581:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857919.977618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857919.977655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857919.977687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857919.977713:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857919.977741:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857919.977769:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171912064 00000100:00100000:3.0:1787857919.977789:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171912064 00010000:00010000:3.0:1787857919.977872:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 22 pid: 22727 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.977899:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171912320 00000100:00100000:3.0:1787857919.977902:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171912320 00010000:00010000:3.0:1787857919.977917:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 12 pid: 6714 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.977928:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171912576 00000100:00100000:3.0:1787857919.977930:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171912576 00010000:00010000:3.0:1787857919.977945:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 20 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.977957:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171912192 00000100:00100000:3.0:1787857919.977959:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171912192 00010000:00010000:3.0:1787857919.977971:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 14 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.977981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171912448 00000100:00100000:3.0:1787857919.977982:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171912448 00010000:00010000:3.0:1787857919.977991:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 21 pid: 6713 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.978000:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171912704 00000100:00100000:3.0:1787857919.978001:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171912704 00010000:00010000:3.0:1787857919.978010:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 13 pid: 6711 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857919.978081:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 494 00000100:00100000:3.0:1787857919.978094:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+22:2350:x1874704171912064:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857919.978112:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857919.978118:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 22 pid: 22727 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978132:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 22 pid: 22727 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978160:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec455e91/0xd3f183cab4a7efe2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a76 expref: 22 pid: 22727 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978182:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857919.978247:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+21:2350:x1874704171912064:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 155us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857919.978256:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 494 00000100:00100000:3.0:1787857919.978279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 495 00000100:00100000:3.0:1787857919.978285:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171912320:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857919.978294:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857919.978298:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 13 pid: 6714 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978307:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 13 pid: 6714 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978321:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000475282f7/0xd3f183cab4a7eb43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd481c expref: 13 pid: 6714 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978332:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857919.978348:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2350:x1874704171912320:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 64us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857919.978354:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 495 00000100:00100000:3.0:1787857919.978366:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 496 00000100:00100000:3.0:1787857919.978371:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+21:2350:x1874704171912576:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857919.978380:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857919.978384:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 21 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978394:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 21 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978404:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c22c9b/0xd3f183cab4a7f005 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a7d expref: 21 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978413:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857919.978427:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+20:2350:x1874704171912576:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 56us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857919.978433:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 496 00000100:00100000:3.0:1787857919.978444:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 497 00000100:00100000:3.0:1787857919.978449:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d0398050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2350:x1874704171912192:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857919.978455:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857919.978459:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 14 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978468:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 14 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978481:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5dd42c1/0xd3f183cab4a7eb35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd480e expref: 14 pid: 14028 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978491:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857919.978496:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857919.978502:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978513:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978539:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857919.978555:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d0398050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2350:x1874704171912192:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 106us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857919.978561:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 497 00000100:00100000:3.0:1787857919.978602:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 498 00000100:00100000:3.0:1787857919.978609:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171912448:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857919.978617:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857919.978622:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 19 pid: 6713 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978632:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 19 pid: 6713 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978644:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb03f7ce/0xd3f183cab4a7effe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a6f expref: 19 pid: 6713 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978654:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857919.978657:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857919.978661:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978670:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978688:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857919.978706:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171912448:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 98us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857919.978713:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 498 00000100:00100000:3.0:1787857919.978726:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 499 00000100:00100000:3.0:1787857919.978733:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171912704:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857919.978740:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857919.978744:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 11 pid: 6711 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978754:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 11 pid: 6711 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978765:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2545ccd/0xd3f183cab4a7eb3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4815 expref: 11 pid: 6711 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978774:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857919.978790:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857919.978794:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978838:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978857:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857919.978874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171912704:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 142us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857919.978881:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 499 00000100:00080000:3.0:1787857919.978914:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857919.978919:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787857919.978933:0:8490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978942:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978952:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978959:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.978978:0:8490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857919.979644:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874704188313216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20762us (21327us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787857919.979654:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00010000:00010000:3.0:1787857919.979697:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.979708:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.979718:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.979728:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857919.979747:0:14028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787857919.980958:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857919.980975:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.980990:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b6c00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857919.980995:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981009:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981035:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981043:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ce97b17/0xd3f183cab4a7f108 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981082:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857919.981087:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981100:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857919.981104:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981111:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981122:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981129:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016da1583/0xd3f183cab4a7f10f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981145:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857919.981147:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857919.981149:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857919.981370:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981380:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981389:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981403:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.981431:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857919.982083:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1874704188313472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22288us (22619us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1787857919.982096:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00010000:00010000:2.0:1787857919.982135:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857919.982140:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.982148:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857919.982151:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.982158:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.982172:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.982178:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f116 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857919.982195:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857919.982197:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857919.982199:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857919.983804:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188313344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24226us (24422us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1787857919.983972:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000004:00080000:3.0:1787857919.984033:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9998f7045a40/2, rc 0, transno 4294967397 00000100:00100000:3.0:1787857919.984055:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188313216:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787857919.984171:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787857919.984197:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c5c6e1c0/2, rc 0, transno 4294967383 00000100:00100000:3.0:1787857919.984202:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188313472:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787857919.984211:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9997c5c6f0c0/2, rc 0, transno 4294967382 00000100:00100000:3.0:1787857919.984214:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188313344:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1787857920.088676:0:23079:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857920.088692:0:23079:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857920.088792:0:23079:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:0.0:1787857920.088799:0:23079:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857920.187194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857920.187270:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171912960 00000100:00100000:3.0:1787857920.187284:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171912960 00000100:00100000:3.0:1787857920.187352:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1687 00000100:00100000:3.0:1787857920.187362:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+111:33656:x1874704171912960:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:3.0:1787857920.187447:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857920.187495:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7eaa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd47a5 expref: 111 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.187518:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:3.0:1787857920.187524:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857920.187553:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.187567:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.187577:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.187590:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.187596:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.187601:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.188023:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.188036:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 54 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.188045:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.188089:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 54 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.188105:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 54 pid: 5857 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857920.188122:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188314368:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857920.188247:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c73a6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857920.191215:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857920.191307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171913088 00000100:00100000:0.0:1787857920.191319:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171913088 00010000:00010000:0.0:1787857920.191364:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 55 pid: 5857 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857920.191430:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 500 00000100:00100000:0.0:1787857920.191442:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:2349:x1874704171913088:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857920.191460:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857920.191468:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 55 pid: 5857 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.191492:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 55 pid: 5857 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.191518:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:0.0:1787857920.191523:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.191533:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.191541:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.191562:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857920.191624:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+55:2349:x1874704171913088:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 183us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857920.191632:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 500 00010000:00010000:3.0:1787857920.192180:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7a00/0xd3f183cab4a7ea78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4790 expref: 54 pid: 5857 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857920.192201:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5857:1874704188314368:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857920.192228:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.192238:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.192244:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857920.194455:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9368 00000004:00080000:3.0:1787857920.194471:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744244652882ns, next at 745244649679ns, rc = 0 00010000:00010000:3.0:1787857920.194563:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194582:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194596:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194605:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194612:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194617:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194653:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857920.194679:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194684:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194690:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194695:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857920.194699:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194707:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194718:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:3.0:1787857920.194720:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787857920.194725:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194731:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f12b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194748:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194754:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194760:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194764:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857920.194767:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194784:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194792:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:3.0:1787857920.194794:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857920.194797:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.194803:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f11d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857920.194814:0:5857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000458c822 reply state 00000000cc8dac63 transno 4294968403 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857920.194850:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857920.194948:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+112:33656:x1874704171912960:12345-192.168.204.36@tcp:36:rm.0 Request processed in 7582us (7760us total) trans 4294968403 rc 0/0 00000100:00100000:3.0:1787857920.194958:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1687 00010000:00010000:0.0:1787857920.195136:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857920.195143:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.195150:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4a00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857920.195154:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.195160:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.195174:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff9997c3d03100) 00010000:00010000:0.0:1787857920.195176:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857920.195179:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.195185:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4a00/0xd3f183cab4a7f132 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857920.195201:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857920.195203:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857920.195205:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857920.204433:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.204454:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.204462:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.204468:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1787857920.204474:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.204482:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.204507:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff9998d12ef400) 00010000:00010000:3.0:1787857920.204510:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857920.204519:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857920.204535:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857920.501758:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967397 is committed 00000100:00100000:2.0:1787857920.602348:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857920.602571:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171913216 00000100:00100000:0.0:1787857920.602586:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171913216 00000100:00100000:0.0:1787857920.602671:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 632 00000100:00100000:0.0:1787857920.602683:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171913216:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857920.602849:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171913216:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 168us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857920.602860:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 632 00010000:00010000:2.0:1787857920.757217:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857921.440490:0:23133:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857921.440499:0:23133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857921.440570:0:23133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:1.0:1787857921.440580:0:23133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787857921.468723:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967383 is committed 00000100:00100000:2.0:1787857921.537738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857921.538092:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171913472 00000100:00100000:1.0:1787857921.538107:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171913472 00000100:00100000:1.0:1787857921.538200:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1688 00000100:00100000:1.0:1787857921.538212:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+111:33666:x1874704171913472:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:1.0:1787857921.538302:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857921.538336:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efa71c00/0xd3f183cab4a7ecf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4911 expref: 111 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538359:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857921.538365:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857921.538403:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538424:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538438:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538475:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538484:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538492:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538629:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538643:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538651:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538691:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 53 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.538707:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 53 pid: 5858 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857921.538721:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188314496:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857921.538863:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2e37d80 going to sleep for 11 seconds 00000100:00080000:3.0:1787857921.539404:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857921.543680:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857921.543727:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171913600 00000100:00100000:3.0:1787857921.543737:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171913600 00010000:00010000:3.0:1787857921.543847:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 54 pid: 5858 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857921.543898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 501 00000100:00100000:3.0:1787857921.543910:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2350:x1874704171913600:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857921.543929:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857921.543936:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 54 pid: 5858 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.543951:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 54 pid: 5858 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.543979:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857921.543986:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.543997:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.544006:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.544033:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857921.544107:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+54:2350:x1874704171913600:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 197us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857921.544118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 501 00000100:00080000:3.0:1787857921.544146:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857921.544429:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7800/0xd3f183cab4a7ec46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4862 expref: 53 pid: 5858 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857921.544456:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5858:1874704188314496:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857921.544485:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.544494:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.544499:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857921.545265:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9784 00000004:00080000:1.0:1787857921.545278:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745595459865ns, next at 746595456745ns, rc = 0 00010000:00010000:1.0:1787857921.545376:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545391:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545401:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545410:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545416:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545423:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545449:0:5858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857921.545478:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545484:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545490:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545497:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857921.545504:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545517:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545529:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:1.0:1787857921.545531:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857921.545536:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545542:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed600/0xd3f183cab4a7f147 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545563:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545569:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545575:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545579:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857921.545582:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545588:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545595:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857921.545597:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857921.545600:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857921.545610:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec000/0xd3f183cab4a7f139 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857921.545622:0:5858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096819c83 reply state 00000000f00721b9 transno 4294968404 ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857921.545632:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857921.545713:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+112:33666:x1874704171913472:12345-192.168.204.36@tcp:36:rm.0 Request processed in 7501us (7984us total) trans 4294968404 rc 0/0 00000100:00100000:1.0:1787857921.545721:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1688 00010000:00010000:3.0:1787857921.545990:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857921.546000:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.546007:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaecc00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:3.0:1787857921.546011:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.546019:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.546029:0:17404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff9997c3d03600) 00010000:00010000:3.0:1787857921.546031:0:17404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857921.546035:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.546041:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaecc00/0xd3f183cab4a7f14e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.546057:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857921.546059:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857921.546061:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857921.559326:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857921.559347:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857921.559356:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857921.559363:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaec200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857921.559368:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857921.559378:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857921.559401:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff9998c2d27800) 00010000:00010000:2.0:1787857921.559405:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857921.559411:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857921.559418:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaec200/0xd3f183cab4a7f140 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857921.778994:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857921.902003:0:6899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745952182050ns, next at 746952179694ns, rc = 0 00000100:00100000:1.0:1787857921.902115:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857921.902136:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998efab70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188314624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857921.902221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857921.902903:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188314624 00000100:00100000:0.0:1787857921.902913:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188314624 00000100:00100000:0.0:1787857921.903031:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787857921.903043:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188314624:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787857921.903046:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787857921.903090:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857921.903169:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188314624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857921.903177:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787857921.903226:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967383 gen 2 00000004:00080000:2.0:1787857921.903233:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c5c6f0c0, transno 4294967382 00000004:00080000:2.0:1787857921.903242:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9997c5c6e1c0, transno 4294967383 00000100:00100000:2.0:1787857921.903258:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998efab70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188314624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857922.803521:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857922.819390:0:23184:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857922.819401:0:23184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857922.819492:0:23184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:1.0:1787857922.819503:0:23184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857922.898528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857922.898952:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171913728 00000100:00100000:1.0:1787857922.898964:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171913728 00000100:00100000:1.0:1787857922.899042:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 93 00000100:00100000:1.0:1787857922.899053:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+111:2347:x1874704171913728:12345-192.168.204.36@tcp:63:ll_sa.0 00010000:00010000:1.0:1787857922.899100:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857922.899127:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7f155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4ac3 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899199:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899224:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899239:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899256:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899264:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899270:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899385:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899394:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899404:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899412:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaeca00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857922.899427:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899437:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899454:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857922.899458:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857922.899464:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899470:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaeca00/0xd3f183cab4a7f15c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899489:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899496:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899501:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899506:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaed000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857922.899508:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899514:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899520:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xbb834312 (ffff9998c2d27e00) 00010000:00010000:1.0:1787857922.899522:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857922.899525:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899530:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed000/0xd3f183cab4a7f163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899567:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7f155 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4ac3 expref: 112 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899578:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857922.899581:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857922.899585:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998efaed200/0xd3f183cab4a7f155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4ac3 expref: 112 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.899595:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9998efaed200, rc -2) 00000100:00100000:1.0:1787857922.899700:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:365dae28-8203-4526-83a5-01baf5c55d8b+111:2347:x1874704171913728:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 648us (1195us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857922.899708:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 93 00000100:00100000:0.0:1787857922.918676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857922.919335:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171913984 00000100:00100000:3.0:1787857922.919351:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171913984 00000100:00100000:3.0:1787857922.919453:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1689 00000100:00100000:3.0:1787857922.919465:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+111:33676:x1874704171913984:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:3.0:1787857922.919531:0:7656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857922.919562:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b6800/0xd3f183cab4a7ee06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4973 expref: 111 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919583:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:3.0:1787857922.919589:0:7656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857922.919617:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919631:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919642:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919658:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919663:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919669:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919812:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919981:0:7656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 52 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.919990:0:7656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.920036:0:7656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 52 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857922.920051:0:7656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 52 pid: 19301 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857922.920066:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188314752:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857922.920184:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f70feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857922.931281:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7656:1874704188314752:192.168.204.36@tcp:104: 00010000:00010000:2.0:1787857922.931342:0:7656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857922.932878:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857922.933108:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171914112 00000100:00100000:1.0:1787857922.933120:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171914112 00010000:00010000:1.0:1787857922.933177:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 53 pid: 19301 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857922.933234:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 502 00000100:00100000:1.0:1787857922.933246:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+53:2350:x1874704171914112:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857922.933266:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857922.933273:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 53 pid: 19301 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.933287:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 53 pid: 19301 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.933328:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6090a00/0xd3f183cab4a7edc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4957 expref: 53 pid: 19301 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.933355:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:1.0:1787857922.933363:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.933374:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.933385:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.933412:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857922.933495:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171914112:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 251us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857922.933503:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 502 00010000:00010000:2.0:1787857922.933979:0:7656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.933992:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857922.935126:0:7656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9432 00000004:00080000:2.0:1787857922.935139:0:7656:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 746985321976ns, next at 747985319368ns, rc = 0 00010000:00010000:2.0:1787857922.935210:0:7656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935228:0:7656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935238:0:7656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935247:0:7656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935254:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935261:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935280:0:7656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857922.935307:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935313:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935319:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935325:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857922.935329:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935337:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935350:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:2.0:1787857922.935353:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787857922.935360:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935366:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5000/0xd3f183cab4a7f178 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935388:0:7656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935393:0:7656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935399:0:7656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935403:0:7656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1787857922.935405:0:7656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935409:0:7656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.935415:0:7656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:1.0:1787857922.935566:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857922.935576:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.935583:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998f72b7600 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857922.935586:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.935593:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.935602:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff9998d12ef600) 00010000:00010000:1.0:1787857922.935604:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857922.935607:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.935618:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f72b7600/0xd3f183cab4a7f17f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.935636:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857922.935639:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857922.935640:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857922.937049:0:7656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857922.937059:0:7656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857922.937070:0:7656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f4c00/0xd3f183cab4a7f16a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857922.937088:0:7656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b730b509 reply state 000000000720599f transno 4294968405 ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857922.937099:0:7656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857922.937256:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+112:33676:x1874704171913984:12345-192.168.204.36@tcp:36:rm.0 Request processed in 17787us (18584us total) trans 4294968405 rc 0/0 00000100:00100000:2.0:1787857922.937266:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1689 00010000:00010000:1.0:1787857922.959088:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.959110:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.959120:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.959126:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1787857922.959132:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.959142:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.959165:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff9998d12ef400) 00010000:00010000:1.0:1787857922.959168:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857922.959173:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857922.959180:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5200/0xd3f183cab4a7f171 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857923.248360:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857923.248373:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857923.258807:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 54 count 1 00000040:00080000:1.0:1787857923.258854:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857923.439365:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188315136:0@lo:400:kworker.0 00000100:00100000:1.0:1787857923.439438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857923.439471:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188315008:0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.439502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857923.439522:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188315520:0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.439545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857923.439587:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188314880:0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.439589:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188315136 00000100:00100000:3.0:1787857923.439597:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188315136 00000100:00100000:2.0:1787857923.439627:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857923.439653:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188315392:0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.439655:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188315008 00000100:00100000:3.0:1787857923.439658:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188315008 00000100:00100000:2.0:1787857923.439676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857923.439681:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1787857923.439689:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188315136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857923.439692:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857923.439696:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188315264:0@lo:400:kworker.0 00000100:00100000:2.0:1787857923.439732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857923.439750:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188315136:12345-0@lo:400:kworker.0 Request processed in 62us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857923.439757:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1787857923.439758:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188314880 00000100:00100000:2.0:1787857923.439761:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188314880 00000100:00100000:3.0:1787857923.439771:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188315392 00000100:00100000:3.0:1787857923.439774:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188315392 00000100:00100000:3.0:1787857923.439788:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1787857923.439789:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1787857923.439794:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188314880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.439806:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188315008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857923.439851:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188314880:12345-0@lo:400:kworker.0 Request processed in 56us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857923.439855:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188315008:12345-0@lo:400:kworker.0 Request processed in 61us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857923.439858:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:3.0:1787857923.439860:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1787857923.439870:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1787857923.439876:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188315392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.439900:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188315392:12345-0@lo:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857923.439906:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1787857923.439918:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188314880:0@lo:400:kworker.0 00000100:00080000:3.0:1787857923.439925:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857923.439933:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188315392:0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.439939:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188315520 00000100:00100000:3.0:1787857923.439942:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188315520 00000100:00100000:3.0:1787857923.439969:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188315264 00000100:00100000:3.0:1787857923.439972:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188315264 00000100:00100000:2.0:1787857923.439972:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188315136:0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.439991:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00080000:2.0:1787857923.439993:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857923.439995:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857923.439998:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188315520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857923.440009:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188315008:0@lo:400:kworker.0 00000100:00100000:3.0:1787857923.440035:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188315520:12345-0@lo:400:kworker.0 Request processed in 37us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857923.440035:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1787857923.440041:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1787857923.440043:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188315264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857923.440074:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188315264:12345-0@lo:400:kworker.0 Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857923.440080:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1787857923.440087:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188315264:0@lo:400:kworker.0 00000100:00100000:2.0:1787857923.440100:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967397 gen 2 00000004:00080000:2.0:1787857923.440105:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9998f7045a40, transno 4294967397 00000100:00100000:2.0:1787857923.440131:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188315520:0@lo:400:kworker.0 00010000:00010000:3.0:1787857923.850224:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857923.961502:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188315648:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1787857923.962122:0:7958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748012303267ns, next at 749012300288ns, rc = 0 00000100:00100000:3.0:1787857923.962237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857923.962857:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188315648 00000100:00100000:1.0:1787857923.962868:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188315648 00000100:00100000:1.0:1787857923.962930:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787857923.962939:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188315648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857923.962980:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857923.963535:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188315648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 594us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857923.963544:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787857923.963743:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188315648:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787857924.034391:0:23235:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857924.034625:0:23235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857924.038122:0:23235:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787857924.038150:0:23235:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857924.846103:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857925.095633:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000001:00080000:2.0:1787857925.095757:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968404 is committed 00000004:00080000:2.0:1787857925.095762:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 26 committed 00000001:00080000:2.0:1787857925.095773:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968405 is committed 00000004:00080000:2.0:1787857925.095776:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 24 committed 00000100:00100000:3.0:1787857925.096135:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188315776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787857925.096222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857925.096285:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857925.096290:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188315904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787857925.096309:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857925.096341:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188315776 00000100:00100000:3.0:1787857925.096348:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188315776 00000100:00100000:3.0:1787857925.096529:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188315904 00000100:00100000:3.0:1787857925.096532:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188315904 00000100:00100000:3.0:1787857925.096554:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1787857925.096562:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188315776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787857925.096592:0:6713:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:3.0:1787857925.096618:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857925.096767:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 23 committed 00010000:00010000:3.0:1787857925.096792:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.096804:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 20 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.096812:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=13s v=(0 0) 00010000:00010000:3.0:1787857925.096834:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857925.096840:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.096886:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 20 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.096907:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 20 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.096920:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188316032:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857925.096996:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 12 pid: 6714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.097007:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 12 pid: 6714 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.097016:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188316160:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857925.097035:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c4fa7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857925.097057:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1787857925.097065:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1874704188315904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787857925.097077:0:14028:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:35 count 1 00010000:00010000:3.0:1787857925.097088:0:14028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.097100:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.097110:0:14028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 20 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.097124:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=13s v=(0 0) 00010000:00010000:3.0:1787857925.097127:0:14028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857925.097131:0:14028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.097147:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 20 pid: 22727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.097156:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 20 pid: 22727 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.097165:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188316288:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857925.097191:0:14028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 12 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.097201:0:14028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 12 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.097209:0:14028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188316416:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857925.097226:0:14028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998f73cfc00 going to sleep for 11 seconds 00000100:00080000:3.0:1787857925.097238:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857925.102363:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188316544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787857925.102463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857925.102519:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857925.102526:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188316672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787857925.102549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857925.102586:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188316544 00000100:00100000:3.0:1787857925.102594:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188316544 00000100:00100000:1.0:1787857925.102802:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188316672 00000100:00100000:1.0:1787857925.102807:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188316672 00000100:00100000:1.0:1787857925.102877:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1787857925.102889:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188316672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787857925.102925:0:22727:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:33 count 1 00010000:00010000:1.0:1787857925.102961:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.102984:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.102994:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.103002:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=13s v=(0 0) 00010000:00010000:1.0:1787857925.103008:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857925.103013:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.103046:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.103060:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 17 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857925.103075:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188316800:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857925.103148:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 9 pid: 6713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.103157:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 9 pid: 6713 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857925.103167:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188316928:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857925.103190:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998c2b843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857925.104008:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1787857925.104023:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874704188316544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787857925.104048:0:6714:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:32 count 1 00010000:00010000:3.0:1787857925.104067:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.104084:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 9 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.104092:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.104100:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=13s v=(0 0) 00010000:00010000:3.0:1787857925.104103:0:6714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857925.104107:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 5/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.104131:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 17 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.104142:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 17 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.104161:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188317056:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857925.104242:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 9 pid: 14028 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.104252:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 9 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.104261:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188317184:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857925.104280:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff9998d1d1f240 going to sleep for 11 seconds 00000100:00080000:3.0:1787857925.104399:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787857925.105576:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 22 committed 00000100:00100000:0.0:1787857925.113237:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.113279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857925.113339:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188316288:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857925.113348:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188316032:192.168.204.36@tcp:104: 00000100:00100000:3.0:1787857925.113354:0:14028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14028:1874704188316416:192.168.204.36@tcp:104: 00000100:00100000:1.0:1787857925.113357:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6713:1874704188316160:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857925.113387:0:14028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.113387:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857925.120173:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171914240 00000100:00100000:1.0:1787857925.120198:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171914240 00000100:00100000:0.0:1787857925.120412:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.120465:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.120545:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.120564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.120576:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.120624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1787857925.120863:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 21 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857925.120893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171914496 00000100:00100000:1.0:1787857925.120896:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171914496 00010000:00010000:1.0:1787857925.120912:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 22 pid: 22727 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857925.120923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171914368 00000100:00100000:1.0:1787857925.120925:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171914368 00000100:00100000:3.0:1787857925.122205:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171914624 00000100:00100000:3.0:1787857925.122218:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171914624 00010000:00010000:3.0:1787857925.122260:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 14 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.122286:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171914880 00000100:00100000:3.0:1787857925.122288:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171914880 00000100:00080000:2.0:1787857925.124609:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857925.124621:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857925.124644:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171915136 00000100:00100000:2.0:1787857925.124654:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171915136 00010000:00010000:2.0:1787857925.124722:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 11 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857925.124753:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171914752 00000100:00100000:2.0:1787857925.124757:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171914752 00010000:00010000:2.0:1787857925.124792:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 18 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857925.124805:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171915008 00000100:00100000:2.0:1787857925.124808:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171915008 00010000:00010000:2.0:1787857925.124838:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 19 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857925.124863:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 503 00000100:00100000:2.0:1787857925.124876:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+22:2349:x1874704171914240:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857925.124898:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857925.124906:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 22 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.124924:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 22 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787857925.124954:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787857925.124963:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b126d278/0xd3f183cab4a7eff0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a84 expref: 22 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.125125:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857925.125217:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+21:2349:x1874704171914240:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 341us (12000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857925.125225:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 503 00000100:00100000:2.0:1787857925.125251:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 504 00000100:00100000:2.0:1787857925.125260:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d039b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+20:2349:x1874704171914496:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857925.125270:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857925.125276:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 20 pid: 22727 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.125286:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 20 pid: 22727 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.125298:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000359e4f4d/0xd3f183cab4a7eff7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a92 expref: 20 pid: 22727 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.125310:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857925.125328:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d039b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171914496:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 70us (12049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857925.125334:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 504 00000100:00100000:2.0:1787857925.125878:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 505 00000100:00100000:2.0:1787857925.125889:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+14:2349:x1874704171914624:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857925.125902:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857925.125909:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 14 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.125920:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 14 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126066:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c21d22ae/0xd3f183cab4a7ef80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a3e expref: 14 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126084:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857925.126090:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857925.126097:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126116:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126151:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857925.126187:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+13:2349:x1874704171914624:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 300us (5721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857925.126194:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 505 00000100:00100000:2.0:1787857925.126214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 506 00000100:00100000:2.0:1787857925.126222:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171915136:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857925.126231:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857925.126238:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 11 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126248:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 11 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126266:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857925.126284:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901220780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171915136:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 63us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857925.126290:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 506 00000100:00100000:2.0:1787857925.126306:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 507 00000100:00100000:2.0:1787857925.126313:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171914752:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857925.126322:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857925.126327:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 19 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126336:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 19 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126352:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857925.126368:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171914752:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 56us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857925.126374:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 507 00010000:00010000:0.0:1787857925.126569:0:14028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.126581:0:14028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.126594:0:14028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.126603:0:14028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.126625:0:14028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857925.126659:0:7647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857925.126666:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.126674:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f4000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:0.0:1787857925.126689:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.126699:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.126712:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857925.126716:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 508 00010000:00010000:0.0:1787857925.126720:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d6ffcb/0xd3f183cab4a7f18d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857925.126724:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171915008:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857925.126734:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857925.126738:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 18 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.126742:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857925.126744:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857925.126746:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857925.126749:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 18 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126763:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857925.126766:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857925.126771:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126778:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.126795:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857925.126842:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:365dae28-8203-4526-83a5-01baf5c55d8b+18:2350:x1874704171915008:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 119us (6219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857925.126849:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 508 00010000:00010000:1.0:1787857925.127885:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 12 pid: 6714 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128098:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 10 pid: 6713 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.128121:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 509 00000100:00100000:3.0:1787857925.128132:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+12:2349:x1874704171914368:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857925.128145:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857925.128149:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 12 pid: 6714 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128162:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 12 pid: 6714 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128185:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d402e326/0xd3f183cab4a7ec9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48bd expref: 12 pid: 6714 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128203:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857925.128208:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857925.128214:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128225:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128255:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857925.128300:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171914368:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 171us (7898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857925.128308:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 509 00000100:00100000:3.0:1787857925.128323:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 510 00000100:00100000:3.0:1787857925.128329:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171914880:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857925.128336:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857925.128340:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 10 pid: 6713 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128351:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 10 pid: 6713 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128366:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857925.128369:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857925.128373:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128388:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.128398:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857925.128413:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+10:2350:x1874704171914880:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 84us (7868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857925.128419:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 510 00010000:00010000:1.0:1787857925.128841:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003738cf89/0xd3f183cab4a7f013 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a99 expref: 17 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857925.128856:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188316800:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857925.128872:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002075f2ed/0xd3f183cab4a7ef87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a4c expref: 10 pid: 6713 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857925.128882:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22727:1874704188316928:192.168.204.36@tcp:104: 00010000:00010000:1.0:1787857925.128912:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.128924:0:22727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.129080:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.129091:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.129100:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.129499:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff03c6a0/0xd3f183cab4a7f00c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4a8b expref: 16 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.129511:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188317056:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857925.129524:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef54c7aa/0xd3f183cab4a7eca1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.36@tcp remote: 0x6587464c02fd48c4 expref: 8 pid: 14028 timeout: 849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.129535:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6714:1874704188317184:192.168.204.36@tcp:104: 00010000:00010000:3.0:1787857925.129550:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.129558:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.129565:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.129573:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857925.129581:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.129607:0:22727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787857925.130948:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857925.130961:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.130973:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998efaeca00 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857925.130978:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.130987:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.131006:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.131014:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e08b5482/0xd3f183cab4a7f194 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.131044:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857925.131049:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.131060:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5000 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:2.0:1787857925.131063:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.131070:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.131080:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.131088:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857925.131089:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857925.131091:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857925.131244:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188316672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28353us (28689us total) trans 4294967384 rc 0/0 00000100:00100000:0.0:1787857925.131244:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3302:x1874704188315904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34175us (34928us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787857925.131256:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000004:00080000:2.0:1787857925.131322:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999900d4cb40/2, rc 0, transno 4294967398 00000100:00100000:2.0:1787857925.131329:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188315904:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787857925.131362:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999901452580/2, rc 0, transno 4294967384 00000100:00100000:2.0:1787857925.131367:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188316672:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787857925.133705:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.133733:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.133750:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.133761:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857925.133806:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787857925.134045:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00010000:00010000:1.0:1787857925.134830:0:17404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857925.134840:0:17404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.134852:0:17404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9998da8f5200 already unused, calling callback (ffffffffc16b0440) 00010000:00010000:1.0:1787857925.134858:0:17404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.134869:0:17404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.134895:0:17404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857925.134903:0:17404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ecb2ef/0xd3f183cab4a7f186 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857925.135184:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857925.135187:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857925.135189:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857925.135882:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1874704188315776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 39314us (39653us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787857925.135894:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000004:00080000:2.0:1787857925.136613:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999900d4f480/2, rc 0, transno 4294967399 00000100:00100000:2.0:1787857925.136626:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188315776:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787857925.136738:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857925.136812:0:6714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857925.137712:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000939d11e8/0xd3f183cab4a7f19b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857925.140451:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874704188316544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36425us (37979us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1787857925.140467:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000004:00080000:2.0:1787857925.140615:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999901450f00/2, rc 0, transno 4294967385 00000100:00100000:2.0:1787857925.140624:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188316544:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787857925.586230:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967398 is committed 00000001:00080000:3.0:1787857925.586249:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967399 is committed 00000100:00100000:0.0:1787857925.716488:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.716550:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.716587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.716611:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.716632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.716651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.716690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857925.716728:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171915520 00000100:00100000:0.0:1787857925.716741:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171915520 00000100:00100000:1.0:1787857925.716785:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171915392 00000100:00100000:1.0:1787857925.716791:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171915392 00000100:00100000:0.0:1787857925.716804:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171916032 00000100:00100000:0.0:1787857925.716808:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171916032 00000100:00100000:0.0:1787857925.716862:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171915648 00000100:00100000:0.0:1787857925.716866:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171915648 00000100:00100000:1.0:1787857925.716882:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171915776 00000100:00100000:1.0:1787857925.716888:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171915776 00000100:00100000:0.0:1787857925.716898:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171915904 00000100:00100000:0.0:1787857925.716903:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171915904 00000100:00100000:0.0:1787857925.716930:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 559 00000100:00100000:1.0:1787857925.716933:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 535 00000100:00100000:0.0:1787857925.716943:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171915520:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857925.716948:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171915392:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857925.717198:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171915264 00000100:00100000:3.0:1787857925.717203:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171915264 00000100:00100000:3.0:1787857925.717244:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 634 00000100:00100000:3.0:1787857925.717253:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171915264:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857925.717363:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efa6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171915392:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 420us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857925.717372:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 535 00000100:00100000:1.0:1787857925.717397:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 536 00000100:00100000:1.0:1787857925.717406:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171915776:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857925.718298:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171915264:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1037us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857925.718312:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 634 00000100:00100000:1.0:1787857925.718583:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171915776:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1177us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857925.718594:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 536 00000100:00100000:1.0:1787857925.718651:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 560 00000100:00100000:1.0:1787857925.718676:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171916032:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857925.718719:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171916032:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 59us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857925.718727:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 560 00000100:00100000:1.0:1787857925.718746:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 561 00000100:00100000:1.0:1787857925.718754:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171915648:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857925.718783:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171915648:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857925.718790:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 561 00000100:00100000:1.0:1787857925.718804:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 562 00000100:00100000:1.0:1787857925.718811:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171915904:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857925.719326:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171915520:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 2379us (2731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857925.719338:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 559 00000100:00100000:1.0:1787857925.720167:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171915904:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1350us (3471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857925.720177:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 562 00000100:00080000:1.0:1787857925.720347:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857925.873130:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857926.153811:0:23290:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857926.153867:0:23290:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857926.157423:0:23290:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857926.157448:0:23290:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787857926.600211:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967384 is committed 00000001:00080000:3.0:1787857926.600384:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967385 is committed 00010000:00010000:2.0:1787857926.899703:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857927.022424:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188317312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857927.022510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857927.022757:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188317312 00000100:00100000:1.0:1787857927.022768:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188317312 00000100:00100000:1.0:1787857927.022875:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787857927.022887:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188317312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857927.022926:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857927.022986:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188317312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857927.022993:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:2.0:1787857927.023120:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857927.023454:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967385 gen 2 00000004:00080000:0.0:1787857927.023461:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999901452580, transno 4294967384 00000004:00080000:0.0:1787857927.023478:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999901450f00, transno 4294967385 00000100:00100000:0.0:1787857927.023494:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188317312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857927.919228:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857928.299041:0:23344:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857928.299056:0:23344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857928.300153:0:23344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857928.300166:0:23344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857928.561088:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188317824:0@lo:400:kworker.0 00000100:00100000:1.0:1787857928.561249:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188317440:0@lo:400:kworker.0 00000100:00100000:1.0:1787857928.561292:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857928.561344:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188317952:0@lo:400:kworker.0 00000100:00100000:1.0:1787857928.561374:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857928.561419:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188317952 00000100:00100000:1.0:1787857928.561426:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188317952 00000100:00100000:1.0:1787857928.561490:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1787857928.561499:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188317952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857928.561551:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188317952:12345-0@lo:400:kworker.0 Request processed in 53us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857928.561559:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1787857928.561607:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188317952:0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.562277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857928.562348:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188317696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.562388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857928.562415:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787857928.562421:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188317568:0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.562446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857928.562462:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188318080:0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.562485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857928.562516:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188317696 00000100:00100000:0.0:1787857928.562522:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188317696 00000100:00100000:0.0:1787857928.562563:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188317568 00000100:00100000:0.0:1787857928.562566:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188317568 00000100:00100000:0.0:1787857928.562586:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1787857928.562595:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188317696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.562804:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188317696:12345-0@lo:400:kworker.0 Request processed in 208us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857928.562811:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1787857928.562853:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1787857928.562859:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188317568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.562887:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188317568:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857928.562893:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1787857928.562910:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188317824 00000100:00100000:0.0:1787857928.562914:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188317824 00000100:00100000:0.0:1787857928.562938:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188318080 00000100:00100000:0.0:1787857928.562941:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188318080 00000100:00100000:0.0:1787857928.562960:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1787857928.562966:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188317824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.563002:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188317824:12345-0@lo:400:kworker.0 Request processed in 36us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857928.563009:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1787857928.563020:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1787857928.563026:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188318080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.563052:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188318080:12345-0@lo:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857928.563058:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1787857928.563091:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188317568:0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.563101:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967399 gen 2 00000004:00080000:0.0:1787857928.563105:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999900d4cb40, transno 4294967398 00000004:00080000:0.0:1787857928.563115:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999900d4f480, transno 4294967399 00000100:00100000:0.0:1787857928.563119:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188318080:0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.563131:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188317696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857928.563244:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188317824:0@lo:400:kworker.0 00000100:00100000:3.0:1787857928.563877:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188317440 00000100:00100000:3.0:1787857928.563883:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188317440 00000100:00100000:3.0:1787857928.563918:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1787857928.563926:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188317440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857928.563977:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188317440:12345-0@lo:400:kworker.0 Request processed in 52us (2684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857928.563982:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1787857928.564028:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188317440:0@lo:400:kworker.0 00000100:00080000:3.0:1787857928.564055:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857928.564060:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857928.942193:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857929.070586:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188318208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857929.070678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857929.070878:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188318208 00000100:00100000:1.0:1787857929.070887:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188318208 00000100:00100000:1.0:1787857929.071102:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787857929.071113:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188318208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857929.071149:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787857929.071207:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188318208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857929.071215:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787857929.071307:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188318208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857929.968255:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857930.551534:0:23396:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857930.551545:0:23396:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857930.552585:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857930.552606:0:23396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857930.843381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857930.843433:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857930.843471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857930.843508:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857930.843527:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857930.843546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857930.843580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857930.843646:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171916416 00000100:00100000:0.0:1787857930.843656:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171916416 00000100:00100000:0.0:1787857930.843749:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171916928 00000100:00100000:0.0:1787857930.843752:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171916928 00000100:00100000:0.0:1787857930.843775:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171916544 00000100:00100000:0.0:1787857930.843779:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171916544 00000100:00100000:1.0:1787857930.843805:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171916800 00000100:00100000:1.0:1787857930.843811:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171916800 00000100:00100000:1.0:1787857930.843873:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 565 00000100:00100000:1.0:1787857930.843884:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171916416:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857930.843985:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171916416:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 103us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857930.843993:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 565 00000100:00100000:1.0:1787857930.844011:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 566 00000100:00100000:1.0:1787857930.844019:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171916928:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857930.844051:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 567 00000100:00100000:1.0:1787857930.844064:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171916928:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 44us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857930.844065:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171916800:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857930.844080:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 566 00000100:00100000:1.0:1787857930.844102:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 568 00000100:00100000:1.0:1787857930.844110:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171916544:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857930.844116:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171916800:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 54us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857930.844125:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 567 00000100:00100000:1.0:1787857930.844141:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171916544:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857930.844148:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 568 00000100:00080000:0.0:1787857930.844151:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857930.844157:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857930.844312:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171916672 00000100:00100000:0.0:1787857930.844317:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171916672 00000100:00100000:0.0:1787857930.844357:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171916288 00000100:00100000:0.0:1787857930.844361:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171916288 00000100:00100000:0.0:1787857930.844464:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 540 00000100:00100000:0.0:1787857930.844472:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171916672:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857930.844509:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171916672:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857930.844516:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 540 00000100:00100000:0.0:1787857930.844529:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 541 00000100:00100000:0.0:1787857930.844536:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171916288:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857930.844563:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171916288:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857930.844582:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 541 00000100:00080000:1.0:1787857930.845457:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857930.845613:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171916160 00000100:00100000:2.0:1787857930.845627:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171916160 00000100:00100000:2.0:1787857930.845784:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 636 00000100:00100000:2.0:1787857930.845799:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171916160:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857930.846399:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171916160:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 603us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857930.846408:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 636 00010000:00010000:2.0:1787857930.991205:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857932.014124:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857932.142123:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188318336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857932.142204:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857932.142411:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188318336 00000100:00100000:2.0:1787857932.142422:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188318336 00000100:00100000:2.0:1787857932.142512:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787857932.142526:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188318336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857932.142588:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857932.142659:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188318336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857932.142670:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787857932.142742:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188318336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787857932.142858:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787857932.599789:0:23450:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857932.599800:0:23450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857932.601558:0:23450:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857932.601587:0:23450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857933.038448:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857933.486151:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857933.486162:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857933.490388:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857933.490569:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857933.680130:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188318464:0@lo:400:kworker.0 00000100:00100000:3.0:1787857933.680251:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857933.680322:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188318976:0@lo:400:kworker.0 00000100:00100000:3.0:1787857933.680389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857933.680429:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857933.680436:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188318848:0@lo:400:kworker.0 00000100:00100000:3.0:1787857933.680469:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857933.680521:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188318976 00000100:00100000:3.0:1787857933.680531:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188318976 00000100:00100000:3.0:1787857933.680635:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1787857933.680647:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188318976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857933.680711:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188318976:12345-0@lo:400:kworker.0 Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857933.680723:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1787857933.680749:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188318848 00000100:00100000:3.0:1787857933.680753:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188318848 00000100:00100000:3.0:1787857933.680781:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1787857933.680789:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188318848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857933.680876:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188318848:12345-0@lo:400:kworker.0 Request processed in 88us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857933.680882:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00080000:3.0:1787857933.680900:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857933.680962:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188318848:0@lo:400:kworker.0 00000100:00100000:3.0:1787857933.680973:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188318976:0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.681603:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188318592:0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.681663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857933.681707:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188319104:0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.681731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857933.681757:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857933.681765:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188318720:0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.681788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857933.681859:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188319104 00000100:00100000:0.0:1787857933.681865:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188319104 00000100:00100000:0.0:1787857933.681906:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1787857933.681913:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188319104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.681957:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188319104:12345-0@lo:400:kworker.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857933.681963:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1787857933.681983:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188318592 00000100:00100000:0.0:1787857933.681987:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188318592 00000100:00100000:0.0:1787857933.682010:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188318720 00000100:00100000:0.0:1787857933.682013:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188318720 00000100:00100000:0.0:1787857933.682033:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1787857933.682039:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188318592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.682070:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188318592:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857933.682075:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1787857933.682085:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1787857933.682090:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188318720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.682114:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188318720:12345-0@lo:400:kworker.0 Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857933.682119:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1787857933.682152:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188318720:0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.682160:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188318592:0@lo:400:kworker.0 00000100:00100000:0.0:1787857933.682168:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188319104:0@lo:400:kworker.0 00000100:00100000:1.0:1787857933.683435:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188318464 00000100:00100000:1.0:1787857933.683448:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188318464 00000100:00100000:1.0:1787857933.683510:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:1.0:1787857933.683534:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188318464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857933.683625:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188318464:12345-0@lo:400:kworker.0 Request processed in 93us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857933.683632:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1787857933.683779:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188318464:0@lo:400:kworker.0 00000100:00080000:3.0:1787857933.684008:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857933.684015:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857934.063305:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857934.192369:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188319232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857934.192479:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857934.192552:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188319232 00000100:00100000:3.0:1787857934.192563:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188319232 00000100:00100000:3.0:1787857934.192614:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787857934.192623:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188319232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857934.192663:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857934.192719:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188319232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857934.192727:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787857934.192774:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188319232:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787857934.587316:0:23501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857934.587329:0:23501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857934.588159:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857934.588173:0:23501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857935.087422:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857935.953556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857935.953605:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857935.953637:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857935.953670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857935.953692:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857935.953710:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857935.953737:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857935.953769:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171917440 00000100:00100000:1.0:1787857935.953780:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171917440 00000100:00100000:1.0:1787857935.953879:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171917696 00000100:00100000:1.0:1787857935.953883:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171917696 00000100:00100000:1.0:1787857935.953901:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171917312 00000100:00100000:1.0:1787857935.953903:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171917312 00000100:00100000:1.0:1787857935.953916:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171917824 00000100:00100000:1.0:1787857935.953918:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171917824 00000100:00100000:1.0:1787857935.954049:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 571 00000100:00100000:1.0:1787857935.954060:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171917440:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857935.954147:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171917440:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 88us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857935.954155:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 571 00000100:00100000:1.0:1787857935.954187:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 572 00000100:00100000:1.0:1787857935.954194:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171917696:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857935.954221:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171917696:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857935.954227:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 572 00000100:00100000:1.0:1787857935.954240:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 573 00000100:00100000:1.0:1787857935.954245:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171917312:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857935.954267:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171917312:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857935.954274:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 573 00000100:00100000:1.0:1787857935.954287:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 574 00000100:00100000:1.0:1787857935.954293:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171917824:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857935.954315:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171917824:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857935.954322:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 574 00000100:00100000:1.0:1787857935.954342:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171917056 00000100:00100000:1.0:1787857935.954346:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171917056 00000100:00100000:1.0:1787857935.954372:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 638 00000100:00100000:1.0:1787857935.954379:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171917056:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857935.954405:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171917056:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857935.954412:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 638 00000100:00100000:1.0:1787857935.954451:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171917184 00000100:00100000:1.0:1787857935.954455:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171917184 00000100:00100000:1.0:1787857935.954496:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171917568 00000100:00100000:1.0:1787857935.954499:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171917568 00000100:00100000:1.0:1787857935.954518:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 545 00000100:00100000:1.0:1787857935.954524:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171917184:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857935.954554:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171917184:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857935.954560:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 545 00000100:00100000:1.0:1787857935.954571:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 546 00000100:00100000:1.0:1787857935.954577:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171917568:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857935.954603:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171917568:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857935.954610:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 546 00000100:00080000:1.0:1787857935.954633:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857935.954638:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857935.954640:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857936.110200:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857936.648280:0:23552:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857936.648293:0:23552:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857936.650522:0:23552:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857936.650551:0:23552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857937.138234:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857937.262159:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857937.264785:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188319360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857937.264913:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857937.270140:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188319360 00000100:00100000:2.0:1787857937.270221:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188319360 00000100:00100000:2.0:1787857937.270397:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787857937.270409:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188319360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857937.270461:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857937.270584:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188319360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (5671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857937.270592:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787857937.271463:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188319360:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857937.279134:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857938.161675:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857938.790598:0:23603:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857938.790611:0:23603:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857938.791197:0:23603:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787857938.791207:0:23603:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857938.807200:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188319488:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.807288:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857938.807341:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188320000:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.807370:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857938.807397:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857938.807403:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188319872:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.807442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857938.807473:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188319616:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.807497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857938.807512:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188320128:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.808423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857938.808460:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857938.808470:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188319744:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.808496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857938.808620:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188319488 00000100:00100000:1.0:1787857938.808629:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188319488 00000100:00100000:1.0:1787857938.808680:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1787857938.808690:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188319488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.808986:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188319488:12345-0@lo:400:kworker.0 Request processed in 296us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857938.808995:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1787857938.809036:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188320000 00000100:00100000:1.0:1787857938.809040:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188320000 00000100:00100000:1.0:1787857938.809084:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188319616 00000100:00100000:1.0:1787857938.809089:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188319616 00000100:00100000:1.0:1787857938.809109:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188319744 00000100:00100000:1.0:1787857938.809112:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188319744 00000100:00100000:1.0:1787857938.809131:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1787857938.809137:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188320000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809245:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188320000:12345-0@lo:400:kworker.0 Request processed in 107us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857938.809252:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1787857938.809267:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1787857938.809273:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188319616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809308:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188319616:12345-0@lo:400:kworker.0 Request processed in 35us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857938.809315:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1787857938.809328:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1787857938.809335:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188319744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809363:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188319744:12345-0@lo:400:kworker.0 Request processed in 30us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857938.809370:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1787857938.809394:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188319872 00000100:00100000:1.0:1787857938.809398:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188319872 00000100:00100000:1.0:1787857938.809436:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188320128 00000100:00100000:1.0:1787857938.809440:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188320128 00000100:00100000:1.0:1787857938.809466:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1787857938.809476:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188319872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809510:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188319872:12345-0@lo:400:kworker.0 Request processed in 36us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857938.809593:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1787857938.809606:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1787857938.809613:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188320128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809645:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188320128:12345-0@lo:400:kworker.0 Request processed in 34us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857938.809651:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1787857938.809705:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188319872:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809716:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188319488:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809727:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188320000:0@lo:400:kworker.0 00000100:00080000:1.0:1787857938.809919:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857938.809925:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857938.809952:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188319744:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809965:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188319616:0@lo:400:kworker.0 00000100:00100000:1.0:1787857938.809975:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188320128:0@lo:400:kworker.0 00010000:00010000:2.0:1787857939.185703:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857939.311638:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857939.311666:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188320256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857939.311757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857939.311834:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188320256 00000100:00100000:2.0:1787857939.311843:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188320256 00000100:00100000:2.0:1787857939.312001:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787857939.312012:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188320256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857939.312058:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857939.312126:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188320256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857939.312135:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787857939.312259:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188320256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787857940.207170:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857941.037766:0:23655:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857941.037778:0:23655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857941.046641:0:23655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857941.046674:0:23655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857941.075087:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857941.075139:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857941.075170:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857941.075198:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857941.075227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857941.075245:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857941.075264:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857941.075298:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171918208 00000100:00100000:0.0:1787857941.075312:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171918208 00000100:00100000:0.0:1787857941.075402:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171918720 00000100:00100000:0.0:1787857941.075406:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171918720 00000100:00100000:0.0:1787857941.075429:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171918336 00000100:00100000:0.0:1787857941.075432:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171918336 00000100:00100000:0.0:1787857941.075447:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171918592 00000100:00100000:0.0:1787857941.075450:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171918592 00000100:00100000:0.0:1787857941.075469:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 577 00000100:00100000:0.0:1787857941.075480:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171918208:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857941.075591:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171918208:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 112us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857941.075604:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 577 00000100:00100000:0.0:1787857941.075804:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 578 00000100:00100000:0.0:1787857941.075811:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171918720:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857941.075875:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171918720:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 63us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857941.075882:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 578 00000100:00100000:0.0:1787857941.075897:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 579 00000100:00100000:0.0:1787857941.075902:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171918336:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857941.075924:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171918336:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857941.075931:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 579 00000100:00100000:0.0:1787857941.075942:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 580 00000100:00100000:0.0:1787857941.075948:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171918592:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857941.075971:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171918592:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857941.075976:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 580 00000100:00100000:3.0:1787857941.076317:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171917952 00000100:00100000:3.0:1787857941.076324:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171917952 00000100:00100000:3.0:1787857941.076387:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 640 00000100:00100000:3.0:1787857941.076396:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171917952:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857941.076430:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171917952:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857941.076438:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 640 00000100:00100000:1.0:1787857941.076873:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171918464 00000100:00100000:1.0:1787857941.076880:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171918464 00000100:00100000:1.0:1787857941.077182:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171918080 00000100:00100000:1.0:1787857941.077187:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171918080 00000100:00100000:1.0:1787857941.077227:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 550 00000100:00100000:1.0:1787857941.077237:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171918464:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857941.077288:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171918464:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 54us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857941.077293:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 550 00000100:00100000:1.0:1787857941.077309:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 551 00000100:00100000:1.0:1787857941.077315:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171918080:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857941.077341:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171918080:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857941.077346:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 551 00000100:00080000:1.0:1787857941.077395:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857941.077402:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857941.077405:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787857941.229950:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857942.254604:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857942.382269:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857942.385737:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188320384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857942.385875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857942.386079:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188320384 00000100:00100000:2.0:1787857942.386090:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188320384 00000100:00080000:3.0:1787857942.386217:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857942.386316:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787857942.386332:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188320384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857942.386395:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857942.386481:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188320384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857942.386489:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787857942.386580:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188320384:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787857943.062696:0:23706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857943.062707:0:23706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857943.063975:0:23706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787857943.063994:0:23706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857943.278350:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857943.726331:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857943.726347:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857943.727006:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857943.727020:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857943.918385:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188320512:0@lo:400:kworker.0 00000100:00100000:3.0:1787857943.918459:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188320640:0@lo:400:kworker.0 00000100:00100000:2.0:1787857943.924289:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188320896:0@lo:400:kworker.0 00000100:00100000:3.0:1787857943.924540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857943.924619:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188321152:0@lo:400:kworker.0 00000100:00100000:3.0:1787857943.924648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857943.924701:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857943.924710:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188320768:0@lo:400:kworker.0 00000100:00100000:3.0:1787857943.924738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857943.924795:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188320640 00000100:00100000:3.0:1787857943.924806:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188320640 00000100:00100000:3.0:1787857943.924883:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188320768 00000100:00100000:3.0:1787857943.924887:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188320768 00000100:00100000:3.0:1787857943.924937:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1787857943.924950:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188320640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857943.925031:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188320640:12345-0@lo:400:kworker.0 Request processed in 84us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857943.925039:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1787857943.925058:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1787857943.925064:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188320768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857943.925092:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188320768:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857943.925097:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00080000:3.0:1787857943.925117:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857943.925153:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188320768:0@lo:400:kworker.0 00000100:00100000:3.0:1787857943.925166:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188320640:0@lo:400:kworker.0 00000100:00100000:0.0:1787857943.927140:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857943.927274:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188321024:0@lo:400:kworker.0 00000100:00100000:0.0:1787857943.927385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857943.927457:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188321152 00000100:00100000:0.0:1787857943.927470:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188321152 00000100:00100000:0.0:1787857943.927560:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1787857943.927573:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188321152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857943.927691:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188321024 00000100:00100000:1.0:1787857943.927707:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188321024 00000100:00100000:1.0:1787857943.927795:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1787857943.927806:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188321024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857943.927947:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188320512 00000100:00100000:3.0:1787857943.927952:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188320512 00000100:00100000:3.0:1787857943.927984:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1787857943.927991:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188320512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857943.929582:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188321024:12345-0@lo:400:kworker.0 Request processed in 1769us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857943.929599:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1787857943.929683:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188321024:0@lo:400:kworker.0 00000100:00080000:1.0:1787857943.929749:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857943.929757:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857943.931404:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188320512:12345-0@lo:400:kworker.0 Request processed in 3397us (4265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857943.931434:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1787857943.931658:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188320512:0@lo:400:kworker.0 00000100:00100000:0.0:1787857943.935158:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188321152:12345-0@lo:400:kworker.0 Request processed in 7562us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857943.935310:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188321152:0@lo:400:kworker.0 00000100:00100000:0.0:1787857943.935346:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1787857943.936468:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857943.940486:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188320896 00000100:00100000:1.0:1787857943.940503:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188320896 00000100:00100000:1.0:1787857943.940586:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1787857943.940598:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188320896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857943.940740:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188320896:12345-0@lo:400:kworker.0 Request processed in 145us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857943.940749:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1787857943.940981:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188320896:0@lo:400:kworker.0 00010000:00010000:0.0:1787857944.302711:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857944.431281:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857944.431323:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188321280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857944.431417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857944.431637:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188321280 00000100:00100000:2.0:1787857944.431647:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188321280 00000100:00100000:2.0:1787857944.431716:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787857944.431727:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188321280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857944.431771:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857944.432149:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188321280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 423us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857944.432157:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787857944.433474:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188321280:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787857945.087730:0:23757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857945.087962:0:23757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857945.088577:0:23757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787857945.088658:0:23757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787857945.328225:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857946.195695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857946.195742:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857946.195782:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857946.195811:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857946.195946:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171919360 00000100:00100000:3.0:1787857946.195971:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171919360 00000100:00100000:3.0:1787857946.196048:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 555 00000100:00100000:3.0:1787857946.196057:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2347:x1874704171919360:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857946.196131:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2347:x1874704171919360:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857946.196140:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 555 00000100:00080000:3.0:1787857946.196179:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857946.196240:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171918848 00000100:00100000:0.0:1787857946.196245:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171918848 00000100:00100000:0.0:1787857946.196290:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 642 00000100:00100000:0.0:1787857946.196298:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171918848:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857946.196327:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171918848:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857946.196333:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 642 00000100:00100000:1.0:1787857946.199000:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857946.199034:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857946.199083:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171918976 00000100:00100000:0.0:1787857946.199093:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171918976 00000100:00100000:0.0:1787857946.199164:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 556 00000100:00100000:0.0:1787857946.199174:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2347:x1874704171918976:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857946.199246:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2347:x1874704171918976:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857946.199254:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 556 00000100:00080000:0.0:1787857946.199354:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857946.200800:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171919104 00000100:00100000:3.0:1787857946.200811:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171919104 00000100:00100000:3.0:1787857946.201058:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171919616 00000100:00100000:3.0:1787857946.201063:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171919616 00000100:00100000:3.0:1787857946.201093:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 583 00000100:00100000:3.0:1787857946.201104:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171919104:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857946.201163:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171919104:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 63us (5421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857946.201171:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 583 00000100:00100000:3.0:1787857946.201186:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 584 00000100:00100000:3.0:1787857946.201193:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171919616:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857946.201217:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171919616:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (5407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857946.201225:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 584 00000100:00080000:0.0:1787857946.201371:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857946.201376:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857946.202887:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857946.203514:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171919232 00000100:00100000:2.0:1787857946.203525:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171919232 00000100:00100000:2.0:1787857946.203606:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171919488 00000100:00100000:2.0:1787857946.203609:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171919488 00000100:00100000:2.0:1787857946.203639:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 585 00000100:00100000:2.0:1787857946.203651:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171919232:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857946.203720:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171919232:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 71us (4685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857946.203728:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 585 00000100:00100000:2.0:1787857946.203743:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 586 00000100:00100000:2.0:1787857946.203749:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171919488:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857946.203775:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171919488:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857946.203781:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 586 00000100:00080000:0.0:1787857946.204856:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857946.204865:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857946.350732:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857947.129790:0:23809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857947.129801:0:23809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857947.132567:0:23809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857947.132591:0:23809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857947.374117:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857947.502440:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188321408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857947.502530:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857947.502647:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188321408 00000100:00100000:0.0:1787857947.502656:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188321408 00000100:00100000:0.0:1787857947.502745:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787857947.502756:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188321408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857947.502795:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:1.0:1787857947.503049:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857947.503323:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188321408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 566us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857947.503331:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787857947.503411:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188321408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857948.398298:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857949.033408:0:23860:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857949.033419:0:23860:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857949.035391:0:23860:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857949.035410:0:23860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857949.043394:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188321536:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.043477:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857949.043524:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188322048:0@lo:400:kworker.0 00000100:00100000:1.0:1787857949.043644:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188321664:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.043736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857949.043751:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857949.043767:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857949.043772:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188322176:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.043773:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188321920:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.043799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857949.043809:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188322048 00000100:00100000:1.0:1787857949.043845:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188322048 00000100:00100000:1.0:1787857949.044101:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188321664 00000100:00100000:1.0:1787857949.044107:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188321664 00000100:00100000:1.0:1787857949.044135:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1787857949.044144:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188322048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.044158:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188321792:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.044186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857949.044195:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990151d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188322048:12345-0@lo:400:kworker.0 Request processed in 53us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857949.044202:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1787857949.044225:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188321792 00000100:00100000:1.0:1787857949.044230:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188321792 00000100:00100000:1.0:1787857949.044249:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1787857949.044254:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188321664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857949.044283:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188321664:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857949.044289:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1787857949.044296:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188321536 00000100:00100000:1.0:1787857949.044300:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1787857949.044300:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188321536 00000100:00100000:1.0:1787857949.044305:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188321792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857949.044336:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188321792:12345-0@lo:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857949.044342:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00080000:1.0:1787857949.044359:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857949.044383:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1787857949.044391:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188321536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.044432:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188321536:12345-0@lo:400:kworker.0 Request processed in 35us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857949.044439:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1787857949.044475:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188321920 00000100:00100000:0.0:1787857949.044478:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188321920 00000100:00100000:0.0:1787857949.044520:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1787857949.044526:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188321920:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787857949.044649:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857949.044707:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c2ca1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188321920:12345-0@lo:400:kworker.0 Request processed in 181us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857949.044714:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1787857949.044770:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188321792:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.044801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857949.044858:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188321664:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.044884:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188321920:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.044893:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188321536:0@lo:400:kworker.0 00000100:00100000:0.0:1787857949.044903:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188322048:0@lo:400:kworker.0 00000100:00100000:1.0:1787857949.046408:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188322176 00000100:00100000:1.0:1787857949.046417:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188322176 00000100:00100000:1.0:1787857949.046482:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1787857949.046490:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188322176:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787857949.046680:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857949.048720:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188322176:12345-0@lo:400:kworker.0 Request processed in 306us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857949.048739:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1787857949.048912:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188322176:0@lo:400:kworker.0 00010000:00010000:1.0:1787857949.421980:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857949.552204:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857949.552241:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188322304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857949.552322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857949.552901:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188322304 00000100:00100000:2.0:1787857949.552911:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188322304 00000100:00100000:2.0:1787857949.552974:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787857949.552984:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188322304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857949.553028:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857949.553149:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188322304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857949.553158:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787857949.560395:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188322304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857950.446599:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857951.087064:0:23911:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857951.087081:0:23911:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857951.088041:0:23911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857951.088061:0:23911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857951.313456:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857951.313494:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171919744 00000100:00100000:3.0:1787857951.313503:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171919744 00000100:00100000:3.0:1787857951.313563:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 644 00000100:00100000:3.0:1787857951.313575:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171919744:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857951.313669:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171919744:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857951.313678:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 644 00000100:00100000:2.0:1787857951.336970:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857951.337020:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857951.337041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857951.337058:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857951.337089:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857951.337893:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171920128 00000100:00100000:1.0:1787857951.337913:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171920128 00000100:00100000:1.0:1787857951.337993:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171920384 00000100:00100000:1.0:1787857951.337998:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171920384 00000100:00100000:1.0:1787857951.338022:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171920000 00000100:00100000:1.0:1787857951.338024:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171920000 00000100:00100000:1.0:1787857951.338048:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 589 00000100:00100000:1.0:1787857951.338058:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171920128:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857951.338159:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171920128:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 102us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857951.338167:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 589 00000100:00100000:1.0:1787857951.338196:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 590 00000100:00100000:1.0:1787857951.338202:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171920384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857951.338228:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998efab70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171920384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857951.338235:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 590 00000100:00100000:1.0:1787857951.338248:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 591 00000100:00100000:1.0:1787857951.338253:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171920000:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857951.338275:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171920000:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857951.338282:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 591 00000100:00080000:1.0:1787857951.338299:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857951.338304:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857951.339320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857951.339363:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171919872 00000100:00100000:2.0:1787857951.339371:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171919872 00000100:00100000:2.0:1787857951.339428:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171920256 00000100:00100000:2.0:1787857951.339432:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171920256 00000100:00100000:2.0:1787857951.339458:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 560 00000100:00100000:3.0:1787857951.339659:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 561 00000100:00100000:3.0:1787857951.339670:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171920256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857951.339748:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171920256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 81us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857951.339756:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 561 00000100:00100000:3.0:1787857951.339788:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171920512 00000100:00100000:3.0:1787857951.339792:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171920512 00000100:00100000:3.0:1787857951.339835:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 592 00000100:00100000:3.0:1787857951.339842:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171920512:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857951.339965:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171919872:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857951.339998:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171919872:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 532us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857951.340005:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 560 00000100:00100000:3.0:1787857951.340121:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171920512:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 278us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857951.340129:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 592 00000100:00080000:1.0:1787857951.340224:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857951.340228:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857951.472595:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857952.494070:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857952.622478:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857952.622505:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188322432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857952.622581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857952.622634:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188322432 00000100:00100000:2.0:1787857952.622644:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188322432 00000100:00100000:2.0:1787857952.622716:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787857952.622726:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188322432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857952.622763:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857952.622840:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188322432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857952.622848:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787857952.622860:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188322432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857952.622915:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857953.365354:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857953.365523:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171920640 00000100:00100000:0.0:1787857953.365534:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171920640 00000100:00100000:0.0:1787857953.365655:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 94 00000100:00100000:0.0:1787857953.365670:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2347:x1874704171920640:12345-192.168.204.36@tcp:63:ll_sa.0 00000100:00080000:2.0:1787857953.365687:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857953.365792:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857953.365967:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7f1a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6587464c02fd4af4 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.366033:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.366382:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.366400:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.366446:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.366455:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.366461:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367148:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367162:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367170:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367176:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c6800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857953.367179:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367186:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367198:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857953.367201:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857953.367206:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367212:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c6800/0xd3f183cab4a7f1a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367226:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367231:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367237:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367242:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9999020c7000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1787857953.367245:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367251:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367258:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xae1c5c33 (ffff9997c3d03100) 00010000:00010000:0.0:1787857953.367261:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857953.367263:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367269:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7000/0xd3f183cab4a7f1b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367306:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7f1a2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4af4 expref: 109 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367317:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9998c3379900) 00010000:00010000:0.0:1787857953.367319:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857953.367323:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999020c7400/0xd3f183cab4a7f1a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd4af4 expref: 109 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857953.367333:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9999020c7400, rc -2) 00000100:00100000:0.0:1787857953.367580:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2347:x1874704171920640:12345-192.168.204.36@tcp:63:ll_sa.0 Request processed in 1912us (2238us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857953.367590:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 94 00000040:00080000:0.0:1787857953.500833:0:23963:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857953.500845:0:23963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857953.501642:0:23963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787857953.501788:0:23963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787857953.518192:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857953.966297:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857953.966311:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857953.967648:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857953.969265:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857954.159650:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188322560:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.159730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857954.159792:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188323072:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.159848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857954.159873:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857954.159879:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188322944:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.159902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857954.159929:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188322816:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.159951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857954.159970:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787857954.159974:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188322688:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.159995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857954.160009:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188323200:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857954.160073:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188323072 00000100:00100000:0.0:1787857954.160082:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188323072 00000100:00100000:0.0:1787857954.160149:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188322816 00000100:00100000:0.0:1787857954.160152:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188322816 00000100:00100000:0.0:1787857954.160173:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188322688 00000100:00100000:0.0:1787857954.160176:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188322688 00000100:00100000:0.0:1787857954.160190:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1787857954.160200:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188323072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160265:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188323072:12345-0@lo:400:kworker.0 Request processed in 65us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857954.160272:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1787857954.160290:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1787857954.160296:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188322816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160329:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188322816:12345-0@lo:400:kworker.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857954.160335:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1787857954.160345:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1787857954.160351:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188322688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160375:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188322688:12345-0@lo:400:kworker.0 Request processed in 24us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857954.160381:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1787857954.160400:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188322944 00000100:00100000:0.0:1787857954.160403:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188322944 00000100:00100000:0.0:1787857954.160430:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188323200 00000100:00100000:0.0:1787857954.160433:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188323200 00000100:00100000:0.0:1787857954.160597:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1787857954.160604:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188322944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160639:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188322944:12345-0@lo:400:kworker.0 Request processed in 36us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857954.160645:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1787857954.160656:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1787857954.160661:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188323200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160686:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188323200:12345-0@lo:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857954.160692:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00080000:0.0:1787857954.160717:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857954.160721:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857954.160724:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857954.160768:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188322688:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160782:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188323200:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160792:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188322816:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160848:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188322944:0@lo:400:kworker.0 00000100:00100000:0.0:1787857954.160859:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188323072:0@lo:400:kworker.0 00000100:00100000:2.0:1787857954.161236:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188322560 00000100:00100000:2.0:1787857954.161244:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188322560 00000100:00100000:2.0:1787857954.161292:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1787857954.161300:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188322560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857954.161360:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188322560:12345-0@lo:400:kworker.0 Request processed in 61us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857954.161369:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1787857954.161649:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188322560:0@lo:400:kworker.0 00010000:00010000:0.0:1787857954.547306:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857954.672548:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188323328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857954.673385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857954.676544:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188323328 00000100:00100000:3.0:1787857954.676560:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188323328 00000100:00100000:3.0:1787857954.676724:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787857954.676759:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188323328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857954.676952:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857954.677178:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188323328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 444us (3796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857954.677198:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787857954.678140:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188323328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857955.569276:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857955.696550:0:24014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857955.696561:0:24014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857955.698097:0:24014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857955.698126:0:24014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857956.444563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857956.444647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857956.444695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857956.444745:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857956.444769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857956.444812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857956.444870:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857956.444931:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171921152 00000100:00100000:1.0:1787857956.444945:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171921152 00000100:00100000:1.0:1787857956.445465:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171921408 00000100:00100000:1.0:1787857956.445474:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171921408 00000100:00100000:1.0:1787857956.445500:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171921024 00000100:00100000:1.0:1787857956.445503:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171921024 00000100:00100000:1.0:1787857956.445521:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171921536 00000100:00100000:1.0:1787857956.445523:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171921536 00000100:00100000:1.0:1787857956.445543:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 595 00000100:00100000:1.0:1787857956.445555:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171921152:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857956.445680:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171921152:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 127us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857956.445690:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 595 00000100:00100000:1.0:1787857956.445713:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 596 00000100:00100000:1.0:1787857956.445720:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171921408:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857956.445749:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171921408:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857956.445755:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 596 00000100:00100000:1.0:1787857956.445766:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 597 00000100:00100000:1.0:1787857956.445772:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171921024:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857956.445796:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171921024:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857956.445802:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 597 00000100:00100000:1.0:1787857956.445813:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 598 00000100:00100000:0.0:1787857956.446215:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171920896 00000100:00100000:0.0:1787857956.446222:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171920896 00000100:00100000:0.0:1787857956.446272:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171921280 00000100:00100000:0.0:1787857956.446288:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171921280 00000100:00100000:0.0:1787857956.446319:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 565 00000100:00100000:0.0:1787857956.446328:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171920896:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857956.446367:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171920896:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857956.446374:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 565 00000100:00100000:0.0:1787857956.446389:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 566 00000100:00100000:0.0:1787857956.446396:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171921280:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857956.446421:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171921280:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857956.446432:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 566 00000100:00100000:1.0:1787857956.446511:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171921536:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857956.446542:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171921536:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857956.446548:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 598 00000100:00100000:3.0:1787857956.446731:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171920768 00000100:00100000:3.0:1787857956.446736:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171920768 00000100:00100000:3.0:1787857956.446773:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 646 00000100:00100000:3.0:1787857956.446782:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171920768:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857956.446812:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171920768:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857956.446839:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 646 00000100:00080000:0.0:1787857956.448479:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857956.448492:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857956.448495:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857956.590581:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857957.614117:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857957.746137:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857957.746169:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188323456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857957.746276:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857957.746383:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188323456 00000100:00100000:3.0:1787857957.746394:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188323456 00000100:00100000:3.0:1787857957.746474:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787857957.746486:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188323456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857957.746545:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857957.746606:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188323456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857957.746614:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1787857957.746644:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857957.746696:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188323456:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787857957.974166:0:24065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857957.974182:0:24065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857957.975427:0:24065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857957.975456:0:24065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857958.640318:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857959.278166:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188323584:0@lo:400:kworker.0 00000100:00100000:2.0:1787857959.278181:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188323712:0@lo:400:kworker.0 00000100:00100000:0.0:1787857959.278273:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188323968:0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.279290:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857959.279388:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188324096:0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.279426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857959.279559:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188323584 00000100:00100000:3.0:1787857959.279571:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188323584 00000100:00100000:3.0:1787857959.279639:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1787857959.279650:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188323584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.279719:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188323584:12345-0@lo:400:kworker.0 Request processed in 70us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857959.280005:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1787857959.280243:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188323584:0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.280309:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188324096 00000100:00100000:3.0:1787857959.280314:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188324096 00000100:00100000:3.0:1787857959.280374:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1787857959.280382:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188324096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.280432:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188324096:12345-0@lo:400:kworker.0 Request processed in 51us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857959.280438:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00080000:3.0:1787857959.280874:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857959.280904:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188324096:0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.280961:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188323840:0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.281001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857959.281060:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188323840 00000100:00100000:3.0:1787857959.281064:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188323840 00000100:00100000:3.0:1787857959.283342:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1787857959.283362:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188323840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.284878:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188323840:12345-0@lo:400:kworker.0 Request processed in 1509us (3863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857959.284894:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00080000:3.0:1787857959.284957:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857959.285013:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188323840:0@lo:400:kworker.0 00000100:00100000:0.0:1787857959.293947:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857959.294030:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188323968 00000100:00100000:0.0:1787857959.294043:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188323968 00000100:00100000:0.0:1787857959.294135:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1787857959.294147:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188323968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857959.294219:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188323968:12345-0@lo:400:kworker.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857959.294227:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00080000:0.0:1787857959.294254:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857959.294302:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188323968:0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.295743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857959.295864:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188324224:0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.295916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857959.295955:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188324224 00000100:00100000:3.0:1787857959.295966:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188324224 00000100:00100000:3.0:1787857959.296050:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1787857959.296061:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188324224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.296135:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188324224:12345-0@lo:400:kworker.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857959.296267:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188323712 00000100:00100000:2.0:1787857959.296273:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188323712 00000100:00100000:2.0:1787857959.296318:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1787857959.296326:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188323712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857959.296369:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188323712:12345-0@lo:400:kworker.0 Request processed in 44us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857959.296377:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1787857959.296458:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188324224:0@lo:400:kworker.0 00000100:00100000:2.0:1787857959.296493:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188323712:0@lo:400:kworker.0 00000100:00100000:3.0:1787857959.297291:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00080000:0.0:1787857959.297660:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857959.664734:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857959.791065:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857959.791099:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188324352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857959.791199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857959.791264:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188324352 00000100:00100000:0.0:1787857959.791275:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188324352 00000100:00100000:0.0:1787857959.791345:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787857959.791357:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188324352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857959.791408:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857959.791480:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188324352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857959.791489:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787857959.791744:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188324352:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787857960.433221:0:24117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857960.433234:0:24117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857960.434680:0:24117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857960.434704:0:24117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857960.696238:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857961.554088:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857961.556693:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171921664 00000100:00100000:3.0:1787857961.556717:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171921664 00000100:00100000:3.0:1787857961.556877:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 648 00000100:00100000:3.0:1787857961.556891:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171921664:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857961.557047:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171921664:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 159us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857961.557057:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 648 00000100:00100000:3.0:1787857961.561250:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857961.561447:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171921792 00000100:00100000:0.0:1787857961.561461:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171921792 00000100:00100000:0.0:1787857961.561569:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 570 00000100:00100000:0.0:1787857961.561584:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171921792:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:1.0:1787857961.561938:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857961.562266:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171921792:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 685us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857961.562286:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 570 00000100:00100000:0.0:1787857961.575003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857961.575068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857961.575105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857961.575140:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857961.575176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857961.575219:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171921920 00000100:00100000:2.0:1787857961.575222:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171922432 00000100:00100000:2.0:1787857961.575231:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171922432 00000100:00100000:0.0:1787857961.575231:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171921920 00000100:00100000:2.0:1787857961.575306:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171922048 00000100:00100000:2.0:1787857961.575310:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171922048 00000100:00100000:3.0:1787857961.575363:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171922304 00000100:00100000:3.0:1787857961.575369:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171922304 00000100:00100000:1.0:1787857961.575398:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171922176 00000100:00100000:1.0:1787857961.575403:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171922176 00000100:00100000:0.0:1787857961.580877:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 601 00000100:00100000:0.0:1787857961.580916:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171922432:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857961.581211:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171922432:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 314us (6103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857961.581221:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 601 00000100:00100000:0.0:1787857961.581249:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 602 00000100:00100000:0.0:1787857961.581258:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171921920:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857961.581327:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 603 00000100:00100000:2.0:1787857961.581345:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171922048:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857961.581384:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171922048:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 48us (6243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857961.581392:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 603 00000100:00100000:3.0:1787857961.581565:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 604 00000100:00100000:3.0:1787857961.581575:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171922304:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857961.581611:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171922304:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (6434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857961.581619:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 604 00000100:00080000:2.0:1787857961.581738:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857961.581746:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857961.581750:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857961.582961:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171921920:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1690us (7977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857961.582992:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 602 00000100:00100000:1.0:1787857961.589723:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 571 00000100:00100000:1.0:1787857961.589745:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171922176:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857961.589911:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171922176:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 172us (14842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857961.589922:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 571 00010000:00010000:1.0:1787857961.710023:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857962.431766:0:24168:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857962.431781:0:24168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857962.435051:0:24168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857962.435258:0:24168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857962.738306:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857962.862376:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857962.862413:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998dacc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188324480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857962.862526:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857962.862789:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188324480 00000100:00100000:2.0:1787857962.862804:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188324480 00000100:00100000:2.0:1787857962.862939:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787857962.862964:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188324480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857962.863023:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857962.863088:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188324480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857962.863097:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787857962.863161:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998dacc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188324480:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857962.863387:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787857963.182214:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857963.182230:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857963.182800:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787857963.182813:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787857963.758279:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857964.403187:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188324992:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.403294:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857964.403373:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787857964.403380:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188324608:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.403410:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857964.403436:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188325120:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.403463:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857964.403492:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188324864:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.403514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857964.403535:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787857964.403540:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188324736:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.403575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857964.403595:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188325248:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.403619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857964.403655:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188324608 00000100:00100000:1.0:1787857964.403665:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188324608 00000100:00100000:1.0:1787857964.403727:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1787857964.403738:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188324608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.403801:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188324608:12345-0@lo:400:kworker.0 Request processed in 64us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857964.403809:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1787857964.403886:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188325120 00000100:00100000:1.0:1787857964.403890:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188325120 00000100:00100000:1.0:1787857964.403941:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188324864 00000100:00100000:1.0:1787857964.403944:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188324864 00000100:00100000:1.0:1787857964.403966:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188324736 00000100:00100000:1.0:1787857964.403969:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188324736 00000100:00100000:1.0:1787857964.403984:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1787857964.403990:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188325120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404022:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188325120:12345-0@lo:400:kworker.0 Request processed in 33us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857964.404028:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1787857964.404038:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1787857964.404043:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188324864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404071:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188324864:12345-0@lo:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857964.404077:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1787857964.404087:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1787857964.404093:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188324736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404117:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188324736:12345-0@lo:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857964.404123:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1787857964.404148:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188324992 00000100:00100000:1.0:1787857964.404152:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188324992 00000100:00100000:1.0:1787857964.404181:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188325248 00000100:00100000:1.0:1787857964.404184:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188325248 00000100:00100000:1.0:1787857964.404206:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1787857964.404212:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188324992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404245:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188324992:12345-0@lo:400:kworker.0 Request processed in 33us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857964.404252:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1787857964.404262:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1787857964.404268:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188325248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404295:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188325248:12345-0@lo:400:kworker.0 Request processed in 28us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857964.404302:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00080000:1.0:1787857964.404323:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857964.404328:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857964.404331:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857964.404384:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188324736:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404400:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188325248:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404410:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188324864:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404458:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188324608:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404467:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188325120:0@lo:400:kworker.0 00000100:00100000:1.0:1787857964.404476:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188324992:0@lo:400:kworker.0 00000040:00080000:1.0:1787857964.495556:0:24219:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857964.495572:0:24219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857964.496550:0:24219:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857964.496567:0:24219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857964.782337:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857964.910113:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857964.910146:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188325376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857964.910247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857964.911064:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188325376 00000100:00100000:2.0:1787857964.911080:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188325376 00000100:00100000:2.0:1787857964.911177:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787857964.911192:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188325376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857964.911265:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857964.911367:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188325376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857964.911376:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787857964.911594:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188325376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857965.806619:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857966.589121:0:24270:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857966.589136:0:24270:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857966.590075:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787857966.590092:0:24270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857966.677857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857966.677921:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857966.677953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857966.677976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857966.678001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857966.678021:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857966.678052:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857966.678090:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171922816 00000100:00100000:3.0:1787857966.678103:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171922816 00000100:00100000:3.0:1787857966.678191:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171923328 00000100:00100000:3.0:1787857966.678196:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171923328 00000100:00100000:3.0:1787857966.678222:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171922944 00000100:00100000:3.0:1787857966.678225:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171922944 00000100:00100000:3.0:1787857966.678241:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171923200 00000100:00100000:3.0:1787857966.678244:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171923200 00000100:00100000:3.0:1787857966.678263:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 607 00000100:00100000:3.0:1787857966.678275:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171922816:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857966.678387:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171922816:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 114us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857966.678395:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 607 00000100:00100000:3.0:1787857966.678419:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 608 00000100:00100000:3.0:1787857966.678426:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171923328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857966.678452:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171923328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857966.678459:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 608 00000100:00100000:3.0:1787857966.678471:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 609 00000100:00100000:3.0:1787857966.678477:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171922944:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857966.678503:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171922944:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857966.678511:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 609 00000100:00100000:3.0:1787857966.678524:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 610 00000100:00100000:3.0:1787857966.678531:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171923200:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857966.678555:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171923200:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857966.678561:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 610 00000100:00100000:0.0:1787857966.682361:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171923072 00000100:00100000:0.0:1787857966.682379:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171923072 00000100:00100000:0.0:1787857966.682462:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171922688 00000100:00100000:0.0:1787857966.682466:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171922688 00000100:00100000:0.0:1787857966.682499:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 575 00000100:00100000:0.0:1787857966.682518:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171923072:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857966.682623:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171923072:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 107us (4668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857966.682632:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 575 00000100:00100000:0.0:1787857966.682656:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 576 00000100:00100000:0.0:1787857966.682664:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171922688:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857966.682694:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171922688:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (4692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857966.682700:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 576 00000100:00100000:0.0:1787857966.682738:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171922560 00000100:00100000:0.0:1787857966.682742:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171922560 00000100:00100000:0.0:1787857966.682769:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 650 00000100:00100000:0.0:1787857966.682776:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171922560:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857966.682849:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171922560:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 73us (5033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857966.682856:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 650 00000100:00080000:3.0:1787857966.684282:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857966.684300:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857966.684304:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857966.830207:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857967.854796:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857967.982287:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857967.982327:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188325504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857967.982432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857967.982904:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188325504 00000100:00100000:3.0:1787857967.982917:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188325504 00000100:00100000:3.0:1787857967.983011:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787857967.983026:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188325504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857967.983088:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857967.983180:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188325504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857967.983189:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787857967.983386:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188325504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857967.983594:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787857968.626098:0:24322:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857968.626112:0:24322:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857968.626955:0:24322:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787857968.626972:0:24322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857968.884082:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857969.518332:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188325888:0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.518462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857969.518569:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787857969.518576:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188325760:0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.518605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857969.518627:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188326272:0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.518656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857969.518713:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188325888 00000100:00100000:3.0:1787857969.518727:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188325888 00000100:00100000:3.0:1787857969.518811:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188325760 00000100:00100000:3.0:1787857969.518873:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188325760 00000100:00100000:3.0:1787857969.518908:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1787857969.518915:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188326016:0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.518924:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188325888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857969.519086:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188325632:0@lo:400:kworker.0 00000100:00100000:0.0:1787857969.519181:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1787857969.519195:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188325760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.519270:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188325888:12345-0@lo:400:kworker.0 Request processed in 351us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857969.519280:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1787857969.519318:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188326272 00000100:00100000:3.0:1787857969.519322:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188326272 00000100:00100000:3.0:1787857969.519365:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1787857969.519372:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188326272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.519409:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188326272:12345-0@lo:400:kworker.0 Request processed in 38us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857969.519415:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1787857969.519472:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188326272:0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.519487:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188325888:0@lo:400:kworker.0 00000100:00080000:3.0:1787857969.519576:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857969.519584:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857969.519897:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857969.520097:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188326016 00000100:00100000:3.0:1787857969.520108:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188326016 00000100:00100000:3.0:1787857969.520212:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1787857969.520223:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188326016:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787857969.520514:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857969.521063:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188326016:12345-0@lo:400:kworker.0 Request processed in 838us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857969.521074:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1787857969.521402:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188326016:0@lo:400:kworker.0 00000100:00100000:2.0:1787857969.523108:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857969.523363:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998daac0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188326144:0@lo:400:kworker.0 00000100:00100000:2.0:1787857969.523441:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857969.523662:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188325632 00000100:00100000:1.0:1787857969.523674:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188325632 00000100:00100000:1.0:1787857969.523803:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1787857969.523859:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188325632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857969.523947:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188325632:12345-0@lo:400:kworker.0 Request processed in 134us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857969.523956:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1787857969.524057:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188326144 00000100:00100000:3.0:1787857969.524063:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188326144 00000100:00100000:3.0:1787857969.524125:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1787857969.524148:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188326144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.524196:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188326144:12345-0@lo:400:kworker.0 Request processed in 64us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857969.524203:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1787857969.524274:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188325632:0@lo:400:kworker.0 00000100:00100000:3.0:1787857969.524290:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998daac0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188326144:0@lo:400:kworker.0 00000100:00080000:3.0:1787857969.524337:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857969.526482:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188325760:12345-0@lo:400:kworker.0 Request processed in 7275us (7859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857969.526501:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1787857969.526795:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188325760:0@lo:400:kworker.0 00010000:00010000:0.0:1787857969.914042:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857970.032666:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857970.032699:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188326400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857970.033049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857970.033198:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188326400 00000100:00100000:0.0:1787857970.033210:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188326400 00000100:00100000:0.0:1787857970.033277:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787857970.033288:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188326400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857970.033340:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857970.033410:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188326400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857970.033419:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787857970.033682:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188326400:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787857970.673421:0:24373:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857970.673434:0:24373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857970.679990:0:24373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857970.680028:0:24373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857970.932047:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857971.800187:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857971.800243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857971.800278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857971.800309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857971.800461:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857971.800505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857971.800533:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857971.800564:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171923968 00000100:00100000:3.0:1787857971.800689:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171923968 00000100:00100000:1.0:1787857971.800800:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171923712 00000100:00100000:1.0:1787857971.800806:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171923712 00000100:00100000:0.0:1787857971.800856:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171923456 00000100:00100000:0.0:1787857971.800862:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171923456 00000100:00100000:0.0:1787857971.800915:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 652 00000100:00100000:0.0:1787857971.800927:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171923456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857971.800966:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171923584 00000100:00100000:2.0:1787857971.800972:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171923584 00000100:00100000:3.0:1787857971.801066:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 580 00000100:00100000:3.0:1787857971.801076:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171923968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857971.801131:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171923456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 206us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857971.801140:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 652 00000100:00100000:0.0:1787857971.801180:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171924224 00000100:00100000:0.0:1787857971.801185:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171924224 00000100:00100000:1.0:1787857971.807060:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171923840 00000100:00100000:1.0:1787857971.807075:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171923840 00000100:00100000:1.0:1787857971.807112:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171924096 00000100:00100000:1.0:1787857971.807116:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171924096 00000100:00100000:1.0:1787857971.807141:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 613 00000100:00100000:1.0:1787857971.807152:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171923712:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857971.807732:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 581 00000100:00100000:2.0:1787857971.807743:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171923584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857971.809385:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171923968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 8286us (9080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857971.809404:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 580 00000100:00100000:3.0:1787857971.809475:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 614 00000100:00100000:3.0:1787857971.809507:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171923840:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857971.809588:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171923840:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 79us (9068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857971.809595:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 614 00000100:00100000:3.0:1787857971.809613:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 615 00000100:00100000:3.0:1787857971.809620:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171924096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857971.809649:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171924096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (9115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857971.809656:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 615 00000100:00080000:3.0:1787857971.809683:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857971.809689:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857971.809692:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857971.809995:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 616 00000100:00100000:0.0:1787857971.810018:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171924224:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857971.810051:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171924224:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 48us (9740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857971.810058:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 616 00000100:00100000:1.0:1787857971.811342:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171923712:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 4180us (11086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857971.811354:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 613 00000100:00100000:2.0:1787857971.812758:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171923584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 5003us (12281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857971.813065:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 581 00010000:00010000:3.0:1787857971.950236:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857972.918669:0:24424:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857972.918680:0:24424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857972.919284:0:24424:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857972.919295:0:24424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857972.975046:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857973.103240:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188326528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857973.103325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857973.103406:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188326528 00000100:00100000:3.0:1787857973.103416:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188326528 00000100:00100000:3.0:1787857973.103597:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787857973.103610:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188326528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857973.103653:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857973.103703:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188326528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857973.103715:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:3.0:1787857973.103737:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857973.103786:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188326528:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787857973.423065:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857973.423081:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857973.425099:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857973.425124:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857974.001630:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857974.643671:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188326656:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.643778:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857974.644027:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188327168:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.644064:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857974.644096:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857974.644103:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188327040:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.644330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857974.644370:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188326784:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.644397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857974.644503:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188327296:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.644534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857974.644556:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857974.644562:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188326912:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.644588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857974.644624:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188327168 00000100:00100000:0.0:1787857974.644632:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188327168 00000100:00100000:0.0:1787857974.644689:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188326784 00000100:00100000:0.0:1787857974.644692:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188326784 00000100:00100000:0.0:1787857974.644713:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188326912 00000100:00100000:0.0:1787857974.644718:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188326912 00000100:00100000:0.0:1787857974.644762:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1787857974.644773:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188327168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.644855:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188327168:12345-0@lo:400:kworker.0 Request processed in 83us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857974.644863:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1787857974.644882:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1787857974.644892:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188326784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.644948:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188326784:12345-0@lo:400:kworker.0 Request processed in 57us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857974.644957:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1787857974.644978:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1787857974.644985:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188326912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.645018:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188326912:12345-0@lo:400:kworker.0 Request processed in 34us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857974.645025:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1787857974.645046:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188327040 00000100:00100000:0.0:1787857974.645050:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188327040 00000100:00100000:0.0:1787857974.645075:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188327296 00000100:00100000:0.0:1787857974.645078:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188327296 00000100:00100000:0.0:1787857974.645100:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1787857974.645180:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188327040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.645216:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188327040:12345-0@lo:400:kworker.0 Request processed in 110us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857974.645222:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1787857974.645233:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1787857974.645265:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188327296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.645296:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188327296:12345-0@lo:400:kworker.0 Request processed in 56us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857974.645301:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00080000:0.0:1787857974.645331:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857974.645335:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857974.645374:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188327040:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.645387:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188327168:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.645465:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188326912:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.645487:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188326784:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.645505:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188327296:0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.646432:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188326656 00000100:00100000:0.0:1787857974.646442:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188326656 00000100:00100000:0.0:1787857974.646489:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1787857974.646497:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188326656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857974.646569:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188326656:12345-0@lo:400:kworker.0 Request processed in 73us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857974.646576:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1787857974.646634:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188326656:0@lo:400:kworker.0 00000040:00080000:3.0:1787857974.753333:0:24476:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857974.753349:0:24476:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857974.754225:0:24476:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857974.754238:0:24476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857975.022139:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857975.150168:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857975.150196:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188327424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857975.150277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857975.150554:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188327424 00000100:00100000:2.0:1787857975.150563:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188327424 00000100:00100000:2.0:1787857975.150623:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787857975.150633:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188327424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857975.150670:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857975.150857:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188327424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 225us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857975.150865:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787857975.152659:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188327424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787857976.046504:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857976.913158:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857976.913248:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171924352 00000100:00100000:2.0:1787857976.913259:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171924352 00000100:00100000:2.0:1787857976.913323:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 654 00000100:00100000:2.0:1787857976.913333:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171924352:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857976.913423:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171924352:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857976.913431:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 654 00000100:00100000:0.0:1787857976.920567:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857976.921506:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171924480 00000100:00100000:0.0:1787857976.921516:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171924480 00000100:00080000:3.0:1787857976.921791:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857976.921916:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 585 00000100:00100000:0.0:1787857976.921929:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171924480:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857976.922121:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171924480:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 194us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857976.922129:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 585 00000100:00100000:3.0:1787857976.930165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857976.930355:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857976.930392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857976.930416:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857976.930440:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857976.930474:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171924736 00000100:00100000:3.0:1787857976.930483:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171924736 00000100:00100000:3.0:1787857976.930539:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171924992 00000100:00100000:3.0:1787857976.930543:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171924992 00000100:00100000:3.0:1787857976.930563:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171924608 00000100:00100000:3.0:1787857976.930566:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171924608 00000100:00100000:3.0:1787857976.930580:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171925120 00000100:00100000:3.0:1787857976.930582:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171925120 00000100:00100000:3.0:1787857976.930616:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 619 00000100:00100000:3.0:1787857976.930626:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171924736:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857976.930709:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171924736:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 84us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857976.930717:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 619 00000100:00100000:3.0:1787857976.930733:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 620 00000100:00100000:3.0:1787857976.930740:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171924992:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857976.930763:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171924992:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857976.930768:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 620 00000100:00100000:3.0:1787857976.930778:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 621 00000100:00100000:3.0:1787857976.930783:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171924608:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857976.930803:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171924608:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857976.930808:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 621 00000100:00100000:3.0:1787857976.930834:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 622 00000100:00100000:3.0:1787857976.930840:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171925120:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857976.930863:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171925120:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857976.930868:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 622 00000100:00080000:3.0:1787857976.930884:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857976.930888:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857976.933892:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171924864 00000100:00100000:0.0:1787857976.933908:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171924864 00000100:00100000:0.0:1787857976.934743:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 586 00000100:00100000:0.0:1787857976.934755:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171924864:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857976.934858:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171924864:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 104us (4439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857976.934866:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 586 00000100:00080000:3.0:1787857976.935331:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787857976.939197:0:24527:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857976.939207:0:24527:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857976.941567:0:24527:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857976.941670:0:24527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787857977.071490:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857978.098024:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857978.222194:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857978.226172:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188327552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857978.227213:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857978.230196:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188327552 00000100:00100000:0.0:1787857978.230210:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188327552 00000100:00100000:0.0:1787857978.231581:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787857978.231596:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188327552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857978.231638:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857978.231742:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188327552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (4532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857978.231754:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787857978.232191:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188327552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857978.232693:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787857979.062121:0:24578:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857979.062132:0:24578:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857979.062685:0:24578:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787857979.062695:0:24578:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857979.126171:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857979.758847:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857979.758878:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188328064:0@lo:400:kworker.0 00000100:00100000:1.0:1787857979.758894:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188327808:0@lo:400:kworker.0 00000100:00100000:0.0:1787857979.758971:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188328192:0@lo:400:kworker.0 00000100:00100000:2.0:1787857979.759031:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188327936:0@lo:400:kworker.0 00000100:00100000:3.0:1787857979.759072:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857979.759085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857979.759712:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188327936 00000100:00100000:2.0:1787857979.759722:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188327936 00000100:00100000:2.0:1787857979.759793:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1787857979.759804:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188327936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857979.759910:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188327936:12345-0@lo:400:kworker.0 Request processed in 109us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857979.759918:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1787857979.759990:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188327936:0@lo:400:kworker.0 00000100:00100000:2.0:1787857979.760026:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188328064 00000100:00100000:2.0:1787857979.760030:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188328064 00000100:00100000:2.0:1787857979.760058:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1787857979.760065:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188328064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857979.760097:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188328064:12345-0@lo:400:kworker.0 Request processed in 33us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857979.760104:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00080000:2.0:1787857979.760131:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857979.760736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857979.760784:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901452580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188328320:0@lo:400:kworker.0 00000100:00100000:1.0:1787857979.760837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857979.760879:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188328320 00000100:00100000:1.0:1787857979.760883:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188328320 00000100:00100000:1.0:1787857979.760914:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1787857979.760921:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188328320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857979.760957:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188328320:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857979.760967:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00080000:1.0:1787857979.760984:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857979.761005:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901452580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188328320:0@lo:400:kworker.0 00000100:00100000:0.0:1787857979.763085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857979.763309:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188328064:0@lo:400:kworker.0 00000100:00100000:1.0:1787857979.763321:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188327808 00000100:00100000:3.0:1787857979.763327:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188327680:0@lo:400:kworker.0 00000100:00100000:1.0:1787857979.763330:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188327808 00000100:00100000:1.0:1787857979.763381:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188328192 00000100:00100000:1.0:1787857979.763383:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188328192 00000100:00100000:3.0:1787857979.763388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857979.763430:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1787857979.763443:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188327808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857979.763455:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188327680 00000100:00100000:3.0:1787857979.763461:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188327680 00000100:00100000:1.0:1787857979.763509:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188327808:12345-0@lo:400:kworker.0 Request processed in 69us (2774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857979.763516:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1787857979.763521:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1787857979.763528:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188327680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857979.763542:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1787857979.763551:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188328192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857979.763581:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188327680:12345-0@lo:400:kworker.0 Request processed in 55us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857979.763590:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1787857979.763596:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188328192:12345-0@lo:400:kworker.0 Request processed in 46us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857979.763604:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00080000:1.0:1787857979.763641:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857979.763662:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188328192:0@lo:400:kworker.0 00000100:00100000:1.0:1787857979.763685:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188327808:0@lo:400:kworker.0 00000100:00100000:2.0:1787857979.763795:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188327680:0@lo:400:kworker.0 00010000:00010000:3.0:1787857980.142392:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857980.275592:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857980.275628:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188328448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857980.275705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857980.275849:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188328448 00000100:00100000:3.0:1787857980.275858:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188328448 00000100:00100000:3.0:1787857980.275910:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787857980.275920:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188328448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857980.275970:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857980.276028:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188328448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857980.276035:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787857980.276458:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188328448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857981.168063:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857981.184098:0:24629:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857981.184107:0:24629:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857981.186404:0:24629:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857981.186428:0:24629:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857982.032193:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857982.032317:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171925248 00000100:00100000:0.0:1787857982.032330:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171925248 00000100:00100000:0.0:1787857982.032395:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 656 00000100:00100000:0.0:1787857982.032406:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171925248:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857982.032500:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171925248:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 95us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857982.032508:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 656 00000100:00100000:0.0:1787857982.032959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857982.032990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857982.033016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857982.033046:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857982.033072:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171925504 00000100:00100000:1.0:1787857982.033079:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171925504 00000100:00100000:0.0:1787857982.033098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857982.033124:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171925760 00000100:00100000:1.0:1787857982.033128:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171926016 00000100:00100000:0.0:1787857982.033129:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171925760 00000100:00100000:1.0:1787857982.033134:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171926016 00000100:00100000:0.0:1787857982.033171:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171925376 00000100:00100000:1.0:1787857982.033172:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171925632 00000100:00100000:0.0:1787857982.033176:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171925376 00000100:00100000:1.0:1787857982.033178:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171925632 00000100:00100000:0.0:1787857982.033206:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 590 00000100:00100000:1.0:1787857982.033214:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 625 00000100:00100000:0.0:1787857982.033218:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171925760:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857982.033229:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171925504:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857982.033266:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171925760:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 52us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857982.033272:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171925504:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857982.033286:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 625 00000100:00100000:0.0:1787857982.033286:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 590 00000100:00100000:0.0:1787857982.033305:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 591 00000100:00100000:0.0:1787857982.033313:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171925376:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857982.033324:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 626 00000100:00100000:1.0:1787857982.033334:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171926016:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857982.033345:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171925376:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857982.033351:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 591 00000100:00100000:1.0:1787857982.033381:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171926016:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857982.033389:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 626 00000100:00100000:3.0:1787857982.033512:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787857982.033628:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171925888 00000100:00100000:3.0:1787857982.033633:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171925888 00000100:00100000:0.0:1787857982.033760:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 627 00000100:00100000:0.0:1787857982.033769:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171925632:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857982.033802:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171925632:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857982.033809:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 627 00000100:00080000:0.0:1787857982.033858:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857982.033863:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857982.033865:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857982.041681:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 628 00000100:00100000:3.0:1787857982.041707:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171925888:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857982.041812:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171925888:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 117us (8299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857982.041843:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 628 00010000:00010000:0.0:1787857982.191775:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857983.215076:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857983.257606:0:24681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857983.257619:0:24681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857983.258481:0:24681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857983.258507:0:24681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857983.343479:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857983.343531:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188328576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857983.343678:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857983.345093:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188328576 00000100:00100000:3.0:1787857983.345107:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188328576 00000100:00100000:3.0:1787857983.345237:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787857983.345250:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188328576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857983.345313:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857983.345404:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188328576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857983.345412:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787857983.345543:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188328576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787857983.346164:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787857983.665487:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857983.665583:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857983.667526:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857983.667563:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857984.238183:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857984.878096:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188328832:0@lo:400:kworker.0 00000100:00100000:1.0:1787857984.878179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857984.878250:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188329344:0@lo:400:kworker.0 00000100:00100000:1.0:1787857984.878280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857984.878314:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857984.878320:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188328960:0@lo:400:kworker.0 00000100:00100000:1.0:1787857984.878343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857984.878434:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188329088:0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.878467:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857984.878496:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787857984.878502:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188328704:0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.878541:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857984.878573:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188329216:0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.878597:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857984.878630:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188328832 00000100:00100000:0.0:1787857984.878638:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188328832 00000100:00100000:0.0:1787857984.878689:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188328960 00000100:00100000:0.0:1787857984.878693:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188328960 00000100:00100000:0.0:1787857984.878722:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188329216 00000100:00100000:0.0:1787857984.878725:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188329216 00000100:00100000:0.0:1787857984.878742:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1787857984.878751:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188328832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.878806:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188328832:12345-0@lo:400:kworker.0 Request processed in 56us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857984.878845:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1787857984.878869:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1787857984.878876:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188328960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.878905:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188328960:12345-0@lo:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857984.878910:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1787857984.878920:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1787857984.878926:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188329216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.878958:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188329216:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857984.878964:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1787857984.878984:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188329344 00000100:00100000:0.0:1787857984.878987:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188329344 00000100:00100000:0.0:1787857984.879014:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188329088 00000100:00100000:0.0:1787857984.879017:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188329088 00000100:00100000:0.0:1787857984.879035:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1787857984.879041:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188329344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.879080:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188329344:12345-0@lo:400:kworker.0 Request processed in 40us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857984.879086:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1787857984.879097:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1787857984.879103:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188329088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.879132:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188329088:12345-0@lo:400:kworker.0 Request processed in 29us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857984.879139:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00080000:0.0:1787857984.879162:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857984.879167:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857984.879206:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188329216:0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.879218:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188329088:0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.879251:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188328960:0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.879261:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188328832:0@lo:400:kworker.0 00000100:00100000:0.0:1787857984.879271:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188329344:0@lo:400:kworker.0 00000100:00100000:3.0:1787857984.879769:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188328704 00000100:00100000:3.0:1787857984.879777:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188328704 00000100:00100000:3.0:1787857984.879849:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1787857984.879858:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188328704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857984.879912:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188328704:12345-0@lo:400:kworker.0 Request processed in 56us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857984.879919:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1787857984.879967:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188328704:0@lo:400:kworker.0 00010000:00010000:3.0:1787857985.268566:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857985.333603:0:24732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857985.333615:0:24732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857985.334471:0:24732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787857985.334488:0:24732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857985.401408:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857985.401434:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188329472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857985.401514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857985.401661:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188329472 00000100:00100000:2.0:1787857985.401668:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188329472 00000100:00100000:2.0:1787857985.401728:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787857985.401737:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188329472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857985.401776:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857985.401860:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188329472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857985.401868:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787857985.401962:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188329472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787857986.287341:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857987.185194:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857987.185271:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857987.185312:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857987.185342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857987.185363:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857987.185382:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857987.185413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857987.185466:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171926272 00000100:00100000:1.0:1787857987.185478:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171926272 00000100:00100000:1.0:1787857987.185568:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171926656 00000100:00100000:1.0:1787857987.185571:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171926656 00000100:00100000:1.0:1787857987.185595:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 595 00000100:00100000:1.0:1787857987.185604:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171926272:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857987.185697:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171926272:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 94us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857987.185705:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 595 00000100:00100000:1.0:1787857987.185726:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 596 00000100:00100000:1.0:1787857987.185733:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171926656:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857987.185759:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171926656:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857987.185765:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 596 00000100:00100000:1.0:1787857987.185785:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171926400 00000100:00100000:3.0:1787857987.186047:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171926144 00000100:00100000:3.0:1787857987.186054:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171926144 00000100:00100000:3.0:1787857987.186094:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 658 00000100:00100000:3.0:1787857987.186103:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171926144:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857987.186134:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171926144:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857987.186141:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 658 00000100:00100000:3.0:1787857987.186195:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171926912 00000100:00100000:3.0:1787857987.186199:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171926912 00000100:00100000:3.0:1787857987.186225:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171926528 00000100:00100000:3.0:1787857987.186228:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171926528 00000100:00100000:3.0:1787857987.186247:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171926784 00000100:00100000:3.0:1787857987.186249:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171926784 00000100:00100000:3.0:1787857987.186264:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 631 00000100:00100000:3.0:1787857987.186270:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171926912:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857987.186298:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171926912:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857987.186305:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 631 00000100:00100000:3.0:1787857987.186317:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 632 00000100:00100000:3.0:1787857987.186323:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171926528:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857987.186346:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171926528:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857987.186353:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 632 00000100:00100000:3.0:1787857987.186365:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 633 00000100:00100000:3.0:1787857987.186372:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171926784:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857987.186399:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171926784:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857987.186405:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 633 00000100:00100000:1.0:1787857987.186520:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171926400 00000100:00100000:1.0:1787857987.186559:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 634 00000100:00100000:1.0:1787857987.186566:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171926400:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857987.186590:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171926400:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857987.186595:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 634 00000100:00080000:1.0:1787857987.186626:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857987.186631:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857987.186633:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787857987.310804:0:24783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00010000:00010000:2.0:1787857987.311192:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857987.311259:0:24783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857987.312305:0:24783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787857987.312321:0:24783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857988.335056:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857988.462991:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857988.463015:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188329600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857988.463097:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857988.463351:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188329600 00000100:00100000:2.0:1787857988.463359:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188329600 00000100:00100000:2.0:1787857988.463429:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787857988.463439:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188329600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857988.463490:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787857988.463544:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188329600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857988.463552:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1787857988.463611:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857988.463703:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188329600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857989.358102:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857989.512541:0:24835:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857989.512561:0:24835:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857989.520503:0:24835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787857989.520536:0:24835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857989.998112:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188329984:0@lo:400:kworker.0 00000100:00100000:1.0:1787857989.998202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857989.998274:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787857989.998281:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188329856:0@lo:400:kworker.0 00000100:00100000:1.0:1787857989.998322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857989.998341:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188330368:0@lo:400:kworker.0 00000100:00100000:1.0:1787857989.998364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857989.998397:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188329984 00000100:00100000:1.0:1787857989.998407:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188329984 00000100:00100000:1.0:1787857989.998481:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188329856 00000100:00100000:1.0:1787857989.998485:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188329856 00000100:00100000:1.0:1787857989.998508:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1787857989.998517:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188329984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857989.998573:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188329984:12345-0@lo:400:kworker.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857989.998581:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1787857989.998602:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1787857989.998607:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188329856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857989.998635:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188329856:12345-0@lo:400:kworker.0 Request processed in 28us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857989.998641:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1787857989.998664:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188330368 00000100:00100000:1.0:1787857989.998668:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188330368 00000100:00100000:1.0:1787857989.998693:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1787857989.998700:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188330368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857989.998728:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188330368:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857989.998735:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00080000:1.0:1787857989.998752:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857989.998757:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857989.998806:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188329856:0@lo:400:kworker.0 00000100:00100000:1.0:1787857989.998840:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188330368:0@lo:400:kworker.0 00000100:00100000:1.0:1787857989.998849:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188329984:0@lo:400:kworker.0 00000100:00100000:3.0:1787857989.999273:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188329728:0@lo:400:kworker.0 00000100:00100000:3.0:1787857989.999320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857989.999364:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188330240:0@lo:400:kworker.0 00000100:00100000:3.0:1787857989.999391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857989.999422:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857989.999436:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188330112:0@lo:400:kworker.0 00000100:00100000:3.0:1787857989.999461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857989.999492:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188330112 00000100:00100000:3.0:1787857989.999497:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188330112 00000100:00100000:3.0:1787857989.999543:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1787857989.999552:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188330112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857989.999596:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188330112:12345-0@lo:400:kworker.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857989.999602:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1787857989.999637:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188330112:0@lo:400:kworker.0 00000100:00100000:2.0:1787857989.999777:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188330240 00000100:00100000:2.0:1787857989.999784:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188330240 00000100:00100000:2.0:1787857989.999884:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1787857989.999893:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188330240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857989.999944:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188330240:12345-0@lo:400:kworker.0 Request processed in 52us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857989.999951:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1787857989.999982:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188330240:0@lo:400:kworker.0 00000100:00080000:0.0:1787857990.000117:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857990.000310:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188329728 00000100:00100000:1.0:1787857990.000315:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188329728 00000100:00100000:1.0:1787857990.000355:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1787857990.000362:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188329728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857990.000414:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188329728:12345-0@lo:400:kworker.0 Request processed in 52us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857990.000421:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1787857990.000572:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188329728:0@lo:400:kworker.0 00010000:00010000:0.0:1787857990.382091:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857990.514784:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188330496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857990.514920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857990.515084:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188330496 00000100:00100000:0.0:1787857990.515094:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188330496 00000100:00100000:0.0:1787857990.515174:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787857990.515185:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188330496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857990.515230:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787857990.517211:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188330496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2016us (2281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857990.517226:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787857990.517291:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188330496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857991.409456:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857991.636172:0:24886:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857991.636183:0:24886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857991.636943:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787857991.636955:0:24886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857992.276215:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857992.276282:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857992.276313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857992.276347:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857992.276367:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857992.276401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787857992.276434:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787857992.276502:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171927168 00000100:00100000:2.0:1787857992.276515:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171927168 00000100:00100000:2.0:1787857992.276592:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171927552 00000100:00100000:2.0:1787857992.276596:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171927552 00000100:00100000:2.0:1787857992.276620:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 600 00000100:00100000:2.0:1787857992.276632:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171927168:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857992.276760:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171927168:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 130us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857992.276769:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 600 00000100:00100000:2.0:1787857992.276789:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 601 00000100:00100000:2.0:1787857992.276796:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171927552:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857992.276861:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171927552:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 65us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857992.276868:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 601 00000100:00100000:2.0:1787857992.278605:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171927040 00000100:00100000:2.0:1787857992.278619:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171927040 00000100:00100000:2.0:1787857992.278683:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 660 00000100:00100000:2.0:1787857992.278693:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171927040:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857992.278775:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171927040:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 83us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857992.278783:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 660 00000100:00100000:3.0:1787857992.289132:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171927424 00000100:00100000:3.0:1787857992.289154:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171927424 00000100:00100000:3.0:1787857992.289304:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171927680 00000100:00100000:3.0:1787857992.289308:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171927680 00000100:00100000:3.0:1787857992.289339:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171927296 00000100:00100000:3.0:1787857992.289342:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171927296 00000100:00100000:3.0:1787857992.289363:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171927808 00000100:00100000:3.0:1787857992.289366:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171927808 00000100:00100000:3.0:1787857992.289411:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 637 00000100:00100000:3.0:1787857992.289424:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171927424:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857992.289518:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171927424:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 98us (13236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857992.289526:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 637 00000100:00100000:3.0:1787857992.289546:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 638 00000100:00100000:3.0:1787857992.289552:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171927680:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857992.289578:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171927680:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (13265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857992.289583:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 638 00000100:00100000:3.0:1787857992.289593:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 639 00000100:00100000:3.0:1787857992.289599:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171927296:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857992.289620:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171927296:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (13252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857992.289627:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 639 00000100:00100000:3.0:1787857992.289637:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 640 00000100:00100000:3.0:1787857992.289642:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171927808:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787857992.294539:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171927808:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 49us (13258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857992.294560:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 640 00000100:00080000:1.0:1787857992.294727:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857992.294734:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857992.294738:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857992.430352:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857993.455978:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857993.582129:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188330624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857993.582234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857993.582341:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188330624 00000100:00100000:3.0:1787857993.582350:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188330624 00000100:00100000:3.0:1787857993.582431:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787857993.582441:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188330624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857993.582479:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857993.582536:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188330624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857993.582545:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787857993.582596:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188330624:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857993.582730:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787857993.863233:0:24937:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857993.863246:0:24937:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857993.863805:0:24937:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787857993.863842:0:24937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787857993.904334:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857993.904347:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857993.905054:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857993.905067:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857994.478398:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857995.118125:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857995.118244:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857995.118278:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188331136:0@lo:400:kworker.0 00000100:00100000:0.0:1787857995.118384:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857995.118478:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188331136 00000100:00100000:0.0:1787857995.118488:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188331136 00000100:00100000:0.0:1787857995.118566:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1787857995.118581:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188331136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857995.118644:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188331136:12345-0@lo:400:kworker.0 Request processed in 67us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857995.118652:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1787857995.118701:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188331136:0@lo:400:kworker.0 00000100:00080000:0.0:1787857995.118731:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857995.119917:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188330880:0@lo:400:kworker.0 00000100:00100000:3.0:1787857995.119992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857995.120056:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857995.120062:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188331008:0@lo:400:kworker.0 00000100:00100000:3.0:1787857995.120084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857995.120121:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188330880 00000100:00100000:3.0:1787857995.120129:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188330880 00000100:00100000:3.0:1787857995.120172:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188331008 00000100:00100000:3.0:1787857995.120174:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188331008 00000100:00100000:3.0:1787857995.120200:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1787857995.120206:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188330880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857995.120257:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188330880:12345-0@lo:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857995.120263:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1787857995.120280:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1787857995.120285:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188331008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857995.120310:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188331008:12345-0@lo:400:kworker.0 Request processed in 24us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857995.120315:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1787857995.120366:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188331008:0@lo:400:kworker.0 00000100:00100000:3.0:1787857995.120375:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188330880:0@lo:400:kworker.0 00000100:00080000:0.0:1787857995.120675:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857995.121117:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188330752:0@lo:400:kworker.0 00000100:00100000:0.0:1787857995.121169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857995.121649:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188330752 00000100:00100000:1.0:1787857995.121657:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188330752 00000100:00100000:1.0:1787857995.121718:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1787857995.121728:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188330752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857995.121804:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188330752:12345-0@lo:400:kworker.0 Request processed in 78us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857995.121812:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1787857995.121895:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188330752:0@lo:400:kworker.0 00000100:00100000:3.0:1787857995.124952:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857995.124989:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188331392:0@lo:400:kworker.0 00000100:00100000:2.0:1787857995.125124:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857995.125143:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188331264:0@lo:400:kworker.0 00000100:00100000:3.0:1787857995.125152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857995.125197:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857995.125246:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188331264 00000100:00100000:2.0:1787857995.125255:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188331264 00000100:00100000:3.0:1787857995.125355:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188331392 00000100:00100000:2.0:1787857995.125361:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1787857995.125362:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188331392 00000100:00100000:2.0:1787857995.125377:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188331264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857995.125405:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1787857995.125416:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188331392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857995.125450:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188331264:12345-0@lo:400:kworker.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857995.125460:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1787857995.125471:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188331392:12345-0@lo:400:kworker.0 Request processed in 57us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857995.125479:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00080000:2.0:1787857995.125488:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857995.125495:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857995.125535:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188331264:0@lo:400:kworker.0 00000100:00100000:0.0:1787857995.134973:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188331392:0@lo:400:kworker.0 00010000:00010000:0.0:1787857995.509925:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857995.638663:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188331520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857995.638753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857995.639107:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188331520 00000100:00100000:3.0:1787857995.639120:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188331520 00000100:00100000:3.0:1787857995.639202:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787857995.639220:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188331520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857995.639280:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787857995.642988:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188331520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3758us (4219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857995.643010:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787857995.651549:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188331520:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787857995.870331:0:24988:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857995.870345:0:24988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857995.875080:0:24988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787857995.875107:0:24988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787857996.526090:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857997.392622:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857997.392673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857997.392695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857997.392723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857997.392750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857997.392768:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857997.392795:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787857997.393012:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171928064 00000100:00100000:0.0:1787857997.393022:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171928064 00000100:00100000:0.0:1787857997.393080:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171928448 00000100:00100000:0.0:1787857997.393083:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171928448 00000100:00100000:0.0:1787857997.393107:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 605 00000100:00100000:0.0:1787857997.393116:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171928064:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857997.393189:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171928064:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 75us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857997.393197:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 605 00000100:00100000:0.0:1787857997.393214:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 606 00000100:00100000:0.0:1787857997.393220:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171928448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787857997.393244:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171928448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857997.393250:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 606 00000100:00100000:0.0:1787857997.393267:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171928320 00000100:00100000:0.0:1787857997.393270:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171928320 00000100:00100000:0.0:1787857997.393310:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171928576 00000100:00100000:0.0:1787857997.393313:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171928576 00000100:00100000:0.0:1787857997.393333:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171928192 00000100:00100000:0.0:1787857997.393336:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171928192 00000100:00100000:0.0:1787857997.393348:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171928704 00000100:00100000:0.0:1787857997.393350:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171928704 00000100:00100000:0.0:1787857997.393363:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 643 00000100:00100000:0.0:1787857997.393369:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171928320:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857997.393375:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 644 00000100:00100000:2.0:1787857997.393384:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171928576:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857997.393415:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171928576:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857997.393422:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 644 00000100:00100000:2.0:1787857997.393436:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 645 00000100:00100000:2.0:1787857997.393441:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171928192:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857997.393464:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171928192:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857997.393470:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 645 00000100:00100000:2.0:1787857997.393481:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 646 00000100:00100000:2.0:1787857997.393486:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171928704:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787857997.393508:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171928704:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857997.393514:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 646 00000100:00100000:0.0:1787857997.393795:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171928320:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 424us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857997.393803:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 643 00000100:00100000:1.0:1787857997.393887:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171927936 00000100:00100000:1.0:1787857997.393892:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171927936 00000100:00100000:1.0:1787857997.393925:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 662 00000100:00100000:1.0:1787857997.393932:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171927936:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787857997.393960:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171927936:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857997.393967:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 662 00000100:00080000:3.0:1787857997.394938:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857997.394947:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857997.394951:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857997.550065:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857997.861738:0:25040:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857997.861749:0:25040:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857997.862523:0:25040:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787857997.862661:0:25040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787857998.574125:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857998.702032:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188331648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857998.702128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857998.705174:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188331648 00000100:00100000:0.0:1787857998.705239:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188331648 00000100:00100000:0.0:1787857998.705388:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787857998.705402:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188331648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857998.705465:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:3.0:1787857998.705618:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857998.706569:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188331648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1165us (4436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857998.706580:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787857998.706787:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188331648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857999.598344:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857999.826228:0:25091:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857999.826248:0:25091:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857999.827423:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787857999.827447:0:25091:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858000.240624:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188332032:0@lo:400:kworker.0 00000100:00100000:0.0:1787858000.240759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858000.240785:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188332160:0@lo:400:kworker.0 00000100:00100000:2.0:1787858000.240852:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858000.240944:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188331904:0@lo:400:kworker.0 00000100:00100000:3.0:1787858000.240975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858000.240996:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188332416:0@lo:400:kworker.0 00000100:00100000:3.0:1787858000.241015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858000.241352:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188331776:0@lo:400:kworker.0 00000100:00100000:1.0:1787858000.241399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858000.242102:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188332032 00000100:00100000:2.0:1787858000.242113:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188332032 00000100:00100000:2.0:1787858000.242226:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188331904 00000100:00100000:2.0:1787858000.242305:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188331904 00000100:00100000:2.0:1787858000.242338:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1787858000.242425:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188332032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858000.242522:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188332032:12345-0@lo:400:kworker.0 Request processed in 175us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858000.242530:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1787858000.242549:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1787858000.242562:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188331904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858000.242592:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188331904:12345-0@lo:400:kworker.0 Request processed in 31us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858000.242598:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1787858000.242618:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188332160 00000100:00100000:2.0:1787858000.242622:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188332160 00000100:00100000:2.0:1787858000.242651:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188332416 00000100:00100000:2.0:1787858000.242655:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188332416 00000100:00100000:2.0:1787858000.242751:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1787858000.242759:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188332160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858000.242792:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7045a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188332160:12345-0@lo:400:kworker.0 Request processed in 35us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858000.242798:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1787858000.242807:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1787858000.242813:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188332416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858000.242857:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188332416:12345-0@lo:400:kworker.0 Request processed in 45us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858000.242866:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00080000:2.0:1787858000.242923:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858000.242927:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858000.242929:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858000.243294:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188332032:0@lo:400:kworker.0 00000100:00100000:0.0:1787858000.243343:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188331776 00000100:00100000:0.0:1787858000.243348:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188331776 00000100:00100000:0.0:1787858000.243440:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1787858000.243448:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188331776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858000.243487:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188331776:12345-0@lo:400:kworker.0 Request processed in 41us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858000.243493:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1787858000.244078:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188331904:0@lo:400:kworker.0 00000100:00100000:3.0:1787858000.244093:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188332416:0@lo:400:kworker.0 00000100:00100000:1.0:1787858000.251470:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188331776:0@lo:400:kworker.0 00000100:00100000:1.0:1787858000.251493:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188332288:0@lo:400:kworker.0 00000100:00100000:1.0:1787858000.251588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858000.251685:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188332288 00000100:00100000:3.0:1787858000.251694:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188332288 00000100:00100000:3.0:1787858000.251793:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1787858000.251805:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188332288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858000.251896:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188332288:12345-0@lo:400:kworker.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858000.251905:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1787858000.252067:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188332160:0@lo:400:kworker.0 00000100:00100000:1.0:1787858000.252103:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188332288:0@lo:400:kworker.0 00000100:00080000:2.0:1787858000.252337:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787858000.622280:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858000.750455:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188332544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787858000.750564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858000.750754:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188332544 00000100:00100000:1.0:1787858000.750763:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188332544 00000100:00100000:1.0:1787858000.750860:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787858000.750873:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188332544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787858000.750924:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858000.751002:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188332544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858000.751009:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787858000.751269:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188332544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787858001.646146:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858001.749041:0:25142:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858001.749050:0:25142:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858001.751324:0:25142:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858001.751346:0:25142:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787858002.512978:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858002.513032:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858002.513177:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858002.513217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858002.513299:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171929344 00000100:00100000:2.0:1787858002.513319:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171929344 00000100:00100000:2.0:1787858002.513496:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 610 00000100:00100000:2.0:1787858002.513522:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171929344:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858002.513662:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171929344:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 153us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858002.513671:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 610 00000100:00080000:2.0:1787858002.513700:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787858002.515351:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171928832 00000100:00100000:1.0:1787858002.515364:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171928832 00000100:00100000:1.0:1787858002.515427:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 664 00000100:00100000:1.0:1787858002.515437:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171928832:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858002.515508:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171928832:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 73us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858002.515516:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 664 00000100:00100000:3.0:1787858002.524646:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858002.524671:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858002.525004:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171928960 00000100:00100000:2.0:1787858002.525014:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171928960 00000100:00100000:2.0:1787858002.525108:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 611 00000100:00100000:2.0:1787858002.525148:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171928960:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858002.525274:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171928960:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 150us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858002.525288:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 611 00000100:00080000:2.0:1787858002.525326:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858002.525829:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171929088 00000100:00100000:0.0:1787858002.525835:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171929088 00000100:00100000:0.0:1787858002.525881:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171929600 00000100:00100000:0.0:1787858002.525884:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171929600 00000100:00100000:0.0:1787858002.525912:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 649 00000100:00100000:0.0:1787858002.525920:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171929088:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858002.525962:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171929088:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 44us (12930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858002.525969:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 649 00000100:00100000:0.0:1787858002.525985:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 650 00000100:00100000:0.0:1787858002.525991:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171929600:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858002.526031:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171929600:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (12811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858002.526042:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 650 00000100:00100000:3.0:1787858002.527780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858002.527841:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171929216 00000100:00100000:3.0:1787858002.527857:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171929216 00000100:00100000:3.0:1787858002.527922:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171929472 00000100:00100000:3.0:1787858002.527926:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171929472 00000100:00100000:3.0:1787858002.527950:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 651 00000100:00100000:3.0:1787858002.527959:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171929216:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858002.528021:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171929216:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 63us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858002.528028:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 651 00000100:00100000:3.0:1787858002.528043:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 652 00000100:00100000:3.0:1787858002.528049:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171929472:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858002.528071:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171929472:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858002.528077:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 652 00000100:00080000:2.0:1787858002.530632:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858002.530644:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787858002.670307:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858003.120446:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858003.120459:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858003.121157:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858003.121170:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858003.695714:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787858003.715756:0:25194:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858003.715768:0:25194:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858003.716494:0:25194:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858003.716507:0:25194:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858003.824343:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188332672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787858003.824507:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858003.825617:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188332672 00000100:00100000:1.0:1787858003.825633:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188332672 00000100:00100000:1.0:1787858003.825760:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787858003.825774:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188332672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787858003.825962:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858003.826067:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188332672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858003.826074:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787858003.826298:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188332672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787858003.827760:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787858004.718452:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858005.358149:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188333184:0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.358353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858005.358426:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787858005.358434:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188332800:0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.358465:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858005.358492:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188333312:0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.358573:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858005.358603:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188332928:0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.358627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858005.358647:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188333440:0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.358671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858005.358691:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858005.358697:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188333056:0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.358721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858005.358752:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188332800 00000100:00100000:3.0:1787858005.358760:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188332800 00000100:00100000:3.0:1787858005.358841:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1787858005.358853:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188332800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.358912:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188332800:12345-0@lo:400:kworker.0 Request processed in 62us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858005.358920:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1787858005.358952:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188333312 00000100:00100000:3.0:1787858005.358955:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188333312 00000100:00100000:3.0:1787858005.358997:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188332928 00000100:00100000:3.0:1787858005.359000:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188332928 00000100:00100000:3.0:1787858005.359019:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188333056 00000100:00100000:3.0:1787858005.359022:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188333056 00000100:00100000:3.0:1787858005.359041:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1787858005.359047:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188333312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.359084:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188333312:12345-0@lo:400:kworker.0 Request processed in 37us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858005.359091:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1787858005.359105:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1787858005.359110:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188332928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858005.359382:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188333184 00000100:00100000:0.0:1787858005.359387:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188333184 00000100:00100000:0.0:1787858005.359420:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188333440 00000100:00100000:0.0:1787858005.359423:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188333440 00000100:00100000:0.0:1787858005.359446:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1787858005.359454:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188333184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858005.359492:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188333184:12345-0@lo:400:kworker.0 Request processed in 39us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858005.359499:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1787858005.359512:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1787858005.359518:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188333440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858005.360325:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188332928:12345-0@lo:400:kworker.0 Request processed in 1210us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858005.360333:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1787858005.360353:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1787858005.360361:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188333056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858005.364342:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188333440:12345-0@lo:400:kworker.0 Request processed in 4807us (5653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858005.364362:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1787858005.365861:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188332800:0@lo:400:kworker.0 00000100:00100000:0.0:1787858005.365886:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188333312:0@lo:400:kworker.0 00000100:00100000:0.0:1787858005.365899:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188333184:0@lo:400:kworker.0 00000100:00080000:2.0:1787858005.366007:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858005.366014:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858005.366017:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858005.366141:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188333056:12345-0@lo:400:kworker.0 Request processed in 5769us (7407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858005.366288:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1787858005.368582:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188333056:0@lo:400:kworker.0 00000100:00100000:2.0:1787858005.368608:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188332928:0@lo:400:kworker.0 00000100:00100000:2.0:1787858005.368621:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188333440:0@lo:400:kworker.0 00000040:00080000:3.0:1787858005.634891:0:25245:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858005.634902:0:25245:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858005.637636:0:25245:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858005.637657:0:25245:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858005.744161:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858005.870166:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858005.872168:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188333568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858005.872253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858005.872434:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188333568 00000100:00100000:0.0:1787858005.872443:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188333568 00000100:00100000:0.0:1787858005.872576:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787858005.872588:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188333568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787858005.872638:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858005.872696:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188333568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858005.872704:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787858005.872788:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188333568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787858006.769792:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858007.607625:0:25296:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858007.607636:0:25296:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858007.608228:0:25296:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858007.608243:0:25296:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858007.635130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858007.635190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858007.635217:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858007.635238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858007.635261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858007.635267:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171929984 00000100:00100000:1.0:1787858007.635276:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171929984 00000100:00100000:0.0:1787858007.635277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858007.635298:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858007.635316:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171930496 00000100:00100000:0.0:1787858007.635320:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171930496 00000100:00100000:1.0:1787858007.635328:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171930112 00000100:00100000:1.0:1787858007.635331:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171930112 00000100:00100000:0.0:1787858007.635340:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171930368 00000100:00100000:0.0:1787858007.635342:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171930368 00000100:00100000:1.0:1787858007.635349:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 655 00000100:00100000:1.0:1787858007.635357:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171929984:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858007.635393:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171929728 00000100:00100000:3.0:1787858007.635399:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171929728 00000100:00100000:3.0:1787858007.635433:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 666 00000100:00100000:3.0:1787858007.635442:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171929728:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858007.635450:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171929984:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858007.635477:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171929728:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858007.635486:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 666 00000100:00100000:0.0:1787858007.638006:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 656 00000100:00100000:0.0:1787858007.638028:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171930496:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858007.638108:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171930496:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 90us (2867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858007.638115:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 656 00000100:00100000:0.0:1787858007.638134:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 657 00000100:00100000:0.0:1787858007.638141:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b38f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171930112:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858007.638328:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b38f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171930112:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 185us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858007.638335:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 657 00000100:00100000:0.0:1787858007.638353:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 658 00000100:00100000:0.0:1787858007.638361:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171930368:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858007.638397:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171930368:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858007.638404:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 658 00000100:00100000:0.0:1787858007.638436:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171930240 00000100:00100000:0.0:1787858007.638444:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171930240 00000100:00100000:0.0:1787858007.638529:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171929856 00000100:00100000:0.0:1787858007.638533:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171929856 00000100:00100000:0.0:1787858007.638560:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 615 00000100:00100000:0.0:1787858007.638566:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171930240:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858007.638597:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171930240:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (3379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858007.638603:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 615 00000100:00100000:0.0:1787858007.638615:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 616 00000100:00100000:0.0:1787858007.638620:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171929856:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858007.638641:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171929856:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (3380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858007.638647:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 616 00000100:00100000:1.0:1787858007.646495:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 655 00000100:00080000:1.0:1787858007.646542:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858007.646549:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787858007.646552:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787858007.790097:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787858008.814651:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858008.943096:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858008.943128:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188333696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858008.943228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858008.943547:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188333696 00000100:00100000:0.0:1787858008.943556:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188333696 00000100:00080000:1.0:1787858008.943607:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858008.943647:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787858008.943658:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188333696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787858008.943739:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858008.943858:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3040b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188333696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858008.943866:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787858008.943894:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188333696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787858009.839352:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858009.977729:0:25347:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858009.977744:0:25347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858009.978803:0:25347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858009.979066:0:25347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787858010.478755:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188334208:0@lo:400:kworker.0 00000100:00100000:2.0:1787858010.478896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858010.478979:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787858010.478987:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188333824:0@lo:400:kworker.0 00000100:00100000:2.0:1787858010.479022:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858010.479060:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188334336:0@lo:400:kworker.0 00000100:00100000:2.0:1787858010.479089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858010.479116:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188334080:0@lo:400:kworker.0 00000100:00100000:2.0:1787858010.479139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858010.479565:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188333952:0@lo:400:kworker.0 00000100:00100000:0.0:1787858010.495625:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188334208 00000100:00100000:0.0:1787858010.495642:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188334208 00000100:00100000:0.0:1787858010.495746:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1787858010.495758:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188334208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858010.496156:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188334336 00000100:00100000:3.0:1787858010.496162:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188334336 00000100:00100000:3.0:1787858010.496193:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188334080 00000100:00100000:3.0:1787858010.496196:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188334080 00000100:00100000:3.0:1787858010.496213:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1787858010.496219:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188334336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.503164:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1787858010.503191:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188334080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.503334:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188334080:12345-0@lo:400:kworker.0 Request processed in 156us (24193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858010.503352:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1787858010.503395:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188333824 00000100:00100000:1.0:1787858010.503405:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188333824 00000100:00100000:1.0:1787858010.503448:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1787858010.503455:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188333824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.503491:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f0ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188333824:12345-0@lo:400:kworker.0 Request processed in 36us (24467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858010.503497:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00080000:1.0:1787858010.503527:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858010.503533:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858010.503598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858010.503638:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188334464:0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.503669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858010.503798:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188333952 00000100:00100000:1.0:1787858010.503847:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188333952 00000100:00100000:1.0:1787858010.503875:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1787858010.503881:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188333952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.503917:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188333952:12345-0@lo:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858010.503924:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1787858010.503960:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188333952:0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.503992:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188334464 00000100:00100000:1.0:1787858010.503995:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188334464 00000100:00100000:1.0:1787858010.504028:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1787858010.504045:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188334464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.504080:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188334464:12345-0@lo:400:kworker.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858010.504086:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00080000:1.0:1787858010.504104:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787858010.504121:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188334464:0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.504195:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188333824:0@lo:400:kworker.0 00000100:00100000:1.0:1787858010.504208:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188334208:0@lo:400:kworker.0 00000100:00100000:2.0:1787858010.504725:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188334080:0@lo:400:kworker.0 00000100:00100000:3.0:1787858010.507113:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188334336:12345-0@lo:400:kworker.0 Request processed in 10882us (28011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858010.507128:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1787858010.507597:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188334336:0@lo:400:kworker.0 00000100:00100000:0.0:1787858010.512125:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188334208:12345-0@lo:400:kworker.0 Request processed in 16357us (33218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858010.512142:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00010000:00010000:0.0:1787858010.862239:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858010.991708:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858010.991737:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188334592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858010.991846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858010.991923:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188334592 00000100:00100000:0.0:1787858010.991936:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188334592 00000100:00100000:0.0:1787858010.991997:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787858010.992008:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188334592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787858010.992064:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858010.992141:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188334592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858010.992151:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787858010.992251:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188334592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787858011.885970:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858012.125641:0:25399:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858012.125661:0:25399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858012.126229:0:25399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858012.126242:0:25399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858012.757583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858012.757638:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858012.757677:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858012.757725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858012.757755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858012.757775:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858012.757869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858012.757902:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171930880 00000100:00100000:0.0:1787858012.757915:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171930880 00000100:00100000:0.0:1787858012.757978:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171931392 00000100:00100000:0.0:1787858012.757982:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171931392 00000100:00100000:0.0:1787858012.758016:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171931008 00000100:00100000:0.0:1787858012.758019:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171931008 00000100:00100000:0.0:1787858012.758034:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171931264 00000100:00100000:0.0:1787858012.758036:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171931264 00000100:00100000:0.0:1787858012.758052:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 661 00000100:00100000:0.0:1787858012.758060:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171930880:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858012.758140:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171930880:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 79us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858012.758147:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 661 00000100:00100000:0.0:1787858012.758165:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 662 00000100:00100000:0.0:1787858012.758172:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171931392:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858012.758199:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171931392:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858012.758205:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 662 00000100:00100000:0.0:1787858012.758216:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 663 00000100:00100000:0.0:1787858012.758222:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171931008:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858012.758243:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171931008:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858012.758249:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 663 00000100:00100000:0.0:1787858012.758260:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 664 00000100:00100000:0.0:1787858012.758266:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171931264:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858012.758288:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171931264:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858012.758294:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 664 00000100:00100000:0.0:1787858012.758313:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171931136 00000100:00100000:0.0:1787858012.758316:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171931136 00000100:00100000:0.0:1787858012.758348:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171930752 00000100:00100000:0.0:1787858012.758352:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171930752 00000100:00100000:0.0:1787858012.758372:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 620 00000100:00100000:0.0:1787858012.758379:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171931136:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858012.758411:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171931136:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858012.758417:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 620 00000100:00100000:0.0:1787858012.758427:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 621 00000100:00100000:0.0:1787858012.758432:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171930752:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858012.758450:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171930752:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 18us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858012.758455:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 621 00000100:00080000:0.0:1787858012.758487:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787858012.758492:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787858012.758494:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787858012.759510:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171930624 00000100:00100000:2.0:1787858012.759522:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171930624 00000100:00100000:2.0:1787858012.759583:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 668 00000100:00100000:2.0:1787858012.759593:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171930624:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858012.759653:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171930624:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 61us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858012.759660:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 668 00010000:00010000:3.0:1787858012.910930:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858013.369142:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858013.369153:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858013.370197:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858013.370211:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858013.938512:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858014.068057:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188334720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858014.068137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858014.068215:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188334720 00000100:00100000:2.0:1787858014.068225:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188334720 00000100:00100000:2.0:1787858014.068286:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787858014.068295:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188334720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787858014.068336:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787858014.068386:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188334720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858014.068394:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1787858014.068417:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787858014.068455:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188334720:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787858014.098647:0:25450:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858014.098658:0:25450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858014.099850:0:25450:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858014.099865:0:25450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858014.958099:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858015.598191:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188334976:0@lo:400:kworker.0 00000100:00100000:1.0:1787858015.598292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858015.598362:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188335488:0@lo:400:kworker.0 00000100:00100000:1.0:1787858015.598395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858015.598430:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787858015.598439:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188335104:0@lo:400:kworker.0 00000100:00100000:1.0:1787858015.598463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858015.598535:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188334976 00000100:00100000:2.0:1787858015.598547:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188334976 00000100:00100000:2.0:1787858015.598632:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188335104 00000100:00100000:2.0:1787858015.598635:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188335104 00000100:00100000:2.0:1787858015.598678:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1787858015.598691:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188334976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858015.598760:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188334976:12345-0@lo:400:kworker.0 Request processed in 71us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858015.598770:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1787858015.598794:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1787858015.598801:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188335104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858015.598866:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188335104:12345-0@lo:400:kworker.0 Request processed in 65us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858015.598872:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00080000:2.0:1787858015.598891:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858015.599098:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188335232:0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599129:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858015.599157:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787858015.599162:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188334848:0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599188:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858015.599209:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188335360:0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599229:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858015.599255:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188335488 00000100:00100000:0.0:1787858015.599259:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188335488 00000100:00100000:0.0:1787858015.599290:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188335232 00000100:00100000:0.0:1787858015.599293:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188335232 00000100:00100000:0.0:1787858015.599313:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1787858015.599319:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599349:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188335488:12345-0@lo:400:kworker.0 Request processed in 31us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858015.599355:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1787858015.599366:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1787858015.599371:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188335232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599396:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188335232:12345-0@lo:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858015.599401:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1787858015.599414:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188335360 00000100:00100000:0.0:1787858015.599417:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188335360 00000100:00100000:0.0:1787858015.599438:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1787858015.599444:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188335360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599470:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188335360:12345-0@lo:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858015.599475:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1787858015.599492:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188334848 00000100:00100000:0.0:1787858015.599495:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188334848 00000100:00100000:0.0:1787858015.599516:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1787858015.599522:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188334848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599546:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188334848:12345-0@lo:400:kworker.0 Request processed in 24us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858015.599552:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00080000:0.0:1787858015.599603:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787858015.599606:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787858015.599730:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188334848:0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599744:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188335360:0@lo:400:kworker.0 00000100:00100000:0.0:1787858015.599753:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188335232:0@lo:400:kworker.0 00000100:00100000:1.0:1787858015.599952:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188335104:0@lo:400:kworker.0 00000100:00100000:1.0:1787858015.599966:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188334976:0@lo:400:kworker.0 00000100:00100000:1.0:1787858015.599975:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188335488:0@lo:400:kworker.0 00010000:00010000:1.0:1787858015.981994:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858016.110108:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787858016.110140:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188335616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787858016.110246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858016.110471:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188335616 00000100:00100000:2.0:1787858016.110482:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188335616 00000100:00100000:2.0:1787858016.110549:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787858016.110561:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188335616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787858016.110629:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787858016.110690:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188335616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858016.110698:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787858016.111102:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188335616:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787858016.170835:0:25502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858016.170850:0:25502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858016.173766:0:25502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858016.173788:0:25502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858017.008341:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858017.886374:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858017.886428:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858017.886452:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858017.886480:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858017.886498:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858017.886517:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858017.886542:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858017.886575:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171931904 00000100:00100000:1.0:1787858017.886587:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171931904 00000100:00100000:1.0:1787858017.886655:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171932160 00000100:00100000:1.0:1787858017.886659:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171932160 00000100:00100000:1.0:1787858017.886680:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171931776 00000100:00100000:1.0:1787858017.886683:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171931776 00000100:00100000:1.0:1787858017.886698:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171932288 00000100:00100000:1.0:1787858017.886700:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171932288 00000100:00100000:1.0:1787858017.886718:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 667 00000100:00100000:1.0:1787858017.886728:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171931904:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858017.886842:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171931904:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 113us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858017.886850:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 667 00000100:00100000:1.0:1787858017.886866:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 668 00000100:00100000:1.0:1787858017.886873:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171932160:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858017.886912:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171932160:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858017.886918:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 668 00000100:00100000:1.0:1787858017.886931:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 669 00000100:00100000:1.0:1787858017.886938:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171931776:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858017.886961:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171931776:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858017.886967:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 669 00000100:00100000:1.0:1787858017.886978:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 670 00000100:00100000:1.0:1787858017.886984:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171932288:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858017.887007:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171932288:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858017.887014:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 670 00000100:00100000:1.0:1787858017.887049:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171931520 00000100:00100000:1.0:1787858017.887053:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171931520 00000100:00100000:1.0:1787858017.887090:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 670 00000100:00100000:1.0:1787858017.887097:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171931520:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858017.887123:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171931520:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858017.887130:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 670 00000100:00100000:1.0:1787858017.887164:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171931648 00000100:00100000:1.0:1787858017.887167:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171931648 00000100:00100000:1.0:1787858017.887200:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171932032 00000100:00100000:1.0:1787858017.887203:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171932032 00000100:00100000:1.0:1787858017.887223:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 625 00000100:00100000:1.0:1787858017.887230:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171931648:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858017.887261:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171931648:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858017.887267:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 625 00000100:00100000:1.0:1787858017.887280:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 626 00000100:00100000:1.0:1787858017.887286:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171932032:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858017.887309:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171932032:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858017.887315:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 626 00000100:00080000:1.0:1787858017.887336:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858017.887341:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787858017.887344:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787858018.030128:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858018.291019:0:25554:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858018.291037:0:25554:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858018.291572:0:25554:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858018.291583:0:25554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858019.054198:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858019.187054:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787858019.187084:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188335744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787858019.187167:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858019.187572:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188335744 00000100:00100000:2.0:1787858019.187583:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188335744 00000100:00100000:2.0:1787858019.187687:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787858019.187701:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188335744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787858019.187742:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787858019.187797:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188335744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858019.187804:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1787858019.187911:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858019.187962:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901453840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188335744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787858020.078035:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858020.263374:0:25605:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858020.263387:0:25605:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858020.266169:0:25605:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858020.266194:0:25605:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787858020.721398:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188335872:0@lo:400:kworker.0 00000100:00100000:2.0:1787858020.721491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858020.722427:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188335872 00000100:00100000:0.0:1787858020.722441:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188335872 00000100:00100000:0.0:1787858020.722513:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1787858020.722526:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188335872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.723411:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188336256:0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.723461:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858020.723531:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188336128:0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.723586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858020.723606:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787858020.723621:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188336000:0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.723642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858020.723683:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188336128 00000100:00100000:3.0:1787858020.723688:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188336128 00000100:00100000:3.0:1787858020.723746:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188336000 00000100:00100000:3.0:1787858020.723750:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188336000 00000100:00100000:3.0:1787858020.723771:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1787858020.723778:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188336128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.723847:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901453840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188336128:12345-0@lo:400:kworker.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858020.723855:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1787858020.723874:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1787858020.723880:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188336000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.723907:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998daac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188336000:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858020.723913:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1787858020.723932:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188336256 00000100:00100000:3.0:1787858020.723936:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188336256 00000100:00100000:3.0:1787858020.723963:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1787858020.723970:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188336256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.724008:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901451a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188336256:12345-0@lo:400:kworker.0 Request processed in 38us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858020.724015:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1787858020.724056:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188336256:0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.724086:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188336000:0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.724095:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c320de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188336128:0@lo:400:kworker.0 00000100:00080000:3.0:1787858020.724136:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858020.730493:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188335872:12345-0@lo:400:kworker.0 Request processed in 7957us (8989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858020.730510:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1787858020.731507:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188336512:0@lo:400:kworker.0 00000100:00100000:1.0:1787858020.731596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858020.731813:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188336512 00000100:00100000:1.0:1787858020.731861:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188336512 00000100:00100000:1.0:1787858020.731935:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1787858020.731948:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188336512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858020.732009:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188336512:12345-0@lo:400:kworker.0 Request processed in 63us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858020.732018:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1787858020.732056:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787858020.732069:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188336512:0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.732073:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990124ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188336384:0@lo:400:kworker.0 00000100:00080000:1.0:1787858020.732099:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787858020.732129:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858020.732274:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188336384 00000100:00100000:1.0:1787858020.732279:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188336384 00000100:00100000:3.0:1787858020.732357:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1787858020.732367:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188336384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858020.732410:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c320de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188336384:12345-0@lo:400:kworker.0 Request processed in 47us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858020.732421:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00080000:3.0:1787858020.732437:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858020.732458:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990124ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188336384:0@lo:400:kworker.0 00000100:00100000:2.0:1787858020.737289:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188335872:0@lo:400:kworker.0 00010000:00010000:3.0:1787858021.103779:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858021.230430:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188336640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787858021.230535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858021.230919:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188336640 00000100:00100000:0.0:1787858021.230930:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188336640 00000100:00100000:0.0:1787858021.230993:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787858021.231002:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188336640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787858021.231047:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858021.236505:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188336640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5489us (5955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858021.236523:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787858021.236762:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188336640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787858022.130382:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858022.620630:0:25656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858022.620639:0:25656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858022.624880:0:25656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858022.624901:0:25656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858022.993201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858022.993458:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171932416 00000100:00100000:0.0:1787858022.993470:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171932416 00000100:00100000:0.0:1787858022.993546:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 672 00000100:00100000:0.0:1787858022.993556:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171932416:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858022.993647:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171932416:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 92us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858022.993655:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 672 00000100:00100000:1.0:1787858023.004769:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858023.004861:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858023.004887:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858023.004917:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858023.004947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858023.005000:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858023.005049:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171932800 00000100:00100000:1.0:1787858023.005060:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171932800 00000100:00100000:1.0:1787858023.005138:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171933056 00000100:00100000:1.0:1787858023.005142:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171933056 00000100:00100000:3.0:1787858023.005342:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171932544 00000100:00100000:3.0:1787858023.005347:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171932544 00000100:00100000:3.0:1787858023.005382:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171932928 00000100:00100000:3.0:1787858023.005384:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171932928 00000100:00100000:3.0:1787858023.005408:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 630 00000100:00100000:3.0:1787858023.005418:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171932544:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858023.005518:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2350:x1874704171932544:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 100us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858023.005526:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 630 00000100:00100000:3.0:1787858023.005545:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 631 00000100:00100000:3.0:1787858023.005552:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171932928:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858023.005578:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c27143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171932928:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858023.005584:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 631 00000100:00080000:3.0:1787858023.005644:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787858023.005650:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787858023.005652:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787858023.005666:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171932672 00000100:00100000:3.0:1787858023.005671:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171932672 00000100:00100000:3.0:1787858023.005701:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171933184 00000100:00100000:3.0:1787858023.005706:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171933184 00000100:00100000:3.0:1787858023.005722:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 673 00000100:00100000:3.0:1787858023.005729:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171932800:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858023.005913:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171932800:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 184us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858023.005920:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 673 00000100:00100000:3.0:1787858023.005933:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 674 00000100:00100000:3.0:1787858023.005938:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171932672:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858023.005957:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dacc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171932672:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858023.005963:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 674 00000100:00100000:3.0:1787858023.005972:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 675 00000100:00100000:3.0:1787858023.005977:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171933184:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858023.005999:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998dabb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171933184:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858023.006005:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 675 00000100:00080000:3.0:1787858023.006022:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787858023.006025:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858023.010562:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 676 00000100:00100000:1.0:1787858023.010586:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171933056:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858023.010692:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990124c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171933056:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 115us (5803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858023.010700:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 676 00010000:00010000:0.0:1787858023.151445:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858023.598105:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858023.598118:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858023.598953:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858023.598974:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858024.174032:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858024.308303:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858024.308328:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188336768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858024.308405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858024.308611:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188336768 00000100:00100000:3.0:1787858024.308621:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188336768 00000100:00100000:3.0:1787858024.308718:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787858024.308731:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188336768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858024.308785:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858024.308876:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188336768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858024.308884:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1787858024.308984:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787858024.309038:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188336768:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787858024.887278:0:25708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858024.887292:0:25708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858024.889115:0:25708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858024.889132:0:25708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858025.198172:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858025.838458:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188337024:0@lo:400:kworker.0 00000100:00100000:1.0:1787858025.838562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858025.838649:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188337536:0@lo:400:kworker.0 00000100:00100000:1.0:1787858025.838685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858025.838727:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787858025.838733:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188337152:0@lo:400:kworker.0 00000100:00100000:1.0:1787858025.838769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858025.838844:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188337536 00000100:00100000:1.0:1787858025.838854:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188337536 00000100:00100000:1.0:1787858025.838949:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1787858025.838961:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188337536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858025.839024:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188337536:12345-0@lo:400:kworker.0 Request processed in 65us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858025.839032:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1787858025.839056:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188337024 00000100:00100000:1.0:1787858025.839059:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188337024 00000100:00100000:1.0:1787858025.839084:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188337152 00000100:00100000:1.0:1787858025.839087:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188337152 00000100:00100000:1.0:1787858025.839104:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1787858025.839110:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188337024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858025.839140:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188337024:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858025.839146:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1787858025.839157:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1787858025.839162:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188337152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858025.839185:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffaa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188337152:12345-0@lo:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858025.839191:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1787858025.839234:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188337152:0@lo:400:kworker.0 00000100:00100000:1.0:1787858025.839246:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188337024:0@lo:400:kworker.0 00000100:00100000:1.0:1787858025.839254:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188337536:0@lo:400:kworker.0 00000100:00100000:0.0:1787858025.839688:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188337280:0@lo:400:kworker.0 00000100:00100000:0.0:1787858025.839731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858025.839773:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787858025.839780:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188336896:0@lo:400:kworker.0 00000100:00100000:0.0:1787858025.839808:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858025.839871:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188337408:0@lo:400:kworker.0 00000100:00100000:0.0:1787858025.839895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858025.839935:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188337408 00000100:00100000:0.0:1787858025.839939:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188337408 00000100:00100000:0.0:1787858025.839973:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1787858025.839980:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188337408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858025.840018:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188337408:12345-0@lo:400:kworker.0 Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858025.840025:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1787858025.840053:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188337408:0@lo:400:kworker.0 00000100:00100000:3.0:1787858025.840167:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188336896 00000100:00100000:3.0:1787858025.840171:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188336896 00000100:00100000:3.0:1787858025.840207:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1787858025.840215:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188336896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858025.840254:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188336896:12345-0@lo:400:kworker.0 Request processed in 41us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858025.840260:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1787858025.840843:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188336896:0@lo:400:kworker.0 00000100:00080000:2.0:1787858025.840942:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787858025.840950:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787858025.840962:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188337280 00000100:00100000:2.0:1787858025.840967:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188337280 00000100:00100000:2.0:1787858025.841012:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1787858025.841020:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188337280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858025.841090:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188337280:12345-0@lo:400:kworker.0 Request processed in 71us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858025.841097:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1787858025.841247:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188337280:0@lo:400:kworker.0 00010000:00010000:3.0:1787858026.229708:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858026.351304:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858026.351335:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188337664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858026.351441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858026.351510:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188337664 00000100:00100000:3.0:1787858026.351517:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188337664 00000100:00100000:3.0:1787858026.351562:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787858026.351571:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188337664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787858026.351624:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858026.351674:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188337664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858026.351681:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787858026.351744:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f9d0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188337664:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787858027.114209:0:25759:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858027.114222:0:25759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858027.115200:0:25759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858027.115221:0:25759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858027.246869:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858028.118811:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858028.118907:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858028.119021:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171933312 00000100:00100000:3.0:1787858028.119034:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171933312 00000100:00100000:3.0:1787858028.119099:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 674 00000100:00100000:3.0:1787858028.119111:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171933312:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858028.119541:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171933312:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 430us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858028.119550:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 674 00000100:00100000:3.0:1787858028.119866:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858028.119902:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858028.119932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858028.119959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858028.119985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858028.120015:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171933696 00000100:00100000:3.0:1787858028.120021:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171933696 00000100:00100000:3.0:1787858028.120059:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171933952 00000100:00100000:3.0:1787858028.120062:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171933952 00000100:00100000:3.0:1787858028.120079:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171933568 00000100:00100000:3.0:1787858028.120082:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171933568 00000100:00100000:3.0:1787858028.120096:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171934080 00000100:00100000:3.0:1787858028.120099:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171934080 00000100:00100000:0.0:1787858028.120113:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 679 00000100:00100000:0.0:1787858028.120131:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171933696:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858028.120179:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171933696:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 56us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858028.120189:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171933440 00000100:00100000:3.0:1787858028.120429:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 680 00000100:00100000:3.0:1787858028.120438:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171933952:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858028.120470:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171933952:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858028.120478:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 680 00000100:00100000:3.0:1787858028.120491:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 681 00000100:00100000:3.0:1787858028.120497:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171933568:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858028.120522:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f9d0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171933568:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858028.120529:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 681 00000100:00100000:3.0:1787858028.120541:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 682 00000100:00100000:3.0:1787858028.120548:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171934080:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858028.120590:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171934080:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 42us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858028.120597:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 682 00000100:00100000:3.0:1787858028.120617:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171933824 00000100:00100000:3.0:1787858028.120621:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171933824 00000100:00100000:3.0:1787858028.120809:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 635 00000100:00100000:3.0:1787858028.120857:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2347:x1874704171933824:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858028.120891:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2347:x1874704171933824:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 76us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858028.120897:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 635 00000100:00100000:1.0:1787858028.121474:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171933440 00000100:00080000:2.0:1787858028.124930:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787858028.124944:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858028.124947:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787858028.127884:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 636 00000100:00100000:1.0:1787858028.127906:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171933440:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858028.128028:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171933440:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 129us (9119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858028.128039:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 636 00000100:00100000:0.0:1787858028.136543:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 679 00000100:00080000:2.0:1787858028.144682:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787858028.270066:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787858029.308590:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858029.328017:0:25810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858029.328108:0:25810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858029.329295:0:25810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858029.329316:0:25810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858029.435197:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787858029.435225:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188337792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787858029.435305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858029.435473:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188337792 00000100:00100000:3.0:1787858029.435480:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188337792 00000100:00100000:3.0:1787858029.435536:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787858029.435545:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188337792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858029.435589:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858029.435637:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188337792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858029.435644:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:3.0:1787858029.435665:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858029.435715:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188337792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787858030.318302:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858030.958052:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188338048:0@lo:400:kworker.0 00000100:00100000:3.0:1787858030.958152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858030.958232:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188338048 00000100:00100000:3.0:1787858030.958238:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188338048 00000100:00100000:3.0:1787858030.958286:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1787858030.958293:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6139850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188338048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858030.958372:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6139850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188338048:12345-0@lo:400:kworker.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858030.958379:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1787858030.959573:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188338048:0@lo:400:kworker.0 00000100:00100000:3.0:1787858030.959633:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188338176:0@lo:400:kworker.0 00000100:00100000:3.0:1787858030.959687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858030.959734:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188338176 00000100:00100000:3.0:1787858030.959739:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188338176 00000100:00100000:3.0:1787858030.959784:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1787858030.959792:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188338176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858030.959863:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188338176:12345-0@lo:400:kworker.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858030.959870:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00080000:3.0:1787858030.959891:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858030.959909:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188338176:0@lo:400:kworker.0 00000100:00100000:3.0:1787858030.959957:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188338560:0@lo:400:kworker.0 00000100:00100000:3.0:1787858030.959983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858030.960010:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188338560 00000100:00100000:3.0:1787858030.960015:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188338560 00000100:00100000:3.0:1787858030.960052:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1787858030.960059:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188338560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858030.960092:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188338560:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858030.960098:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00080000:3.0:1787858030.960112:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787858030.960130:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188338560:0@lo:400:kworker.0 00000100:00100000:0.0:1787858030.960512:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188338304:0@lo:400:kworker.0 00000100:00100000:0.0:1787858030.960545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858030.960576:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787858030.960582:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188337920:0@lo:400:kworker.0 00000100:00100000:0.0:1787858030.960608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858030.960628:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188338432:0@lo:400:kworker.0 00000100:00100000:0.0:1787858030.960663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858030.960701:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188337920 00000100:00100000:0.0:1787858030.960705:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188337920 00000100:00100000:0.0:1787858030.960735:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1787858030.960741:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858030.960777:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188337920:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858030.960784:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1787858030.960837:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188337920:0@lo:400:kworker.0 00000100:00100000:1.0:1787858030.960918:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188338432 00000100:00100000:1.0:1787858030.960923:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188338432 00000100:00100000:1.0:1787858030.960981:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1787858030.960989:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188338432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858030.961031:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188338432:12345-0@lo:400:kworker.0 Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858030.961038:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1787858030.961068:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188338432:0@lo:400:kworker.0 00000100:00080000:0.0:1787858030.961214:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858030.962136:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188338304 00000100:00100000:0.0:1787858030.962146:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188338304 00000100:00100000:0.0:1787858030.962196:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1787858030.962205:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188338304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858030.962274:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188338304:12345-0@lo:400:kworker.0 Request processed in 70us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858030.962280:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1787858030.963102:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188338304:0@lo:400:kworker.0 00010000:00010000:3.0:1787858031.346728:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858031.480376:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787858031.480556:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188338688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787858031.481123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858031.481187:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188338688 00000100:00100000:2.0:1787858031.481195:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188338688 00000100:00100000:2.0:1787858031.481246:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787858031.481256:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ef916450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188338688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787858031.481295:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787858031.482302:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ef916450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188338688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1042us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858031.482313:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787858031.483809:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188338688:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787858031.655865:0:25861:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858031.655879:0:25861:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858031.656476:0:25861:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858031.656486:0:25861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858032.366022:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858033.241067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858033.241122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858033.241153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858033.241187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858033.241209:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858033.241228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858033.241254:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858033.241294:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171934720 00000100:00100000:3.0:1787858033.241305:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171934720 00000100:00100000:3.0:1787858033.241380:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171934336 00000100:00100000:3.0:1787858033.241383:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171934336 00000100:00100000:3.0:1787858033.241410:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 640 00000100:00100000:3.0:1787858033.241420:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171934720:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858033.241511:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171934720:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 92us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858033.241519:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 640 00000100:00100000:3.0:1787858033.241538:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 641 00000100:00100000:3.0:1787858033.241544:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171934336:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858033.241570:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171934336:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858033.241576:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 641 00000100:00100000:3.0:1787858033.241615:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171934464 00000100:00100000:3.0:1787858033.241618:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171934464 00000100:00100000:3.0:1787858033.241643:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171934976 00000100:00100000:3.0:1787858033.241646:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171934976 00000100:00100000:3.0:1787858033.241666:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171934592 00000100:00100000:3.0:1787858033.241669:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171934592 00000100:00100000:3.0:1787858033.241683:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171934848 00000100:00100000:3.0:1787858033.241685:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171934848 00000100:00100000:3.0:1787858033.241703:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 685 00000100:00100000:3.0:1787858033.241710:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171934464:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858033.241737:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171934464:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858033.241744:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 685 00000100:00100000:3.0:1787858033.241757:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 686 00000100:00100000:3.0:1787858033.241763:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171934976:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858033.241785:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171934976:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858033.241790:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 686 00000100:00100000:3.0:1787858033.241801:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 687 00000100:00100000:3.0:1787858033.241807:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171934592:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858033.241858:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171934592:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 51us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858033.241868:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 687 00000100:00100000:3.0:1787858033.241880:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 688 00000100:00100000:3.0:1787858033.241886:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171934848:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858033.241907:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171934848:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858033.241913:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 688 00000100:00100000:1.0:1787858033.242404:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171934208 00000100:00100000:1.0:1787858033.242412:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171934208 00000100:00100000:1.0:1787858033.242456:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 676 00000100:00100000:1.0:1787858033.242465:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171934208:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858033.242507:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171934208:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 43us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858033.242514:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 676 00000100:00080000:0.0:1787858033.242797:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787858033.242803:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787858033.242806:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787858033.392525:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858033.682694:0:25913:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858033.682715:0:25913:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858033.684116:0:25913:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858033.684132:0:25913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787858033.838022:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858033.838033:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858033.838726:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858033.838744:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858034.414186:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858034.542512:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787858034.548742:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188338816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787858034.549260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858034.554689:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188338816 00000100:00100000:0.0:1787858034.554709:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188338816 00000100:00100000:0.0:1787858034.554912:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787858034.554926:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188338816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787858034.554988:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858034.555156:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188338816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 233us (5897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858034.555165:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1787858034.562213:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858034.562587:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188338816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787858035.438646:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858035.957121:0:25964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858035.957136:0:25964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858035.959613:0:25964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858035.959633:0:25964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858036.086625:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188339072:0@lo:400:kworker.0 00000100:00100000:1.0:1787858036.086704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858036.086755:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188339584:0@lo:400:kworker.0 00000100:00100000:1.0:1787858036.086780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858036.086813:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787858036.086859:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188339200:0@lo:400:kworker.0 00000100:00100000:1.0:1787858036.086880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858036.086917:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188339072 00000100:00100000:1.0:1787858036.086925:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188339072 00000100:00100000:1.0:1787858036.086981:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188339200 00000100:00100000:1.0:1787858036.086984:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188339200 00000100:00100000:1.0:1787858036.087018:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1787858036.087029:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188339072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858036.087088:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188339072:12345-0@lo:400:kworker.0 Request processed in 61us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858036.087095:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1787858036.087112:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1787858036.087119:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188339200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858036.087145:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188339200:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858036.087149:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1787858036.087192:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188339200:0@lo:400:kworker.0 00000100:00100000:1.0:1787858036.087201:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188339072:0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.087514:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188338944:0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.087560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858036.087596:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188339456:0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.087621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858036.087643:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858036.087649:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188339328:0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.087672:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787858036.087707:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858036.087720:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188339456 00000100:00100000:2.0:1787858036.087723:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188339456 00000100:00100000:2.0:1787858036.087758:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1787858036.087763:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188339456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.087796:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188339456:12345-0@lo:400:kworker.0 Request processed in 33us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858036.087801:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1787858036.087853:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188339584 00000100:00100000:2.0:1787858036.087857:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188339584 00000100:00100000:2.0:1787858036.087884:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188339328 00000100:00100000:2.0:1787858036.087888:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188339328 00000100:00100000:2.0:1787858036.087911:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1787858036.087917:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188339584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.087952:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188339584:12345-0@lo:400:kworker.0 Request processed in 35us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858036.087959:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1787858036.087972:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1787858036.087977:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188339328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.088006:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188339328:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858036.088012:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00080000:2.0:1787858036.088034:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858036.088037:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858036.088039:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858036.088058:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188339328:0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.088066:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188339456:0@lo:400:kworker.0 00000100:00100000:2.0:1787858036.088094:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188339584:0@lo:400:kworker.0 00000100:00100000:1.0:1787858036.088286:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188338944 00000100:00100000:1.0:1787858036.088293:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188338944 00000100:00100000:1.0:1787858036.088465:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1787858036.088472:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188338944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858036.088509:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188338944:12345-0@lo:400:kworker.0 Request processed in 38us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858036.088515:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1787858036.088595:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188338944:0@lo:400:kworker.0 00010000:00010000:0.0:1787858036.462380:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858036.590264:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858036.590298:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188339712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858036.590369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858036.590697:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188339712 00000100:00100000:0.0:1787858036.590705:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188339712 00000100:00100000:0.0:1787858036.590777:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787858036.590792:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188339712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787858036.591039:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858036.591129:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188339712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 337us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858036.591136:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787858036.591249:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188339712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787858037.486477:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858038.121665:0:26015:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858038.121676:0:26015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858038.122716:0:26015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858038.122732:0:26015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858038.354782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858038.354851:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858038.354873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858038.354898:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858038.354922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858038.354942:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858038.354942:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171935488 00000100:00100000:0.0:1787858038.354952:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171935488 00000100:00100000:1.0:1787858038.355017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858038.355024:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171935744 00000100:00100000:0.0:1787858038.355027:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171935744 00000100:00100000:1.0:1787858038.355040:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171935104 00000100:00100000:1.0:1787858038.355043:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171935104 00000100:00100000:0.0:1787858038.355061:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171935360 00000100:00100000:0.0:1787858038.355063:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171935360 00000100:00100000:1.0:1787858038.355071:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 678 00000100:00100000:0.0:1787858038.355075:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171935872 00000100:00100000:0.0:1787858038.355077:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171935872 00000100:00100000:1.0:1787858038.355080:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171935104:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858038.355091:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 691 00000100:00100000:0.0:1787858038.355096:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171935488:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858038.355169:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171935232 00000100:00100000:2.0:1787858038.355173:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171935232 00000100:00100000:2.0:1787858038.355208:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171935616 00000100:00100000:2.0:1787858038.355223:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171935616 00000100:00100000:2.0:1787858038.355248:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 645 00000100:00100000:2.0:1787858038.355255:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171935232:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858038.355320:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171935104:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 240us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858038.355343:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 678 00000100:00100000:0.0:1787858038.355397:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171935488:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 299us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858038.355404:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 691 00000100:00100000:0.0:1787858038.355417:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 692 00000100:00100000:0.0:1787858038.355424:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171935744:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858038.355449:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171935744:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858038.355455:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 692 00000100:00100000:0.0:1787858038.355465:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 693 00000100:00100000:0.0:1787858038.355470:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171935360:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858038.355488:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171935360:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 18us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858038.355495:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 693 00000100:00100000:0.0:1787858038.355514:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 694 00000100:00100000:0.0:1787858038.355520:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171935872:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858038.355540:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171935872:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858038.355545:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 694 00000100:00080000:0.0:1787858038.355563:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787858038.355567:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787858038.355569:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787858038.355606:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 646 00000100:00100000:0.0:1787858038.355613:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171935616:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858038.355634:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171935616:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858038.355639:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 646 00000100:00100000:2.0:1787858038.366801:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171935232:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 11527us (12008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858038.366841:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 645 00010000:00010000:3.0:1787858038.510998:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787858039.534745:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858039.664840:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858039.664877:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188339840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858039.665005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858039.665082:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188339840 00000100:00100000:1.0:1787858039.665092:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188339840 00000100:00100000:1.0:1787858039.665180:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787858039.665190:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188339840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787858039.665238:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858039.665293:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188339840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858039.665301:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:2.0:1787858039.666339:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787858039.666422:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188339840:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787858040.175174:0:26067:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858040.175187:0:26067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858040.175721:0:26067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858040.175736:0:26067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858040.559582:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858041.198429:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188339968:0@lo:400:kworker.0 00000100:00100000:3.0:1787858041.198522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858041.199473:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188339968 00000100:00100000:1.0:1787858041.199484:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188339968 00000100:00100000:1.0:1787858041.199548:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1787858041.199558:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188339968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.202561:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188340352:0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.202639:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858041.202715:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188340352 00000100:00100000:0.0:1787858041.202723:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188340352 00000100:00100000:0.0:1787858041.202780:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1787858041.202790:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188340352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.202865:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188340352:12345-0@lo:400:kworker.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858041.202873:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00080000:0.0:1787858041.202893:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858041.202926:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188340352:0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.202967:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188340224:0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.202995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858041.203024:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787858041.203031:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999015883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188340096:0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.203051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858041.203078:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188340224 00000100:00100000:0.0:1787858041.203082:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188340224 00000100:00100000:0.0:1787858041.203119:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188340096 00000100:00100000:0.0:1787858041.203123:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188340096 00000100:00100000:0.0:1787858041.203156:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1787858041.203163:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188340224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.203200:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188340224:12345-0@lo:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858041.203206:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1787858041.203217:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1787858041.203223:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188340096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.203249:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188340096:12345-0@lo:400:kworker.0 Request processed in 27us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858041.203255:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00080000:0.0:1787858041.203272:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858041.203287:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999015883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188340096:0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.203295:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188340224:0@lo:400:kworker.0 00000100:00100000:1.0:1787858041.210537:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188339968:12345-0@lo:400:kworker.0 Request processed in 10965us (12000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858041.210707:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1787858041.211675:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188339968:0@lo:400:kworker.0 00000100:00100000:2.0:1787858041.212603:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787858041.212623:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188340608:0@lo:400:kworker.0 00000100:00100000:2.0:1787858041.213261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858041.213489:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188340480:0@lo:400:kworker.0 00000100:00100000:3.0:1787858041.213533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858041.213602:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188340480 00000100:00100000:3.0:1787858041.213610:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188340480 00000100:00100000:3.0:1787858041.213670:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1787858041.213680:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188340480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858041.214504:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188340480:12345-0@lo:400:kworker.0 Request processed in 822us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858041.214512:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1787858041.214872:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188340608 00000100:00100000:0.0:1787858041.214879:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188340608 00000100:00100000:0.0:1787858041.214933:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1787858041.214942:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188340608:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787858041.215045:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787858041.215050:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787858041.215137:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188340608:0@lo:400:kworker.0 00000100:00100000:0.0:1787858041.215144:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188340608:12345-0@lo:400:kworker.0 Request processed in 203us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858041.215151:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1787858041.215297:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188340480:0@lo:400:kworker.0 00010000:00010000:2.0:1787858041.583447:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858041.710181:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858041.710206:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188340736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858041.710296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858041.710395:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188340736 00000100:00100000:3.0:1787858041.710404:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188340736 00000100:00100000:3.0:1787858041.710468:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787858041.710478:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188340736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787858041.710516:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858041.710564:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188340736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858041.710572:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787858041.710623:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188340736:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787858042.228294:0:26118:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858042.228304:0:26118:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858042.233954:0:26118:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858042.233975:0:26118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858042.606142:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858043.056331:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858043.056343:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858043.057148:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858043.057161:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858043.482458:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858043.482502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858043.482532:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171936384 00000100:00100000:0.0:1787858043.482541:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171936384 00000100:00100000:0.0:1787858043.482604:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 697 00000100:00100000:0.0:1787858043.482615:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171936384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858043.482695:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171936384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858043.482704:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 697 00000100:00080000:0.0:1787858043.482726:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787858043.482753:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858043.482889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858043.482910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858043.482931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858043.482951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858043.482971:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171936640 00000100:00100000:0.0:1787858043.482975:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171936640 00000100:00100000:0.0:1787858043.483003:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171936256 00000100:00100000:0.0:1787858043.483006:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171936256 00000100:00100000:0.0:1787858043.483023:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171936768 00000100:00100000:0.0:1787858043.483026:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171936768 00000100:00100000:0.0:1787858043.483045:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 698 00000100:00100000:0.0:1787858043.483051:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171936640:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858043.483084:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171936640:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858043.483091:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 698 00000100:00100000:0.0:1787858043.483103:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 699 00000100:00100000:0.0:1787858043.483109:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171936256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858043.483133:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171936256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858043.483141:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 699 00000100:00100000:0.0:1787858043.483152:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 700 00000100:00100000:0.0:1787858043.483158:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171936768:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858043.483180:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171936768:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858043.483186:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 700 00000100:00100000:0.0:1787858043.483208:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171936128 00000100:00100000:0.0:1787858043.483212:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171936128 00000100:00100000:0.0:1787858043.483241:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171936512 00000100:00100000:0.0:1787858043.483244:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171936512 00000100:00100000:0.0:1787858043.483266:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 650 00000100:00100000:0.0:1787858043.483273:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171936128:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858043.483303:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171936128:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858043.483310:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 650 00000100:00100000:0.0:1787858043.483321:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 651 00000100:00100000:0.0:1787858043.483327:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171936512:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858043.483349:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171936512:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858043.483356:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 651 00000100:00080000:0.0:1787858043.483373:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787858043.483376:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787858043.483378:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858043.483706:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171936000 00000100:00100000:1.0:1787858043.483712:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171936000 00000100:00100000:1.0:1787858043.483749:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 680 00000100:00100000:1.0:1787858043.483769:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171936000:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858043.483808:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171936000:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 51us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858043.483833:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 680 00010000:00010000:0.0:1787858043.630125:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858044.334213:0:26169:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858044.334226:0:26169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858044.334746:0:26169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858044.334762:0:26169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858044.665337:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858044.783077:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188340864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787858044.783171:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858044.783344:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188340864 00000100:00100000:3.0:1787858044.783354:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188340864 00000100:00100000:3.0:1787858044.783434:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787858044.783444:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188340864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858044.783488:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858044.783547:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188340864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858044.783555:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787858044.783612:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188340864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787858044.784023:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787858045.680378:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858046.318023:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188341120:0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.318095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858046.318141:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901252580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188341632:0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.318168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858046.318200:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858046.318206:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188341248:0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.318229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858046.318270:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188341120 00000100:00100000:3.0:1787858046.318279:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188341120 00000100:00100000:3.0:1787858046.318335:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188341248 00000100:00100000:3.0:1787858046.318339:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188341248 00000100:00100000:3.0:1787858046.318388:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1787858046.318397:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188341120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.318452:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188341120:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858046.318459:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1787858046.318476:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1787858046.318482:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188341248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.318509:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188341248:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858046.318514:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1787858046.318532:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188341632 00000100:00100000:3.0:1787858046.318536:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188341632 00000100:00100000:3.0:1787858046.318565:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1787858046.318572:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188341632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.318601:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188341632:12345-0@lo:400:kworker.0 Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858046.318608:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00080000:3.0:1787858046.318629:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787858046.318633:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858046.318677:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188341248:0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.318689:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188341120:0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.318700:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901252580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188341632:0@lo:400:kworker.0 00000100:00100000:1.0:1787858046.318856:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188341376:0@lo:400:kworker.0 00000100:00100000:1.0:1787858046.318893:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858046.318916:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787858046.318922:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188340992:0@lo:400:kworker.0 00000100:00100000:1.0:1787858046.318950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858046.318974:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188341504:0@lo:400:kworker.0 00000100:00100000:1.0:1787858046.318995:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858046.319021:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188340992 00000100:00100000:1.0:1787858046.319025:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188340992 00000100:00100000:1.0:1787858046.319053:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1787858046.319059:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188340992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858046.319096:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188340992:12345-0@lo:400:kworker.0 Request processed in 37us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858046.319103:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1787858046.319142:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188340992:0@lo:400:kworker.0 00000100:00100000:2.0:1787858046.319235:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188341504 00000100:00100000:2.0:1787858046.319240:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188341504 00000100:00100000:2.0:1787858046.319283:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1787858046.319291:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188341504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858046.319333:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188341504:12345-0@lo:400:kworker.0 Request processed in 43us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858046.319339:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1787858046.319650:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901250f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188341504:0@lo:400:kworker.0 00000100:00080000:1.0:1787858046.319746:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858046.320020:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188341376 00000100:00100000:3.0:1787858046.320026:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188341376 00000100:00100000:3.0:1787858046.320081:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1787858046.320088:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188341376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858046.320142:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188341376:12345-0@lo:400:kworker.0 Request processed in 54us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858046.320149:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1787858046.320186:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901253840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188341376:0@lo:400:kworker.0 00000100:00080000:1.0:1787858046.320248:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787858046.509631:0:26221:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858046.509643:0:26221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858046.511570:0:26221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858046.511587:0:26221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787858046.702042:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858046.830078:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188341760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858046.830163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858046.830768:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188341760 00000100:00100000:1.0:1787858046.830778:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188341760 00000100:00100000:1.0:1787858046.830869:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787858046.830879:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188341760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787858046.830919:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858046.833352:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188341760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2453us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858046.833368:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787858046.833439:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188341760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787858047.729245:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787858048.538354:0:26272:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858048.538363:0:26272:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858048.541993:0:26272:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858048.542516:0:26272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858048.602714:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858048.602762:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858048.602789:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858048.602808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858048.602858:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858048.602877:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858048.602914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858048.602938:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171937152 00000100:00100000:1.0:1787858048.602947:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171937152 00000100:00100000:1.0:1787858048.602994:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171937664 00000100:00100000:1.0:1787858048.603009:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171937664 00000100:00100000:1.0:1787858048.603031:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171937280 00000100:00100000:1.0:1787858048.603033:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171937280 00000100:00100000:1.0:1787858048.603046:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171937536 00000100:00100000:1.0:1787858048.603049:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171937536 00000100:00100000:1.0:1787858048.603065:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 703 00000100:00100000:1.0:1787858048.603075:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171937152:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858048.603148:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171937152:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 74us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858048.603156:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 703 00000100:00100000:1.0:1787858048.603174:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 704 00000100:00100000:1.0:1787858048.603180:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171937664:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858048.603205:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171937664:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858048.603211:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 704 00000100:00100000:1.0:1787858048.603222:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 705 00000100:00100000:1.0:1787858048.603228:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171937280:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858048.603252:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171937280:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858048.603258:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 705 00000100:00100000:1.0:1787858048.603268:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 706 00000100:00100000:1.0:1787858048.603273:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171937536:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858048.603295:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171937536:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858048.603312:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 706 00000100:00080000:1.0:1787858048.603333:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787858048.603337:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858048.605075:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171936896 00000100:00100000:3.0:1787858048.605090:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171936896 00000100:00100000:3.0:1787858048.605179:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 682 00000100:00100000:3.0:1787858048.605189:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171936896:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858048.605260:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171936896:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 73us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858048.605268:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 682 00000100:00100000:3.0:1787858048.605319:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171937408 00000100:00100000:3.0:1787858048.605323:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171937408 00000100:00100000:3.0:1787858048.605363:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171937024 00000100:00100000:3.0:1787858048.605366:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171937024 00000100:00100000:3.0:1787858048.605391:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 655 00000100:00100000:3.0:1787858048.605398:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171937408:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858048.605430:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171937408:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (2639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858048.605436:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 655 00000100:00100000:3.0:1787858048.605449:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 656 00000100:00100000:3.0:1787858048.605456:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171937024:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858048.605479:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171937024:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (2621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858048.605487:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 656 00000100:00080000:3.0:1787858048.605659:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787858048.750953:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787858049.774133:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858049.905384:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787858049.905412:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901252580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188341888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787858049.905494:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858049.905596:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188341888 00000100:00100000:3.0:1787858049.905603:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188341888 00000100:00100000:3.0:1787858049.905660:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787858049.905670:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188341888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858049.905710:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858049.905760:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188341888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858049.905769:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:3.0:1787858049.905791:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858049.905865:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901252580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188341888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787858050.807417:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858050.842423:0:26323:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858050.842434:0:26323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858050.844522:0:26323:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858050.846932:0:26323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858051.440432:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787858051.440566:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188342144:0@lo:400:kworker.0 00000100:00100000:3.0:1787858051.440646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858051.440723:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858051.440730:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188342272:0@lo:400:kworker.0 00000100:00100000:3.0:1787858051.440765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858051.440803:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188342144 00000100:00100000:3.0:1787858051.440811:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188342144 00000100:00100000:3.0:1787858051.440894:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188342272 00000100:00100000:3.0:1787858051.440897:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188342272 00000100:00100000:3.0:1787858051.440927:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1787858051.440935:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188342144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858051.441000:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901252580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188342144:12345-0@lo:400:kworker.0 Request processed in 65us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858051.441008:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1787858051.441024:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1787858051.441030:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188342272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858051.441055:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188342272:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858051.441061:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00080000:3.0:1787858051.441084:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858051.441115:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188342272:0@lo:400:kworker.0 00000100:00100000:3.0:1787858051.441125:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188342144:0@lo:400:kworker.0 00000100:00100000:2.0:1787858051.449600:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787858051.449623:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188342656:0@lo:400:kworker.0 00000100:00100000:2.0:1787858051.449715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858051.449793:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188342656 00000100:00100000:2.0:1787858051.449800:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188342656 00000100:00100000:2.0:1787858051.449899:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1787858051.449910:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188342656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858051.449980:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188342656:12345-0@lo:400:kworker.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858051.449988:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1787858051.450045:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188342656:0@lo:400:kworker.0 00000100:00100000:3.0:1787858051.450583:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999015883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188342528:0@lo:400:kworker.0 00000100:00100000:3.0:1787858051.450627:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787858051.450681:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787858051.450851:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188342400:0@lo:400:kworker.0 00000100:00100000:1.0:1787858051.450885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858051.450914:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188342016:0@lo:400:kworker.0 00000100:00100000:1.0:1787858051.450946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858051.451038:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188342400 00000100:00100000:0.0:1787858051.451043:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188342400 00000100:00100000:0.0:1787858051.451094:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1787858051.451103:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188342400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858051.451153:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188342400:12345-0@lo:400:kworker.0 Request processed in 52us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858051.451168:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1787858051.451328:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188342528 00000100:00100000:2.0:1787858051.451333:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188342528 00000100:00100000:2.0:1787858051.451384:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1787858051.451391:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188342528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858051.451431:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188342528:12345-0@lo:400:kworker.0 Request processed in 40us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858051.451437:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1787858051.451506:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188342016 00000100:00100000:3.0:1787858051.451511:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188342016 00000100:00100000:3.0:1787858051.451553:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1787858051.451560:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188342016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858051.451595:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188342016:12345-0@lo:400:kworker.0 Request processed in 36us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858051.451601:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1787858051.451658:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999015883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188342528:0@lo:400:kworker.0 00000100:00080000:1.0:1787858051.451849:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858051.451854:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858051.451877:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188342400:0@lo:400:kworker.0 00000100:00100000:1.0:1787858051.451886:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999015892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188342016:0@lo:400:kworker.0 00010000:00010000:0.0:1787858051.822814:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858051.950524:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188342784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787858051.950598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858051.950812:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188342784 00000100:00100000:2.0:1787858051.950853:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188342784 00000100:00100000:2.0:1787858051.950948:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787858051.950958:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188342784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787858051.950994:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787858051.951050:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188342784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858051.951059:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787858051.951139:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901588780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188342784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787858052.846201:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858053.039343:0:26374:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858053.039353:0:26374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858053.041138:0:26374:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858053.041155:0:26374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787858053.300284:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858053.300294:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858053.300951:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858053.300961:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858053.719537:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858053.719599:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858053.721081:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171937792 00000100:00100000:2.0:1787858053.721097:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171937792 00000100:00100000:2.0:1787858053.721245:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 684 00000100:00100000:2.0:1787858053.721257:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171937792:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858053.721381:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171937792:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 126us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858053.721389:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 684 00000100:00100000:3.0:1787858053.731370:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171937920 00000100:00100000:3.0:1787858053.731389:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171937920 00000100:00080000:1.0:1787858053.731527:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858053.731791:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858053.731863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858053.731887:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858053.731928:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171938048 00000100:00100000:1.0:1787858053.731935:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171938048 00000100:00100000:1.0:1787858053.731977:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171938176 00000100:00100000:1.0:1787858053.731981:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171938176 00000100:00100000:1.0:1787858053.732011:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 709 00000100:00100000:1.0:1787858053.732142:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171938048:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858053.732879:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171938048:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 855us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858053.732892:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 709 00000100:00100000:1.0:1787858053.732922:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 710 00000100:00100000:1.0:1787858053.732933:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171938176:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858053.732968:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171938176:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858053.732978:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 710 00000100:00080000:1.0:1787858053.733009:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787858053.733013:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787858053.736869:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858053.736903:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858053.737183:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171938432 00000100:00100000:1.0:1787858053.737198:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171938432 00000100:00100000:1.0:1787858053.737271:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171938560 00000100:00100000:1.0:1787858053.737274:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171938560 00000100:00100000:1.0:1787858053.737299:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 711 00000100:00100000:1.0:1787858053.737309:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171938432:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858053.737387:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171938432:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 78us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858053.737396:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 711 00000100:00100000:1.0:1787858053.737420:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 712 00000100:00100000:1.0:1787858053.737428:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171938560:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858053.737456:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990158b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171938560:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858053.737462:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 712 00000100:00100000:3.0:1787858053.737465:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171938304 00000100:00100000:3.0:1787858053.737472:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171938304 00000100:00080000:1.0:1787858053.737485:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787858053.737491:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858053.737494:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858053.737517:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 660 00000100:00100000:3.0:1787858053.737528:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171937920:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858053.737562:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171937920:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (17962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858053.737568:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 660 00000100:00100000:3.0:1787858053.737581:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 661 00000100:00100000:3.0:1787858053.737587:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171938304:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858053.737609:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999015883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171938304:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (5721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858053.737616:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 661 00010000:00010000:0.0:1787858053.870138:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787858054.894217:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858055.023012:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858055.023037:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188342912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858055.023112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858055.023735:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188342912 00000100:00100000:3.0:1787858055.023745:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188342912 00000100:00100000:3.0:1787858055.023970:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787858055.023981:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188342912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858055.024035:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858055.024099:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188342912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858055.024107:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787858055.024970:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188342912:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787858055.025366:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787858055.134850:0:26426:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858055.134859:0:26426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858055.136058:0:26426:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858055.136075:0:26426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858055.920261:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858056.559191:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188343168:0@lo:400:kworker.0 00000100:00100000:2.0:1787858056.559285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858056.559343:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188343680:0@lo:400:kworker.0 00000100:00100000:2.0:1787858056.559370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858056.559400:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787858056.559407:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188343296:0@lo:400:kworker.0 00000100:00100000:2.0:1787858056.559431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858056.559487:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188343168 00000100:00100000:2.0:1787858056.559495:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188343168 00000100:00100000:2.0:1787858056.559543:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188343296 00000100:00100000:2.0:1787858056.559546:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188343296 00000100:00100000:2.0:1787858056.559579:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1787858056.559588:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188343168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858056.559641:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188343168:12345-0@lo:400:kworker.0 Request processed in 54us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858056.559649:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1787858056.559664:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1787858056.559670:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188343296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858056.559696:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188343296:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858056.559701:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00080000:2.0:1787858056.559723:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858056.559753:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188343296:0@lo:400:kworker.0 00000100:00100000:2.0:1787858056.559764:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188343168:0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.560467:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188343424:0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.560515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858056.560552:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787858056.560560:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188343040:0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.560591:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858056.560622:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188343552:0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.560648:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858056.560680:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188343680 00000100:00100000:1.0:1787858056.560687:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188343680 00000100:00100000:1.0:1787858056.560740:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188343424 00000100:00100000:1.0:1787858056.560744:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188343424 00000100:00100000:1.0:1787858056.560766:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1787858056.560774:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188343680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.560838:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188343680:12345-0@lo:400:kworker.0 Request processed in 65us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858056.561033:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1787858056.561054:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1787858056.561061:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188343424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.561102:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188343424:12345-0@lo:400:kworker.0 Request processed in 41us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858056.561509:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1787858056.561536:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188343040 00000100:00100000:1.0:1787858056.561541:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188343040 00000100:00100000:1.0:1787858056.561571:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1787858056.561577:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188343040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.561612:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188343040:12345-0@lo:400:kworker.0 Request processed in 36us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858056.561619:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1787858056.561650:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188343552 00000100:00100000:1.0:1787858056.561654:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188343552 00000100:00100000:1.0:1787858056.561690:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1787858056.561697:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188343552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.561727:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188343552:12345-0@lo:400:kworker.0 Request processed in 31us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858056.561732:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00080000:1.0:1787858056.561757:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858056.561762:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787858056.562064:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188343680:0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.566048:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c1d42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188343040:0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.566098:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188343552:0@lo:400:kworker.0 00000100:00100000:1.0:1787858056.566112:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188343424:0@lo:400:kworker.0 00010000:00010000:1.0:1787858056.942051:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858057.072214:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188343808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858057.072295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858057.072420:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188343808 00000100:00100000:2.0:1787858057.072429:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188343808 00000100:00100000:2.0:1787858057.072589:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787858057.072604:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188343808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787858057.072669:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787858057.072803:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999012521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188343808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858057.072812:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787858057.078782:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188343808:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787858057.233928:0:26477:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858057.233938:0:26477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858057.234498:0:26477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858057.234508:0:26477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858057.966383:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858058.832759:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858058.832853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858058.832880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858058.832901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858058.832919:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858058.832937:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858058.832957:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858058.832982:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171939072 00000100:00100000:1.0:1787858058.832992:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171939072 00000100:00100000:1.0:1787858058.833047:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171939328 00000100:00100000:1.0:1787858058.833050:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171939328 00000100:00100000:1.0:1787858058.833069:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171938944 00000100:00100000:1.0:1787858058.833071:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171938944 00000100:00100000:1.0:1787858058.833082:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171939456 00000100:00100000:1.0:1787858058.833085:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171939456 00000100:00100000:1.0:1787858058.833098:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 715 00000100:00100000:1.0:1787858058.833121:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171939072:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858058.833198:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171939072:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 78us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858058.833206:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 715 00000100:00100000:1.0:1787858058.833420:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 716 00000100:00100000:1.0:1787858058.833428:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171939328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858058.833455:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171939328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858058.833462:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 716 00000100:00100000:1.0:1787858058.833473:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 717 00000100:00100000:1.0:1787858058.833478:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171938944:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858058.833499:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171938944:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858058.833504:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 717 00000100:00100000:1.0:1787858058.833515:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 718 00000100:00100000:1.0:1787858058.833521:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171939456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858058.833540:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171939456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 19us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858058.833546:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 718 00000100:00100000:1.0:1787858058.833569:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171938688 00000100:00100000:1.0:1787858058.833572:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171938688 00000100:00100000:1.0:1787858058.833597:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 686 00000100:00100000:1.0:1787858058.833603:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171938688:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858058.833626:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171938688:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858058.833631:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 686 00000100:00100000:1.0:1787858058.833657:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171938816 00000100:00100000:1.0:1787858058.833660:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171938816 00000100:00100000:1.0:1787858058.833690:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171939200 00000100:00100000:1.0:1787858058.833693:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171939200 00000100:00100000:1.0:1787858058.833712:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 665 00000100:00100000:1.0:1787858058.833717:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171938816:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858058.833745:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c26e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171938816:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858058.833751:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 665 00000100:00100000:1.0:1787858058.833762:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 666 00000100:00100000:1.0:1787858058.833768:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171939200:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858058.833790:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171939200:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858058.833796:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 666 00000100:00080000:1.0:1787858058.833842:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858058.833847:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787858058.833849:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787858058.989927:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858059.487340:0:26528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858059.487351:0:26528:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858059.491941:0:26528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858059.491985:0:26528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858060.014210:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858060.142306:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787858060.151589:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188343936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787858060.151692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858060.152762:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188343936 00000100:00100000:2.0:1787858060.152785:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188343936 00000100:00100000:2.0:1787858060.152898:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787858060.152909:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188343936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787858060.152950:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:1.0:1787858060.153143:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787858060.153378:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188343936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 471us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858060.153387:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787858060.154468:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188343936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787858061.044305:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858061.681002:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188344064:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681097:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858061.681148:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188344576:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681174:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858061.681197:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858061.681202:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188344448:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858061.681249:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188344192:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858061.681290:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188344704:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858061.681328:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787858061.681332:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188344320:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858061.681399:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188344064 00000100:00100000:2.0:1787858061.681406:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188344064 00000100:00100000:2.0:1787858061.681461:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1787858061.681470:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188344064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681532:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188344064:12345-0@lo:400:kworker.0 Request processed in 62us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858061.681539:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1787858061.681575:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188344576 00000100:00100000:2.0:1787858061.681579:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188344576 00000100:00100000:2.0:1787858061.681617:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188344192 00000100:00100000:2.0:1787858061.681620:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188344192 00000100:00100000:2.0:1787858061.681638:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188344320 00000100:00100000:2.0:1787858061.681640:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188344320 00000100:00100000:2.0:1787858061.681656:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1787858061.681662:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188344576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681693:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188344576:12345-0@lo:400:kworker.0 Request processed in 31us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858061.681699:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1787858061.681709:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1787858061.681714:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188344192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681741:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188344192:12345-0@lo:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858061.681746:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1787858061.681757:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1787858061.681762:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188344320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681785:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188344320:12345-0@lo:400:kworker.0 Request processed in 23us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858061.681790:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1787858061.681805:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188344448 00000100:00100000:2.0:1787858061.681808:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188344448 00000100:00100000:2.0:1787858061.681847:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188344704 00000100:00100000:2.0:1787858061.681850:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188344704 00000100:00100000:2.0:1787858061.681868:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1787858061.681873:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188344448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681897:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188344448:12345-0@lo:400:kworker.0 Request processed in 25us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858061.681903:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1787858061.681912:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1787858061.681917:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188344704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.681936:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188344704:12345-0@lo:400:kworker.0 Request processed in 19us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858061.681941:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00080000:2.0:1787858061.681966:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858061.681971:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858061.682010:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188344320:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.682019:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188344192:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.682026:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188344704:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.682060:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188344448:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.682068:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188344064:0@lo:400:kworker.0 00000100:00100000:2.0:1787858061.682076:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188344576:0@lo:400:kworker.0 00000040:00080000:1.0:1787858061.797956:0:26580:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858061.797969:0:26580:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858061.798515:0:26580:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858061.798531:0:26580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858062.064802:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858062.190995:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858062.191031:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188344832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858062.191124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858062.192459:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188344832 00000100:00100000:2.0:1787858062.192493:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188344832 00000100:00100000:2.0:1787858062.192569:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787858062.192580:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188344832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787858062.192625:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787858062.192721:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188344832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858062.192728:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787858062.192901:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188344832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787858063.085961:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858063.543285:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858063.543298:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858063.543900:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858063.543911:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787858063.801459:0:26631:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858063.801469:0:26631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858063.803615:0:26631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858063.803635:0:26631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858063.952238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858063.952329:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858063.952371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858063.952398:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858063.952417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858063.952437:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858063.952464:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858063.952493:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171940096 00000100:00100000:1.0:1787858063.952503:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171940096 00000100:00100000:1.0:1787858063.952569:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171939712 00000100:00100000:1.0:1787858063.952573:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171939712 00000100:00100000:1.0:1787858063.952596:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 670 00000100:00100000:1.0:1787858063.952606:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171940096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858063.952687:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171940096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858063.952694:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 670 00000100:00100000:1.0:1787858063.952726:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 671 00000100:00100000:1.0:1787858063.952732:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171939712:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858063.952757:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171939712:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858063.952762:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 671 00000100:00100000:1.0:1787858063.952782:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171939840 00000100:00100000:1.0:1787858063.952785:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171939840 00000100:00100000:1.0:1787858063.952810:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171940352 00000100:00100000:1.0:1787858063.952842:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171940352 00000100:00100000:1.0:1787858063.952863:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171939968 00000100:00100000:1.0:1787858063.952865:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171939968 00000100:00100000:1.0:1787858063.952878:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171940224 00000100:00100000:1.0:1787858063.952880:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171940224 00000100:00100000:1.0:1787858063.952892:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 721 00000100:00100000:1.0:1787858063.952897:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171939840:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858063.952922:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171939840:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858063.952928:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 721 00000100:00100000:1.0:1787858063.952951:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 722 00000100:00100000:1.0:1787858063.952958:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171940352:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858063.952981:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171940352:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858063.952987:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 722 00000100:00100000:1.0:1787858063.952998:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 723 00000100:00100000:1.0:1787858063.953014:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171939968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858063.953037:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171939968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 34us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858063.953043:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 723 00000100:00100000:1.0:1787858063.953053:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 724 00000100:00100000:1.0:1787858063.953059:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171940224:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858063.953080:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171940224:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858063.953087:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 724 00000100:00080000:1.0:1787858063.953115:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787858063.953119:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787858063.953122:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858063.964902:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171939584 00000100:00100000:3.0:1787858063.964916:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171939584 00000100:00100000:3.0:1787858063.965096:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 688 00000100:00100000:3.0:1787858063.965108:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171939584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858063.965188:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171939584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 82us (12961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858063.965195:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 688 00010000:00010000:3.0:1787858064.110035:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787858065.137128:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858065.262035:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787858065.262064:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188344960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787858065.262158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858065.262234:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188344960 00000100:00100000:3.0:1787858065.262242:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188344960 00000100:00100000:3.0:1787858065.262308:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787858065.262319:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188344960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858065.262363:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858065.262417:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188344960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858065.262425:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:3.0:1787858065.262447:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858065.262488:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188344960:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787858065.872678:0:26682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858065.872690:0:26682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858065.873538:0:26682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858065.873555:0:26682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858066.157945:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858066.798173:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188345344:0@lo:400:kworker.0 00000100:00100000:0.0:1787858066.798260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858066.798337:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787858066.798343:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188345216:0@lo:400:kworker.0 00000100:00100000:0.0:1787858066.798368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858066.798386:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188345728:0@lo:400:kworker.0 00000100:00100000:0.0:1787858066.798410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858066.798445:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188345344 00000100:00100000:0.0:1787858066.798452:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188345344 00000100:00100000:0.0:1787858066.798508:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188345216 00000100:00100000:0.0:1787858066.798511:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188345216 00000100:00100000:0.0:1787858066.798528:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1787858066.798536:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188345344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858066.798587:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188345344:12345-0@lo:400:kworker.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858066.798595:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1787858066.798612:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1787858066.798618:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188345216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858066.798645:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188345216:12345-0@lo:400:kworker.0 Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858066.798663:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1787858066.798685:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188345728 00000100:00100000:0.0:1787858066.798689:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188345728 00000100:00100000:0.0:1787858066.798716:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1787858066.798875:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188345088:0@lo:400:kworker.0 00000100:00100000:3.0:1787858066.798915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858066.798939:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188345600:0@lo:400:kworker.0 00000100:00100000:3.0:1787858066.798972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858066.798993:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787858066.798998:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188345472:0@lo:400:kworker.0 00000100:00100000:3.0:1787858066.799019:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787858066.799066:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787858066.799071:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858066.799104:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188345216:0@lo:400:kworker.0 00000100:00100000:3.0:1787858066.799117:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188345344:0@lo:400:kworker.0 00000100:00100000:1.0:1787858066.799424:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188345600 00000100:00100000:1.0:1787858066.799430:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188345600 00000100:00100000:1.0:1787858066.799482:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1787858066.799490:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188345600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858066.799538:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188345600:12345-0@lo:400:kworker.0 Request processed in 50us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858066.799544:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1787858066.799567:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188345472 00000100:00100000:1.0:1787858066.799570:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188345472 00000100:00100000:1.0:1787858066.799592:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1787858066.799599:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188345472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787858066.799731:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858066.799792:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188345472:0@lo:400:kworker.0 00000100:00100000:3.0:1787858066.799801:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188345600:0@lo:400:kworker.0 00000100:00100000:1.0:1787858066.800046:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188345472:12345-0@lo:400:kworker.0 Request processed in 47us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858066.800053:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1787858066.800139:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188345088 00000100:00100000:2.0:1787858066.800144:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188345088 00000100:00100000:2.0:1787858066.800183:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1787858066.800191:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188345088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858066.800241:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188345088:12345-0@lo:400:kworker.0 Request processed in 52us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858066.800247:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1787858066.801009:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188345728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858066.801073:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188345728:12345-0@lo:400:kworker.0 Request processed in 2350us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858066.801081:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1787858066.801148:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188345088:0@lo:400:kworker.0 00000100:00100000:3.0:1787858066.801238:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188345728:0@lo:400:kworker.0 00010000:00010000:1.0:1787858067.182645:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858067.312149:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999900d4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188345856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858067.312223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858067.312342:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188345856 00000100:00100000:0.0:1787858067.312351:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188345856 00000100:00100000:0.0:1787858067.312409:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787858067.312419:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188345856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787858067.312472:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858067.314848:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188345856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2418us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858067.314864:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787858067.316511:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999900d4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188345856:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787858067.770374:0:26733:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858067.770386:0:26733:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858067.774191:0:26733:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858067.774216:0:26733:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858068.206300:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858069.072940:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858069.074213:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858069.074249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858069.074288:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858069.074306:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858069.074334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858069.074394:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171940864 00000100:00100000:3.0:1787858069.074404:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171940864 00000100:00100000:3.0:1787858069.074465:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171941120 00000100:00100000:3.0:1787858069.074469:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171941120 00000100:00100000:3.0:1787858069.074485:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171940736 00000100:00100000:3.0:1787858069.074487:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171940736 00000100:00100000:3.0:1787858069.074512:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 727 00000100:00100000:3.0:1787858069.074521:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171940864:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858069.074597:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171940864:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 77us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858069.074604:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 727 00000100:00100000:3.0:1787858069.074622:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 728 00000100:00100000:3.0:1787858069.074627:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171941120:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858069.074650:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171941120:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858069.074655:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 728 00000100:00100000:3.0:1787858069.074665:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 729 00000100:00100000:3.0:1787858069.074671:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171940736:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858069.074691:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171940736:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858069.074696:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 729 00000100:00080000:3.0:1787858069.074714:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787858069.074718:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787858069.074812:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171940480 00000100:00100000:1.0:1787858069.074848:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171940480 00000100:00100000:1.0:1787858069.074878:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 690 00000100:00100000:1.0:1787858069.074885:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171940480:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858069.074930:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171940480:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 45us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858069.074936:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 690 00000100:00100000:2.0:1787858069.077390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858069.077532:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171940608 00000100:00100000:0.0:1787858069.077541:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171940608 00000100:00100000:0.0:1787858069.077664:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171940992 00000100:00100000:0.0:1787858069.077668:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171940992 00000100:00100000:3.0:1787858069.077695:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171941248 00000100:00100000:3.0:1787858069.077698:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171941248 00000100:00080000:2.0:1787858069.077964:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858069.077970:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787858069.078029:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 675 00000100:00100000:1.0:1787858069.078042:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171940608:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858069.078135:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2348:x1874704171940608:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 96us (5205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858069.078143:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 675 00000100:00100000:0.0:1787858069.078630:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 676 00000100:00100000:0.0:1787858069.078640:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171940992:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858069.078680:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2348:x1874704171940992:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 42us (4344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858069.078688:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 676 00000100:00100000:3.0:1787858069.080109:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 730 00000100:00100000:3.0:1787858069.080125:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171941248:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858069.080490:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171941248:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 369us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858069.080498:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 730 00010000:00010000:0.0:1787858069.230064:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787858069.692176:0:26785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858069.692186:0:26785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858069.693302:0:26785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858069.693315:0:26785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858070.256073:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858070.382109:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188345984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858070.382287:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858070.382621:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188345984 00000100:00100000:0.0:1787858070.382632:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188345984 00000100:00100000:0.0:1787858070.382712:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787858070.382723:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188345984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787858070.382763:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:1.0:1787858070.382956:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858070.384120:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188345984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1392us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858070.384133:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787858070.386845:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188345984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787858071.277962:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858071.724361:0:26836:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858071.724372:0:26836:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858071.725365:0:26836:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858071.725377:0:26836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787858071.918777:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188346496:0@lo:400:kworker.0 00000100:00100000:2.0:1787858071.918927:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858071.919021:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188346496 00000100:00100000:2.0:1787858071.919022:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787858071.919032:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188346496 00000100:00100000:2.0:1787858071.919035:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188346112:0@lo:400:kworker.0 00000100:00100000:2.0:1787858071.919090:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858071.919098:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1787858071.919108:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188346496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858071.919135:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188346624:0@lo:400:kworker.0 00000100:00100000:3.0:1787858071.919163:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188346496:12345-0@lo:400:kworker.0 Request processed in 56us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858071.919171:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1787858071.919176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858071.919205:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188346112 00000100:00100000:3.0:1787858071.919208:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188346112 00000100:00100000:2.0:1787858071.919229:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188346496:0@lo:400:kworker.0 00000100:00100000:3.0:1787858071.919235:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1787858071.919244:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188346112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858071.919284:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188346112:12345-0@lo:400:kworker.0 Request processed in 41us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858071.919291:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1787858071.919303:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188346624 00000100:00100000:2.0:1787858071.919311:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188346624 00000100:00100000:2.0:1787858071.919387:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1787858071.919398:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188346624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858071.919451:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188346624:12345-0@lo:400:kworker.0 Request processed in 55us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858071.919459:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00080000:3.0:1787858071.919481:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858071.919492:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188346112:0@lo:400:kworker.0 00000100:00100000:2.0:1787858071.919502:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7019a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188346624:0@lo:400:kworker.0 00000100:00100000:1.0:1787858071.919959:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998e185ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188346240:0@lo:400:kworker.0 00000100:00100000:1.0:1787858071.919997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858071.920021:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188346752:0@lo:400:kworker.0 00000100:00100000:1.0:1787858071.920042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858071.920073:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787858071.920080:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188346368:0@lo:400:kworker.0 00000100:00100000:1.0:1787858071.920101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858071.920124:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188346752 00000100:00100000:3.0:1787858071.920130:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188346752 00000100:00100000:1.0:1787858071.920145:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188346240 00000100:00100000:1.0:1787858071.920150:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188346240 00000100:00100000:3.0:1787858071.920177:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1787858071.920185:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188346368 00000100:00100000:3.0:1787858071.920187:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188346752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858071.920190:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188346368 00000100:00100000:1.0:1787858071.920219:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1787858071.920227:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188346240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858071.920236:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188346752:12345-0@lo:400:kworker.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858071.920244:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00080000:3.0:1787858071.920263:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787858071.920267:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787858071.920269:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188346240:12345-0@lo:400:kworker.0 Request processed in 42us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858071.920277:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1787858071.920290:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1787858071.920296:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188346368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858071.920320:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188346368:12345-0@lo:400:kworker.0 Request processed in 25us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858071.920325:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1787858071.920364:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188346368:0@lo:400:kworker.0 00000100:00100000:1.0:1787858071.920373:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998e185ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188346240:0@lo:400:kworker.0 00000100:00100000:1.0:1787858071.920381:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188346752:0@lo:400:kworker.0 00010000:00010000:3.0:1787858072.303570:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858072.430348:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188346880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787858072.430433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858072.434298:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188346880 00000100:00100000:0.0:1787858072.434317:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188346880 00000100:00100000:0.0:1787858072.434463:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787858072.434476:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188346880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787858072.434524:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858072.434624:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188346880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (4190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858072.434632:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787858072.434727:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5c6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188346880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787858073.326075:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858073.673044:0:26887:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858073.673061:0:26887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858073.673604:0:26887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858073.673617:0:26887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787858073.776098:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858073.776112:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858073.778193:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858073.778213:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787858074.193765:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858074.193864:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858074.193893:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858074.193934:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858074.194171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858074.194539:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171941632 00000100:00100000:0.0:1787858074.194553:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171941632 00000100:00100000:0.0:1787858074.194631:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171941760 00000100:00100000:0.0:1787858074.194634:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171941760 00000100:00100000:0.0:1787858074.194655:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171942016 00000100:00100000:0.0:1787858074.194657:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171942016 00000100:00100000:0.0:1787858074.194688:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 733 00000100:00100000:0.0:1787858074.194701:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171941632:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858074.194891:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171941632:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 191us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858074.194899:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 733 00000100:00100000:0.0:1787858074.194922:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 734 00000100:00100000:0.0:1787858074.194929:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171941760:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858074.198449:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171941760:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 3421us (4416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858074.198478:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 734 00000100:00100000:0.0:1787858074.198559:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 735 00000100:00100000:0.0:1787858074.198581:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171942016:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858074.198674:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171942016:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 105us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858074.198680:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 735 00000100:00100000:1.0:1787858074.198854:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171941504 00000100:00100000:1.0:1787858074.198864:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171941504 00000100:00100000:1.0:1787858074.198921:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 680 00000100:00100000:1.0:1787858074.198928:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171941504:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858074.198981:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171941504:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 55us (5087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858074.198988:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 680 00000100:00080000:2.0:1787858074.199741:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787858074.199748:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858074.199751:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858074.200136:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171941376 00000100:00100000:3.0:1787858074.200143:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171941376 00000100:00100000:3.0:1787858074.200195:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 692 00000100:00100000:3.0:1787858074.200203:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171941376:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858074.200274:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171941376:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 71us (6522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858074.200282:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 692 00000100:00100000:2.0:1787858074.211657:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858074.211854:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171941888 00000100:00100000:1.0:1787858074.211865:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171941888 00000100:00100000:1.0:1787858074.211992:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 681 00000100:00100000:1.0:1787858074.212009:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171941888:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:3.0:1787858074.212230:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787858074.216215:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171941888:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 4192us (4561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858074.216233:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 681 00000100:00100000:2.0:1787858074.216460:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858074.216912:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171942144 00000100:00100000:3.0:1787858074.216925:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171942144 00000100:00100000:3.0:1787858074.217017:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 736 00000100:00100000:3.0:1787858074.217026:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171942144:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:1.0:1787858074.217136:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787858074.217535:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171942144:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 506us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858074.217543:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 736 00010000:00010000:1.0:1787858074.351574:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787858075.379639:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858075.502204:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787858075.502475:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188347008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787858075.502622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858075.504181:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188347008 00000100:00100000:2.0:1787858075.504193:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188347008 00000100:00100000:0.0:1787858075.504610:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787858075.504622:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188347008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787858075.504688:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858075.504774:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188347008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858075.504805:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787858075.505166:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188347008:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787858075.505473:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787858075.700041:0:26939:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858075.700054:0:26939:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858075.706810:0:26939:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858075.709584:0:26939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858076.398172:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858077.039031:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188347264:0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.039117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858077.039188:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188347776:0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.039222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858077.039260:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858077.039267:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188347392:0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.039294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858077.039334:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188347264 00000100:00100000:3.0:1787858077.039343:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188347264 00000100:00100000:3.0:1787858077.039398:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188347392 00000100:00100000:3.0:1787858077.039401:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188347392 00000100:00100000:3.0:1787858077.039439:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1787858077.039449:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188347264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.039511:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188347264:12345-0@lo:400:kworker.0 Request processed in 63us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858077.039518:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1787858077.039534:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1787858077.039541:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188347392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.039570:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188347392:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858077.039575:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1787858077.039592:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188347776 00000100:00100000:3.0:1787858077.039595:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188347776 00000100:00100000:3.0:1787858077.039627:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1787858077.039634:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188347776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.039665:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7019a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188347776:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858077.039671:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00080000:3.0:1787858077.039694:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787858077.039701:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858077.039744:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188347392:0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.039770:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188347264:0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.039784:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188347776:0@lo:400:kworker.0 00000100:00100000:0.0:1787858077.039913:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188347136:0@lo:400:kworker.0 00000100:00100000:0.0:1787858077.039953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858077.039995:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f701bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188347648:0@lo:400:kworker.0 00000100:00100000:0.0:1787858077.040022:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858077.040041:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787858077.040047:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188347520:0@lo:400:kworker.0 00000100:00100000:0.0:1787858077.040070:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858077.040104:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188347520 00000100:00100000:0.0:1787858077.040107:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188347520 00000100:00100000:0.0:1787858077.040142:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1787858077.040150:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188347520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858077.040192:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188347520:12345-0@lo:400:kworker.0 Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858077.040199:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1787858077.040960:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188347520:0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.040968:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188347136 00000100:00100000:3.0:1787858077.040974:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188347136 00000100:00080000:2.0:1787858077.040990:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858077.041009:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1787858077.041017:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188347136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858077.041071:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188347136:12345-0@lo:400:kworker.0 Request processed in 55us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858077.041078:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1787858077.041181:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188347648 00000100:00100000:1.0:1787858077.041186:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188347648 00000100:00100000:1.0:1787858077.041271:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1787858077.041280:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188347648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858077.041320:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188347648:12345-0@lo:400:kworker.0 Request processed in 42us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858077.041327:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00080000:3.0:1787858077.041426:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858077.041802:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188347136:0@lo:400:kworker.0 00000100:00100000:2.0:1787858077.041814:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f701bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188347648:0@lo:400:kworker.0 00010000:00010000:1.0:1787858077.425283:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858077.550041:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188347904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858077.550150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858077.550297:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188347904 00000100:00100000:1.0:1787858077.550308:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188347904 00000100:00100000:1.0:1787858077.550377:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787858077.550391:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188347904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787858077.550444:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858077.550500:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188347904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858077.550508:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787858077.550669:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188347904:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787858077.779098:0:26992:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858077.779110:0:26992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858077.780377:0:26992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858077.780402:0:26992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858078.446497:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858079.311877:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858079.311945:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858079.311983:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171942528 00000100:00100000:2.0:1787858079.311994:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171942528 00000100:00100000:2.0:1787858079.312057:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 739 00000100:00100000:2.0:1787858079.312069:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171942528:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858079.312156:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171942528:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858079.312164:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 739 00000100:00100000:3.0:1787858079.312490:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171942272 00000100:00100000:3.0:1787858079.312496:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171942272 00000100:00100000:3.0:1787858079.312527:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 694 00000100:00100000:3.0:1787858079.312535:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171942272:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858079.312581:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171942272:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 48us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858079.312589:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 694 00000100:00080000:3.0:1787858079.312623:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858079.314160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858079.314244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858079.314268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858079.314353:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171943040 00000100:00100000:2.0:1787858079.314362:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171943040 00000100:00100000:2.0:1787858079.314437:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 740 00000100:00100000:2.0:1787858079.314446:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171943040:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858079.314517:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171943040:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858079.314525:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 740 00000100:00080000:2.0:1787858079.314591:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787858079.319243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858079.319274:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1787858079.319300:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171942656 00000100:00100000:2.0:1787858079.319311:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171942656 00000100:00100000:2.0:1787858079.319383:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171942912 00000100:00100000:2.0:1787858079.319386:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171942912 00000100:00100000:2.0:1787858079.319542:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 741 00000100:00100000:2.0:1787858079.319554:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171942656:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858079.319639:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171942656:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 88us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858079.319647:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 741 00000100:00100000:2.0:1787858079.319664:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 742 00000100:00100000:2.0:1787858079.319671:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171942912:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858079.319696:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171942912:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858079.319702:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 742 00000100:00080000:2.0:1787858079.319733:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858079.319737:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787858079.321177:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171942784 00000100:00100000:1.0:1787858079.321185:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171942784 00000100:00100000:2.0:1787858079.321378:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171942400 00000100:00100000:2.0:1787858079.321383:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171942400 00000100:00100000:2.0:1787858079.321581:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 685 00000100:00100000:2.0:1787858079.321591:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171942784:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858079.321664:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171942784:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 75us (7514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858079.321673:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 685 00000100:00100000:2.0:1787858079.321732:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 686 00000100:00100000:2.0:1787858079.321738:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171942400:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858079.321770:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f701bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+108:2349:x1874704171942400:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (7501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858079.321776:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 686 00000100:00080000:0.0:1787858079.322749:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787858079.470605:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858079.941403:0:27043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858079.941412:0:27043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858079.943177:0:27043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858079.943196:0:27043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858080.494097:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858080.622967:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858080.623003:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188348032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858080.623112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858080.624391:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188348032 00000100:00100000:0.0:1787858080.624411:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188348032 00000100:00100000:0.0:1787858080.624492:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1787858080.624781:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858080.624907:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188348032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787858080.624950:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858080.625049:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188348032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 547us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858080.625057:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787858080.625222:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188348032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787858081.523084:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858082.085209:0:27094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858082.085222:0:27094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858082.088314:0:27094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858082.088340:0:27094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787858082.163388:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188348160:0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.163798:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787858082.163833:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188348288:0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.163916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858082.164037:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188348416:0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.164063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858082.164113:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188348544:0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.164143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858082.164186:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787858082.164192:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188348672:0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.164215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858082.164250:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787858082.164256:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188348800:0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.164279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858082.164566:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188348288 00000100:00100000:1.0:1787858082.164578:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188348288 00000100:00100000:1.0:1787858082.164647:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188348416 00000100:00100000:1.0:1787858082.164650:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188348416 00000100:00100000:1.0:1787858082.164696:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188348672 00000100:00100000:1.0:1787858082.164699:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188348672 00000100:00100000:1.0:1787858082.164724:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1787858082.164736:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188348288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858082.164810:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188348288:12345-0@lo:400:kworker.0 Request processed in 77us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858082.164843:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1787858082.164864:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1787858082.164871:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188348416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858082.164902:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188348416:12345-0@lo:400:kworker.0 Request processed in 33us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858082.164908:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1787858082.164918:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1787858082.164925:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188348672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858082.164959:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188348672:12345-0@lo:400:kworker.0 Request processed in 35us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858082.164967:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1787858082.165022:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188348416:0@lo:400:kworker.0 00000100:00100000:1.0:1787858082.165035:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188348288:0@lo:400:kworker.0 00000100:00100000:1.0:1787858082.165066:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188348672:0@lo:400:kworker.0 00000100:00100000:2.0:1787858082.169602:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188348544 00000100:00100000:2.0:1787858082.169623:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188348544 00000100:00100000:2.0:1787858082.169735:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188348800 00000100:00100000:2.0:1787858082.169740:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188348800 00000100:00100000:2.0:1787858082.169774:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1787858082.169787:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188348544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.170043:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1787858082.170054:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188348800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.170221:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188348800:12345-0@lo:400:kworker.0 Request processed in 168us (5938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858082.170228:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1787858082.170312:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188348544:12345-0@lo:400:kworker.0 Request processed in 529us (6168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858082.170319:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00080000:2.0:1787858082.170344:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858082.170349:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858082.170352:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858082.170392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858082.170421:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188348160 00000100:00100000:2.0:1787858082.170426:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188348160 00000100:00100000:2.0:1787858082.170453:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1787858082.170459:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188348160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858082.170490:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188348160:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858082.170496:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1787858082.170560:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188348160:0@lo:400:kworker.0 00000100:00100000:1.0:1787858082.170725:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188348800:0@lo:400:kworker.0 00000100:00100000:3.0:1787858082.174988:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188348544:0@lo:400:kworker.0 00010000:00010000:1.0:1787858082.544362:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858082.672807:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188348928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787858082.672946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858082.674132:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188348928 00000100:00100000:3.0:1787858082.674145:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188348928 00000100:00100000:3.0:1787858082.674230:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787858082.674242:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188348928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787858082.674297:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858082.674411:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188348928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858082.674419:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787858082.674942:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188348928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787858083.566113:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858084.016032:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858084.016043:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858084.016571:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858084.016588:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858084.180987:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858084.181072:0:17347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171943168 00000100:00100000:0.0:1787858084.181084:0:17347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171943168 00000100:00100000:0.0:1787858084.181181:0:17347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:0.0:1787858084.181195:0:17347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998d039a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+108:2347:x1874704171943168:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787858084.181213:0:17347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:0.0:1787858084.182711:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c0031200/0xd3f183cab4a793e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2b82 expref: 108 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.182753:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9998d8bfdf00) 00010000:00010000:0.0:1787858084.182796:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2e00/0xd3f183cab4a7919a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ada expref: 107 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787858084.183278:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787858084.183424:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9998c6b34a00) 00010000:00010000:0.0:1787858084.183459:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1c00/0xd3f183cab4a7910e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ab7 expref: 106 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183477:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2c00/0xd3f183cab4a78ffd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x51/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2a6a expref: 105 pid: 5856 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183489:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9998d8bfde00) 00010000:00010000:0.0:1787858084.183499:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5e00/0xd3f183cab4a78ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2a08 expref: 104 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183510:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff9998d8bfd900) 00010000:00010000:0.0:1787858084.183517:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0c00/0xd3f183cab4a78e2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd29e5 expref: 103 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183530:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3600/0xd3f183cab4a78ced lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd29a6 expref: 102 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183539:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9998c6b34600) 00010000:00010000:0.0:1787858084.183547:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2600/0xd3f183cab4a78cbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2998 expref: 101 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183556:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9998c6b34c00) 00010000:00010000:0.0:1787858084.183569:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2a00/0xd3f183cab4a78c53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2983 expref: 100 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183585:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9998c6b34100) 00010000:00010000:0.0:1787858084.183597:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b2400/0xd3f183cab4a78a15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd28db expref: 99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183608:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9998c53ae700) 00010000:00010000:0.0:1787858084.183627:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e2000/0xd3f183cab4a788b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2872 expref: 98 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183639:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9998c6b34200) 00010000:00010000:0.0:1787858084.183651:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1800/0xd3f183cab4a787bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd281e expref: 97 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183661:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9998d8797c00) 00010000:00010000:0.0:1787858084.183671:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3400/0xd3f183cab4a78687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd27ca expref: 96 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183686:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3c00/0xd3f183cab4a785ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd27ae expref: 95 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183700:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3000/0xd3f183cab4a784ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd277d expref: 94 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183710:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9998c6b34500) 00010000:00010000:0.0:1787858084.183721:0:17347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c1495200/0xd3f183cab4a784ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd276f expref: 93 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787858084.183737:0:17347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9998d8bfdc00) 00010000:00010000:0.0:1787858084.183745:0:17347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787858084.184852:0:17347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998d039a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:365dae28-8203-4526-83a5-01baf5c55d8b+92:2347:x1874704171943168:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3649us (3869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858084.184869:0:17347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 83 00000040:00080000:0.0:1787858084.240330:0:27146:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858084.240341:0:27146:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858084.240895:0:27146:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858084.240906:0:27146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787858084.433425:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858084.433585:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171943296 00000100:00100000:1.0:1787858084.433596:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171943296 00000100:00100000:1.0:1787858084.433667:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 696 00000100:00100000:1.0:1787858084.433677:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171943296:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858084.433779:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171943296:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 104us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858084.433788:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 696 00000100:00100000:0.0:1787858084.441953:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858084.442052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858084.442086:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858084.442102:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858084.442121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858084.442187:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171943680 00000100:00100000:3.0:1787858084.442197:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171943680 00000100:00100000:3.0:1787858084.442268:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 690 00000100:00100000:3.0:1787858084.442277:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171943680:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858084.442349:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2349:x1874704171943680:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 73us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858084.442356:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 690 00000100:00100000:3.0:1787858084.442380:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171943424 00000100:00100000:3.0:1787858084.442384:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171943424 00000100:00080000:0.0:1787858084.442681:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787858084.442686:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858084.442757:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171943936 00000100:00100000:3.0:1787858084.442761:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171943936 00000100:00100000:3.0:1787858084.448720:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171943552 00000100:00100000:3.0:1787858084.448737:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171943552 00000100:00100000:3.0:1787858084.448792:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171943808 00000100:00100000:3.0:1787858084.448796:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171943808 00000100:00100000:3.0:1787858084.448847:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 745 00000100:00100000:3.0:1787858084.448858:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171943424:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858084.448945:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171943424:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 89us (8140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858084.448953:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 745 00000100:00100000:3.0:1787858084.448973:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 746 00000100:00100000:3.0:1787858084.448980:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171943936:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858084.449005:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171943936:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (6919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858084.449011:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 746 00000100:00100000:3.0:1787858084.449022:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 747 00000100:00100000:3.0:1787858084.449027:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171943552:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858084.449047:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171943552:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20us (6944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858084.449053:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 747 00000100:00100000:3.0:1787858084.449062:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 748 00000100:00100000:3.0:1787858084.449067:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171943808:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858084.449085:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171943808:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 18us (6963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858084.449090:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 748 00000100:00080000:3.0:1787858084.449111:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787858084.449116:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787858084.595156:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787858085.615167:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858085.743161:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858085.743239:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188349056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858085.743345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858085.743499:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188349056 00000100:00100000:3.0:1787858085.743509:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188349056 00000100:00100000:3.0:1787858085.743598:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787858085.743611:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188349056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858085.743657:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858085.743718:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188349056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858085.743726:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:2.0:1787858085.743869:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787858085.743918:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188349056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787858086.639010:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858086.722388:0:27197:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858086.722426:0:27197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858086.723811:0:27197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858086.723851:0:27197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787858087.278893:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188349440:0@lo:400:kworker.0 00000100:00100000:3.0:1787858087.279013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858087.279161:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787858087.279169:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188349312:0@lo:400:kworker.0 00000100:00100000:3.0:1787858087.279196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858087.279234:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188349824:0@lo:400:kworker.0 00000100:00100000:3.0:1787858087.279264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858087.279302:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188349440 00000100:00100000:3.0:1787858087.279311:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188349440 00000100:00100000:3.0:1787858087.279378:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188349312 00000100:00100000:3.0:1787858087.279383:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188349312 00000100:00100000:3.0:1787858087.279410:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1787858087.279419:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188349440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858087.279482:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188349440:12345-0@lo:400:kworker.0 Request processed in 63us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858087.279740:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188349184:0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.279779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858087.279808:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188349696:0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.279862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858087.279885:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858087.279903:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188349568:0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.279926:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858087.279978:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188349184 00000100:00100000:2.0:1787858087.279982:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188349184 00000100:00100000:2.0:1787858087.280014:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1787858087.280021:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188349184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.280055:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188349184:12345-0@lo:400:kworker.0 Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858087.280062:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1787858087.280096:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188349696 00000100:00100000:2.0:1787858087.280099:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188349696 00000100:00100000:2.0:1787858087.280117:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1787858087.280123:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188349312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.280152:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188349312:12345-0@lo:400:kworker.0 Request processed in 29us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858087.280158:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1787858087.280171:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1787858087.280176:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188349696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.280200:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188349696:12345-0@lo:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858087.280206:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1787858087.280244:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188349184:0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.280258:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188349696:0@lo:400:kworker.0 00000100:00080000:2.0:1787858087.280298:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858087.280310:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188349824 00000100:00100000:2.0:1787858087.280313:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188349824 00000100:00100000:2.0:1787858087.280342:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188349568 00000100:00100000:2.0:1787858087.280345:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188349568 00000100:00100000:2.0:1787858087.280368:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1787858087.280374:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188349824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.280406:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188349824:12345-0@lo:400:kworker.0 Request processed in 32us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858087.280412:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1787858087.280423:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1787858087.280429:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188349568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.280457:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188349568:12345-0@lo:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858087.280463:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00080000:2.0:1787858087.280479:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858087.280482:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787858087.280954:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188349568:0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.281018:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188349312:0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.281032:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188349824:0@lo:400:kworker.0 00000100:00100000:2.0:1787858087.281046:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188349440:0@lo:400:kworker.0 00000100:00100000:3.0:1787858087.283099:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00010000:00010000:3.0:1787858087.662143:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858087.791974:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787858087.799511:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188349952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787858087.799618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858087.801460:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188349952 00000100:00100000:3.0:1787858087.801478:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188349952 00000100:00100000:3.0:1787858087.801567:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787858087.801579:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188349952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787858087.801627:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858087.802040:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188349952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858087.802050:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787858087.811024:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188349952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787858088.691042:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858089.087191:0:27248:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858089.087203:0:27248:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858089.089632:0:27248:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858089.089652:0:27248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787858089.552291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858089.552329:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858089.552353:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858089.554041:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858089.554070:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858089.554090:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858089.554114:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858089.554144:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171944064 00000100:00100000:3.0:1787858089.554155:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171944064 00000100:00100000:3.0:1787858089.554209:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 698 00000100:00100000:3.0:1787858089.554221:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171944064:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858089.554300:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171944064:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 81us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858089.554309:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 698 00000100:00100000:3.0:1787858089.554345:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171944320 00000100:00100000:3.0:1787858089.554349:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171944320 00000100:00100000:3.0:1787858089.558130:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171944832 00000100:00100000:3.0:1787858089.558149:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171944832 00000100:00100000:3.0:1787858089.558180:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171944448 00000100:00100000:3.0:1787858089.558184:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171944448 00000100:00100000:3.0:1787858089.558202:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171944704 00000100:00100000:3.0:1787858089.558204:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171944704 00000100:00100000:3.0:1787858089.558229:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 751 00000100:00100000:3.0:1787858089.558239:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171944320:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858089.558331:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171944320:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 93us (6000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858089.558339:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 751 00000100:00100000:3.0:1787858089.560684:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 752 00000100:00100000:3.0:1787858089.560720:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171944832:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858089.560887:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171944576 00000100:00100000:2.0:1787858089.560896:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171944576 00000100:00100000:2.0:1787858089.560956:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171944192 00000100:00100000:2.0:1787858089.560960:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171944192 00000100:00100000:2.0:1787858089.560984:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 694 00000100:00100000:2.0:1787858089.560992:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2347:x1874704171944576:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858089.561984:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171944832:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1275us (7941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858089.561998:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 752 00000100:00100000:3.0:1787858089.562037:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 753 00000100:00100000:3.0:1787858089.562050:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171944448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:0.0:1787858089.562286:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787858089.562293:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787858089.562297:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858089.562317:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 754 00000100:00100000:0.0:1787858089.562328:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171944704:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858089.563495:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171944448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1437us (9390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858089.563509:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 753 00000100:00100000:2.0:1787858089.563684:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2347:x1874704171944576:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 2690us (11326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858089.563693:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 694 00000100:00100000:2.0:1787858089.563720:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 695 00000100:00100000:2.0:1787858089.563732:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:2347:x1874704171944192:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858089.563782:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:365dae28-8203-4526-83a5-01baf5c55d8b+92:2347:x1874704171944192:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 56us (9712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858089.563789:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 695 00000100:00100000:0.0:1787858089.565234:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2347:x1874704171944704:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 2894us (11104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858089.565249:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 754 00010000:00010000:3.0:1787858089.718460:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787858090.734095:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858090.862687:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c3a23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188350080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787858090.862765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858090.862919:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188350080 00000100:00100000:3.0:1787858090.862930:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188350080 00000100:00100000:3.0:1787858090.863012:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787858090.863024:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188350080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858090.863072:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858090.863119:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188350080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858090.863127:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:0.0:1787858090.863185:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858090.863225:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c3a23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188350080:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787858091.274176:0:27300:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858091.274186:0:27300:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858091.276496:0:27300:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858091.276518:0:27300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858091.759041:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858092.375452:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858092.375619:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171944960 00000100:00100000:1.0:1787858092.375643:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171944960 00000100:00100000:1.0:1787858092.375751:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:1.0:1787858092.375765:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+52:2350:x1874704171944960:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787858092.375785:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:1.0:1787858092.375856:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3e00/0xd3f183cab4a7a631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd30ad expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.375888:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9998d5316700) 00010000:00010000:1.0:1787858092.375901:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c26c1e00/0xd3f183cab4a7a4a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3028 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.375914:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9998d8aea100) 00010000:00010000:1.0:1787858092.375923:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707a00/0xd3f183cab4a7a432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd3005 expref: 50 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.375936:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9998d5316100) 00010000:00010000:1.0:1787858092.375945:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c2707200/0xd3f183cab4a7a2d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f8e expref: 49 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.375955:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9998c53aed00) 00010000:00010000:1.0:1787858092.375963:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e44200/0xd3f183cab4a7a264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f6b expref: 48 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.375976:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9998c53ae100) 00010000:00010000:1.0:1787858092.375984:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45200/0xd3f183cab4a7a13e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2f09 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376001:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9998d8797a00) 00010000:00010000:1.0:1787858092.376008:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9997c1e45400/0xd3f183cab4a7a0f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2ef4 expref: 46 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376017:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9998d8797200) 00010000:00010000:1.0:1787858092.376025:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c6091200/0xd3f183cab4a799dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2d0a expref: 45 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376035:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff9998d5316f00) 00010000:00010000:1.0:1787858092.376042:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3800/0xd3f183cab4a79735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2c46 expref: 44 pid: 5858 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376052:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9998d8bfd800) 00010000:00010000:1.0:1787858092.376060:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998f8e95000/0xd3f183cab4a79758 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2c4d expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376070:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff9998d5316a00) 00010000:00010000:1.0:1787858092.376078:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999014e3200/0xd3f183cab4a79314 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2b43 expref: 42 pid: 7656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376088:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff9998c6b34a00) 00010000:00010000:1.0:1787858092.376125:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d0a00/0xd3f183cab4a79035 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x51/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2a71 expref: 41 pid: 5858 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376135:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9998d8bfde00) 00010000:00010000:1.0:1787858092.376151:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c70b3000/0xd3f183cab4a79058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2a78 expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376161:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff9998d8bfd900) 00010000:00010000:1.0:1787858092.376170:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998da8f5600/0xd3f183cab4a78b8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2944 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376196:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9998c53ae700) 00010000:00010000:1.0:1787858092.376209:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9998c13fdc00/0xd3f183cab4a7877c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2810 expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376220:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9998d8bfd500) 00010000:00010000:1.0:1787858092.376232:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9999009d1400/0xd3f183cab4a78752 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0x6587464c02fd2802 expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787858092.376241:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9998d8797c00) 00010000:00010000:1.0:1787858092.376248:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787858092.376323:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171944960:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 562us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858092.376332:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00080000:0.0:1787858092.376736:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858092.413353:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787858092.413520:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858092.413556:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188350592:0@lo:400:kworker.0 00000100:00100000:2.0:1787858092.414795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858092.414939:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188350464:0@lo:400:kworker.0 00000100:00100000:2.0:1787858092.414989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858092.415019:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787858092.415026:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188350336:0@lo:400:kworker.0 00000100:00100000:2.0:1787858092.415046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858092.415079:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188350464 00000100:00100000:2.0:1787858092.415088:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188350464 00000100:00100000:2.0:1787858092.415154:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188350336 00000100:00100000:2.0:1787858092.415157:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188350336 00000100:00100000:2.0:1787858092.415183:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1787858092.415193:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188350464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858092.415220:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188350592 00000100:00100000:3.0:1787858092.415234:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188350592 00000100:00100000:2.0:1787858092.415256:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188350464:12345-0@lo:400:kworker.0 Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858092.415266:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1787858092.415292:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1787858092.415302:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188350336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858092.415332:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188350336:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858092.415336:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1787858092.415346:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1787858092.415372:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188350592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858092.415407:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188350336:0@lo:400:kworker.0 00000100:00100000:2.0:1787858092.415423:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188350464:0@lo:400:kworker.0 00000100:00100000:0.0:1787858092.422864:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188350208:0@lo:400:kworker.0 00000100:00100000:0.0:1787858092.422966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858092.423047:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188350208 00000100:00100000:0.0:1787858092.423055:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188350208 00000100:00100000:3.0:1787858092.423325:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998e185fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188350592:12345-0@lo:400:kworker.0 Request processed in 7971us (8532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858092.423338:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1787858092.427381:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188350592:0@lo:400:kworker.0 00000100:00080000:3.0:1787858092.427446:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787858092.427453:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787858092.428901:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188350848:0@lo:400:kworker.0 00000100:00100000:1.0:1787858092.428968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858092.429023:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188350720:0@lo:400:kworker.0 00000100:00100000:1.0:1787858092.429051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858092.429107:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188350848 00000100:00100000:1.0:1787858092.429114:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188350848 00000100:00100000:1.0:1787858092.429176:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1787858092.429186:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188350848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858092.429235:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188350848:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858092.429242:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1787858092.430869:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188350848:0@lo:400:kworker.0 00000100:00100000:1.0:1787858092.430934:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188350720 00000100:00100000:1.0:1787858092.430941:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188350720 00000100:00100000:1.0:1787858092.430995:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1787858092.431003:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188350720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858092.431065:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188350720:12345-0@lo:400:kworker.0 Request processed in 63us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858092.431072:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1787858092.431108:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188350720:0@lo:400:kworker.0 00000100:00100000:0.0:1787858092.433902:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1787858092.433937:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188350208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858092.434056:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c7b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188350208:12345-0@lo:400:kworker.0 Request processed in 138us (11091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858092.438346:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00080000:3.0:1787858092.448938:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787858092.448951:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787858092.449016:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188350208:0@lo:400:kworker.0 00010000:00010000:1.0:1787858092.788233:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858092.913084:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858092.913121:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188350976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858092.913210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858092.913466:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188350976 00000100:00100000:1.0:1787858092.913475:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188350976 00000100:00100000:1.0:1787858092.913548:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787858092.913560:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188350976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787858092.913608:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858092.913682:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188350976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858092.913690:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787858092.913747:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188350976:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787858093.753120:0:27351:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858093.753136:0:27351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858093.754081:0:27351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858093.754105:0:27351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858093.827323:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787858094.254301:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858094.254313:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858094.254982:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858094.254993:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787858094.673592:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858094.673668:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858094.673706:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858094.673738:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171945216 00000100:00100000:3.0:1787858094.673750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858094.673755:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171945216 00000100:00100000:3.0:1787858094.673789:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171945472 00000100:00100000:3.0:1787858094.673796:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171945472 00000100:00100000:1.0:1787858094.673922:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171945088 00000100:00100000:1.0:1787858094.673940:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171945088 00000100:00100000:3.0:1787858094.673947:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171945728 00000100:00100000:3.0:1787858094.673955:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171945728 00000100:00100000:0.0:1787858094.673955:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 699 00000100:00100000:0.0:1787858094.673977:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:2350:x1874704171945216:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858094.674005:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 757 00000100:00100000:3.0:1787858094.674025:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171945472:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858094.674037:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 700 00000100:00100000:1.0:1787858094.674057:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171945088:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858094.674175:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171945472:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 158us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858094.674186:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 757 00000100:00100000:3.0:1787858094.674215:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 758 00000100:00100000:3.0:1787858094.674224:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171945728:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:2.0:1787858094.674639:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858094.674645:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858094.674647:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858094.689191:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c3a212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:2350:x1874704171945216:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 15207us (15599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858094.689207:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 699 00000100:00100000:0.0:1787858094.689365:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858094.689404:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858094.689460:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858094.689494:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171945344 00000100:00100000:0.0:1787858094.689503:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171945344 00000100:00100000:0.0:1787858094.689550:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171945856 00000100:00100000:0.0:1787858094.689553:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171945856 00000100:00100000:0.0:1787858094.689572:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 759 00000100:00100000:0.0:1787858094.689580:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171945344:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858094.689629:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171945344:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858094.689636:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 759 00000100:00100000:0.0:1787858094.689646:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 760 00000100:00100000:0.0:1787858094.689652:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171945856:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858094.689673:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171945856:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858094.689679:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 760 00000100:00100000:0.0:1787858094.691468:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171945600 00000100:00100000:0.0:1787858094.691486:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171945600 00000100:00100000:0.0:1787858094.691573:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 700 00000100:00100000:0.0:1787858094.691584:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2349:x1874704171945600:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858094.692389:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2349:x1874704171945600:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 802us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858094.692399:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 700 00000100:00080000:0.0:1787858094.692454:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787858094.692460:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787858094.692463:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858094.694318:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171945088:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20242us (20623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858094.694338:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 700 00000100:00100000:3.0:1787858094.694540:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171945728:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 20301us (20774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858094.694553:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 758 00010000:00010000:1.0:1787858094.830507:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787858095.854249:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858095.987159:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188351104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787858095.987251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858095.987332:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188351104 00000100:00100000:0.0:1787858095.987340:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188351104 00000100:00100000:0.0:1787858095.987421:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787858095.987430:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188351104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787858095.987481:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858095.987545:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188351104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858095.987554:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:0.0:1787858095.987576:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858095.987632:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188351104:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787858096.201217:0:27402:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858096.201228:0:27402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858096.203280:0:27402:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858096.203304:0:27402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858096.880333:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858097.518228:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188351616:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.518340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858097.518420:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787858097.518427:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188351232:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.518458:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858097.518482:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188351744:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.518510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858097.518539:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188351360:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.519074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858097.519109:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188351872:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.519201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858097.519228:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787858097.519297:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188351488:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.519324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858097.519378:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188351616 00000100:00100000:2.0:1787858097.519386:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188351616 00000100:00100000:2.0:1787858097.519441:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188351872 00000100:00100000:2.0:1787858097.519444:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188351872 00000100:00100000:2.0:1787858097.519472:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1787858097.519483:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188351616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.519550:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188351616:12345-0@lo:400:kworker.0 Request processed in 68us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858097.519559:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1787858097.519577:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1787858097.519583:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188351872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.519616:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188351872:12345-0@lo:400:kworker.0 Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858097.519622:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1787858097.519641:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188351232 00000100:00100000:2.0:1787858097.519645:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188351232 00000100:00100000:2.0:1787858097.519674:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1787858097.519680:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188351232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.519709:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188351232:12345-0@lo:400:kworker.0 Request processed in 30us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858097.519715:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1787858097.519746:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188351744 00000100:00100000:2.0:1787858097.519750:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188351744 00000100:00100000:2.0:1787858097.519779:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188351360 00000100:00100000:2.0:1787858097.519782:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188351360 00000100:00100000:2.0:1787858097.519994:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188351488 00000100:00100000:2.0:1787858097.519999:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188351488 00000100:00080000:0.0:1787858097.524648:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787858097.524660:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787858097.524664:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858097.525110:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1787858097.525137:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188351744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.525643:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1787858097.525655:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188351360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.525754:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188351360:12345-0@lo:400:kworker.0 Request processed in 101us (7187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858097.525762:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1787858097.525782:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1787858097.525789:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188351488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.525929:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188351488:12345-0@lo:400:kworker.0 Request processed in 141us (6604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858097.525935:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1787858097.525996:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188351488:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.526011:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188351360:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.526025:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188351872:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.526077:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c34f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188351232:0@lo:400:kworker.0 00000100:00100000:2.0:1787858097.526091:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188351616:0@lo:400:kworker.0 00000100:00100000:1.0:1787858097.526774:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188351744:12345-0@lo:400:kworker.0 Request processed in 1652us (8262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858097.526782:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1787858097.526904:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188351744:0@lo:400:kworker.0 00010000:00010000:0.0:1787858097.906011:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858098.030076:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188352000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787858098.030152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858098.030334:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188352000 00000100:00100000:1.0:1787858098.030343:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188352000 00000100:00100000:1.0:1787858098.030409:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787858098.030419:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188352000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787858098.030453:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858098.030503:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188352000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858098.030511:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787858098.030557:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998ffa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188352000:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787858098.742320:0:27454:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858098.742329:0:27454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858098.744804:0:27454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858098.745294:0:27454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787858098.937180:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858099.795891:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858099.795949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858099.795986:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858099.796025:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858099.796044:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858099.796063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858099.796149:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171946368 00000100:00100000:3.0:1787858099.796160:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171946368 00000100:00100000:1.0:1787858099.796160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00080000:1.0:1787858099.796205:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787858099.796232:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171946624 00000100:00100000:3.0:1787858099.796236:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171946624 00000100:00100000:1.0:1787858099.796241:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171946240 00000100:00100000:1.0:1787858099.796244:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171946240 00000100:00100000:3.0:1787858099.796260:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171946752 00000100:00100000:3.0:1787858099.796263:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171946752 00000100:00100000:1.0:1787858099.796269:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 763 00000100:00100000:3.0:1787858099.796278:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 764 00000100:00100000:1.0:1787858099.796279:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171946368:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858099.796284:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171946624:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858099.796389:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171946112 00000100:00100000:2.0:1787858099.796395:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171946112 00000100:00100000:2.0:1787858099.796434:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171946496 00000100:00100000:2.0:1787858099.796437:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171946496 00000100:00100000:2.0:1787858099.796460:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 704 00000100:00100000:2.0:1787858099.796466:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+92:2349:x1874704171946112:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858099.796539:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171945984 00000100:00100000:0.0:1787858099.796544:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171945984 00000100:00100000:0.0:1787858099.796574:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 702 00000100:00100000:0.0:1787858099.796581:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171945984:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858099.800847:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171946368:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 4556us (4846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858099.800870:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171946624:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 4583us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858099.800874:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 763 00000100:00100000:3.0:1787858099.800878:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 764 00000100:00100000:3.0:1787858099.800914:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 765 00000100:00100000:1.0:1787858099.800919:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 766 00000100:00100000:1.0:1787858099.800928:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171946752:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858099.800929:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171946240:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858099.800970:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171946240:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 49us (4925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858099.800970:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171946752:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 46us (4811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858099.800977:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 765 00000100:00100000:1.0:1787858099.801119:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 766 00000100:00100000:1.0:1787858099.801152:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 705 00000100:00100000:1.0:1787858099.801161:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171946496:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858099.801194:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171946496:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (5130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858099.801200:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 705 00000100:00080000:1.0:1787858099.801390:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858099.801397:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787858099.801399:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858099.805944:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998ffa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:365dae28-8203-4526-83a5-01baf5c55d8b+92:2349:x1874704171946112:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 9459us (10048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858099.805962:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 704 00000100:00100000:0.0:1787858099.819933:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171945984:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23334us (23966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858099.819951:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 702 00010000:00010000:3.0:1787858099.950507:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858100.803186:0:27505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858100.803198:0:27505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858100.803760:0:27505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858100.803772:0:27505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858100.976038:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858101.119722:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188352128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787858101.119841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858101.119924:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188352128 00000100:00100000:1.0:1787858101.119932:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188352128 00000100:00100000:1.0:1787858101.120067:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787858101.120079:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188352128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787858101.120124:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858101.120175:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188352128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858101.120183:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:1.0:1787858101.120204:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787858101.120247:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188352128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787858101.998124:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858102.640626:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188352256:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.640700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858102.640742:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188352768:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.640764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858102.640786:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787858102.640791:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188352640:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.640839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858102.640867:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188352512:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.640889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858102.640904:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787858102.640908:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188352384:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.640925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858102.640937:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990153f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188352896:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.640954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858102.640978:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188352256 00000100:00100000:2.0:1787858102.640986:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188352256 00000100:00100000:2.0:1787858102.641023:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1787858102.641031:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188352256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641074:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f43e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188352256:12345-0@lo:400:kworker.0 Request processed in 44us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858102.641081:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1787858102.641110:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188352768 00000100:00100000:2.0:1787858102.641113:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188352768 00000100:00100000:2.0:1787858102.641144:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188352512 00000100:00100000:2.0:1787858102.641147:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188352512 00000100:00100000:2.0:1787858102.641163:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188352384 00000100:00100000:2.0:1787858102.641165:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188352384 00000100:00100000:2.0:1787858102.641176:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1787858102.641182:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188352768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641212:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188352768:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858102.641218:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1787858102.641228:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1787858102.641233:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188352512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641256:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188352512:12345-0@lo:400:kworker.0 Request processed in 24us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858102.641274:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1787858102.641284:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1787858102.641289:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188352384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641310:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c34f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188352384:12345-0@lo:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858102.641315:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1787858102.641330:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188352640 00000100:00100000:2.0:1787858102.641334:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188352640 00000100:00100000:2.0:1787858102.641352:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188352896 00000100:00100000:2.0:1787858102.641354:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188352896 00000100:00100000:2.0:1787858102.641370:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1787858102.641375:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188352640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641399:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188352640:12345-0@lo:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858102.641404:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1787858102.641413:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1787858102.641418:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188352896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641436:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188352896:12345-0@lo:400:kworker.0 Request processed in 19us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858102.641444:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1787858102.641484:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188352640:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641492:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188352256:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641500:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188352768:0@lo:400:kworker.0 00000100:00080000:2.0:1787858102.641524:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858102.641528:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858102.641540:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188352384:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641548:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188352896:0@lo:400:kworker.0 00000100:00100000:2.0:1787858102.641555:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990153c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188352512:0@lo:400:kworker.0 00010000:00010000:1.0:1787858103.024518:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858103.058488:0:27556:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858103.058501:0:27556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858103.059162:0:27556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858103.059174:0:27556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787858103.150184:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188353024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858103.150292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858103.154600:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188353024 00000100:00100000:0.0:1787858103.154618:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188353024 00000100:00100000:0.0:1787858103.154989:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787858103.155003:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188353024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787858103.155058:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787858103.155178:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188353024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (4887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858103.155187:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787858103.155455:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188353024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787858104.047849:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787858104.495256:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858104.495270:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858104.495840:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858104.495851:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858104.921315:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858104.921361:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858104.921440:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858104.921474:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171947136 00000100:00100000:1.0:1787858104.921483:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171947136 00000100:00100000:1.0:1787858104.921551:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 769 00000100:00100000:1.0:1787858104.921561:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171947136:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858104.921635:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171947136:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858104.921644:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 769 00000100:00100000:0.0:1787858104.921760:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171946880 00000100:00100000:0.0:1787858104.921765:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171946880 00000100:00100000:0.0:1787858104.921839:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 704 00000100:00100000:0.0:1787858104.921848:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171946880:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858104.921886:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171946880:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858104.921894:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 704 00000100:00100000:3.0:1787858104.922453:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171947008 00000100:00100000:3.0:1787858104.922460:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171947008 00000100:00100000:3.0:1787858104.922600:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 709 00000100:00100000:3.0:1787858104.922608:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+92:2347:x1874704171947008:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858104.922654:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+92:2347:x1874704171947008:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 47us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858104.922661:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 709 00000100:00100000:3.0:1787858104.922714:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858104.922748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858104.922765:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858104.922783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858104.923145:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171947392 00000100:00100000:0.0:1787858104.923152:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171947392 00000100:00100000:0.0:1787858104.923189:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 710 00000100:00100000:0.0:1787858104.923197:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2347:x1874704171947392:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858104.923253:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2347:x1874704171947392:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 56us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858104.923260:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 710 00000100:00080000:2.0:1787858104.923578:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787858104.923585:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858104.923758:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171947264 00000100:00100000:3.0:1787858104.923764:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171947264 00000100:00100000:0.0:1787858104.924038:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171947520 00000100:00100000:0.0:1787858104.924043:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171947520 00000100:00100000:0.0:1787858104.924073:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171947648 00000100:00100000:0.0:1787858104.924076:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171947648 00000100:00100000:0.0:1787858104.924099:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 770 00000100:00100000:0.0:1787858104.924107:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171947520:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858104.924158:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171947520:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 52us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858104.924165:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 770 00000100:00100000:0.0:1787858104.924180:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 771 00000100:00100000:0.0:1787858104.924186:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171947648:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858104.924212:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171947648:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858104.924232:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 771 00000100:00080000:2.0:1787858104.924492:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787858104.924497:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787858104.924646:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 772 00000100:00100000:3.0:1787858104.924656:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171947264:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858104.924809:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2347:x1874704171947264:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 142us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858104.924830:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 772 00010000:00010000:2.0:1787858105.070095:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858105.217257:0:27608:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858105.217268:0:27608:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858105.217786:0:27608:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858105.217798:0:27608:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858106.094061:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858106.222199:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188353152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787858106.222278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858106.222439:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188353152 00000100:00100000:1.0:1787858106.222448:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188353152 00000100:00100000:1.0:1787858106.222521:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787858106.222530:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188353152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787858106.222568:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858106.222636:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188353152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858106.222644:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787858106.222693:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188353152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787858106.222924:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787858107.119760:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858107.476057:0:27659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858107.476067:0:27659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858107.476603:0:27659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858107.476614:0:27659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858107.764278:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188353408:0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.764353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858107.764406:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7049a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188353920:0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.764432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858107.764475:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787858107.764481:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188353536:0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.764506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858107.764542:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188353408 00000100:00100000:0.0:1787858107.764550:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188353408 00000100:00100000:0.0:1787858107.764596:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188353536 00000100:00100000:0.0:1787858107.764599:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188353536 00000100:00100000:0.0:1787858107.764631:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1787858107.764640:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188353408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.764695:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188353408:12345-0@lo:400:kworker.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858107.764704:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1787858107.764722:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1787858107.764728:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188353536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.764752:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188353536:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858107.764758:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1787858107.764777:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188353920 00000100:00100000:0.0:1787858107.764780:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188353920 00000100:00100000:0.0:1787858107.764811:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1787858107.764999:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188353920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.765037:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188353920:12345-0@lo:400:kworker.0 Request processed in 42us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858107.765043:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00080000:0.0:1787858107.765067:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787858107.765072:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858107.765496:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f7048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188353664:0@lo:400:kworker.0 00000100:00100000:3.0:1787858107.765539:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858107.765573:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787858107.765580:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f70492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188353280:0@lo:400:kworker.0 00000100:00100000:3.0:1787858107.765612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858107.765638:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9998f704b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188353792:0@lo:400:kworker.0 00000100:00100000:3.0:1787858107.765662:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858107.765695:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188353280 00000100:00100000:3.0:1787858107.765700:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188353280 00000100:00100000:3.0:1787858107.765736:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1787858107.765742:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188353280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858107.765796:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3302:x1874704188353280:12345-0@lo:400:kworker.0 Request processed in 54us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858107.765803:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1787858107.765889:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f70492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3302:1874704188353280:0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.768336:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188353664 00000100:00100000:0.0:1787858107.768352:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188353664 00000100:00100000:0.0:1787858107.768419:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1787858107.768429:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188353664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.769103:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188353664:12345-0@lo:400:kworker.0 Request processed in 672us (3559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858107.769114:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1787858107.769151:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188353792 00000100:00100000:0.0:1787858107.769156:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188353792 00000100:00100000:3.0:1787858107.769382:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188353664:0@lo:400:kworker.0 00000100:00080000:2.0:1787858107.769444:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787858107.770410:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1787858107.770429:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188353792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.770535:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874704188353792:12345-0@lo:400:kworker.0 Request processed in 113us (4870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858107.770542:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1787858107.770615:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188353536:0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.770631:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188353408:0@lo:400:kworker.0 00000100:00100000:0.0:1787858107.770644:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f7049a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188353920:0@lo:400:kworker.0 00000100:00100000:3.0:1787858107.772013:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9998f704b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874704188353792:0@lo:400:kworker.0 00010000:00010000:3.0:1787858108.146408:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787858108.274208:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858108.274237:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188354048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787858108.274329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858108.274843:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188354048 00000100:00100000:1.0:1787858108.274853:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188354048 00000100:00100000:1.0:1787858108.274916:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787858108.274927:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188354048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787858108.274970:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858108.275043:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c5b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188354048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858108.275051:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787858108.275436:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99990139da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188354048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787858109.169458:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787858109.612324:0:27710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787858109.612340:0:27710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787858109.612903:0:27710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787858109.612917:0:27710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858110.034047:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858110.034097:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858110.034146:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858110.034178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858110.034205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858110.034222:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1787858110.034664:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171948032 00000100:00100000:3.0:1787858110.034676:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171948032 00000100:00100000:3.0:1787858110.034752:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171948544 00000100:00100000:3.0:1787858110.034755:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171948544 00000100:00100000:3.0:1787858110.034775:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171948160 00000100:00100000:3.0:1787858110.034777:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171948160 00000100:00100000:3.0:1787858110.034801:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 775 00000100:00100000:3.0:1787858110.034811:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171948032:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858110.034943:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2349:x1874704171948032:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 134us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858110.034951:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 775 00000100:00100000:3.0:1787858110.034969:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 776 00000100:00100000:3.0:1787858110.034976:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171948544:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858110.035015:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2349:x1874704171948544:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858110.035021:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 776 00000100:00100000:3.0:1787858110.035032:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 777 00000100:00100000:3.0:1787858110.035037:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171948160:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858110.035073:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+19:2349:x1874704171948160:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858110.035079:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 777 00000100:00100000:0.0:1787858110.035265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1787858110.035417:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171948416 00000100:00100000:0.0:1787858110.035423:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171948416 00000100:00100000:0.0:1787858110.035457:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 778 00000100:00100000:0.0:1787858110.035465:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171948416:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858110.035510:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2349:x1874704171948416:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 39us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858110.035517:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 778 00000100:00100000:0.0:1787858110.035543:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171948288 00000100:00100000:0.0:1787858110.035548:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171948288 00000100:00100000:0.0:1787858110.035578:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171947904 00000100:00100000:0.0:1787858110.035581:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171947904 00000100:00100000:0.0:1787858110.035603:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 714 00000100:00100000:0.0:1787858110.035611:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2349:x1874704171948288:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858110.035642:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f704ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2349:x1874704171948288:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 34us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858110.035649:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 714 00000100:00100000:0.0:1787858110.035661:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 715 00000100:00100000:0.0:1787858110.035667:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:2349:x1874704171947904:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858110.035692:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:2349:x1874704171947904:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858110.035699:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 715 00000100:00100000:1.0:1787858110.038346:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171947776 00000100:00100000:1.0:1787858110.038368:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171947776 00000100:00100000:1.0:1787858110.038452:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 706 00000100:00100000:1.0:1787858110.038464:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171947776:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858110.038582:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2349:x1874704171947776:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 120us (4546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858110.038592:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 706 00000100:00080000:2.0:1787858110.038769:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787858110.038776:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787858110.038780:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787858110.190636:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787858111.214919:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858111.344264:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188354176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787858111.344355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858111.344491:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188354176 00000100:00100000:3.0:1787858111.344502:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188354176 00000100:00100000:3.0:1787858111.344578:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787858111.344591:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f7048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188354176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858111.344649:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858111.344708:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f7048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188354176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858111.344717:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787858111.344780:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188354176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787858111.345783:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787858111.478431:0:27762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858111.478442:0:27762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858111.479528:0:27762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858111.479545:0:27762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858112.239874:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858112.879126:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188354304:0@lo:400:kworker.0 00000100:00100000:1.0:1787858112.879227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858112.879289:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188354816:0@lo:400:kworker.0 00000100:00100000:1.0:1787858112.879319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858112.879358:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787858112.879363:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188354688:0@lo:400:kworker.0 00000100:00100000:1.0:1787858112.879395:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858112.879624:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188354560:0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.879656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858112.879684:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787858112.879690:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c5b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188354432:0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.879715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858112.879733:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188354944:0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.879755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787858112.879798:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188354688 00000100:00100000:0.0:1787858112.879806:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188354688 00000100:00100000:0.0:1787858112.879874:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188354944 00000100:00100000:0.0:1787858112.879878:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188354944 00000100:00100000:0.0:1787858112.879909:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1787858112.879917:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188354688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.879973:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188354688:12345-0@lo:400:kworker.0 Request processed in 56us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858112.879980:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1787858112.879997:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1787858112.880004:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188354944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.880036:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188354944:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858112.880043:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1787858112.880077:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188354816 00000100:00100000:0.0:1787858112.880080:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188354816 00000100:00100000:0.0:1787858112.880108:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188354560 00000100:00100000:0.0:1787858112.880111:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188354560 00000100:00100000:0.0:1787858112.880127:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188354432 00000100:00100000:0.0:1787858112.880129:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188354432 00000100:00100000:0.0:1787858112.880141:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1787858112.880148:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188354816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.880178:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188354816:12345-0@lo:400:kworker.0 Request processed in 31us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858112.880185:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1787858112.880199:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:0.0:1787858112.880205:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188354560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.880233:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f70492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188354560:12345-0@lo:400:kworker.0 Request processed in 28us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858112.880238:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:0.0:1787858112.880248:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1787858112.880254:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188354432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.880277:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874704188354432:12345-0@lo:400:kworker.0 Request processed in 24us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858112.880282:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00080000:0.0:1787858112.880302:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787858112.880306:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787858112.880336:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874704188354432:0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.880360:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188354944:0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.880368:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188354560:0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.880397:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188354688:0@lo:400:kworker.0 00000100:00100000:0.0:1787858112.880407:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188354816:0@lo:400:kworker.0 00000100:00100000:3.0:1787858112.880905:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188354304 00000100:00100000:3.0:1787858112.880911:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188354304 00000100:00100000:3.0:1787858112.880952:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1787858112.880960:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188354304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858112.881013:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188354304:12345-0@lo:400:kworker.0 Request processed in 54us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858112.881019:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1787858112.881109:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c5b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188354304:0@lo:400:kworker.0 00010000:00010000:2.0:1787858113.266253:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787858113.390032:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787858113.390075:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188355072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787858113.390149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858113.390193:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188355072 00000100:00100000:3.0:1787858113.390202:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188355072 00000100:00100000:3.0:1787858113.390270:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787858113.390281:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188355072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787858113.390322:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858113.390381:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188355072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858113.390391:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787858113.390435:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188355072:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787858113.639320:0:27813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858113.639336:0:27813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858113.639887:0:27813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858113.639898:0:27813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787858114.286918:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858114.735549:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858114.735562:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858114.736154:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858114.736164:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858115.160631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858115.160686:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858115.160731:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858115.160759:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858115.160783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858115.160906:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858115.161000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858115.161058:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171949056 00000100:00100000:1.0:1787858115.161072:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171949056 00000100:00100000:1.0:1787858115.161166:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171949312 00000100:00100000:1.0:1787858115.161170:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171949312 00000100:00100000:1.0:1787858115.161191:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171948928 00000100:00100000:1.0:1787858115.161195:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171948928 00000100:00100000:1.0:1787858115.161210:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171949440 00000100:00100000:1.0:1787858115.161213:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171949440 00000100:00100000:1.0:1787858115.161233:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 781 00000100:00100000:1.0:1787858115.161247:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171949056:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858115.161370:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171949056:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 126us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858115.161378:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 781 00000100:00100000:1.0:1787858115.161404:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 782 00000100:00100000:1.0:1787858115.161410:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171949312:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858115.161436:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171949312:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858115.161442:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 782 00000100:00100000:1.0:1787858115.161452:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 783 00000100:00100000:1.0:1787858115.161458:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171948928:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858115.161482:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:365dae28-8203-4526-83a5-01baf5c55d8b+16:2347:x1874704171948928:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858115.161488:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 783 00000100:00100000:1.0:1787858115.161498:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 784 00000100:00100000:1.0:1787858115.161504:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998f6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171949440:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858115.161529:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998f6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2347:x1874704171949440:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 24us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858115.161535:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 784 00000100:00100000:1.0:1787858115.161757:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171948800 00000100:00100000:1.0:1787858115.161762:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171948800 00000100:00100000:1.0:1787858115.161794:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171949184 00000100:00100000:1.0:1787858115.161797:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171949184 00000100:00100000:1.0:1787858115.161848:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 719 00000100:00100000:1.0:1787858115.161856:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+92:2348:x1874704171948800:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858115.161888:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990139e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:365dae28-8203-4526-83a5-01baf5c55d8b+92:2348:x1874704171948800:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 33us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858115.161894:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 719 00000100:00100000:1.0:1787858115.161907:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 720 00000100:00100000:1.0:1787858115.161913:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2347:x1874704171949184:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858115.161936:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2347:x1874704171949184:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858115.161942:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 720 00000100:00080000:1.0:1787858115.161963:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858115.161967:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787858115.161970:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787858115.162178:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171948672 00000100:00100000:2.0:1787858115.162183:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171948672 00000100:00100000:2.0:1787858115.162226:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 708 00000100:00100000:2.0:1787858115.162234:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171948672:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858115.162272:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2347:x1874704171948672:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858115.162279:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 708 00010000:00010000:1.0:1787858115.309979:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858115.820808:0:27864:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858115.820860:0:27864:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858115.821400:0:27864:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858115.821413:0:27864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787858116.334394:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858116.463216:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787858116.463244:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188355200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787858116.463326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858116.463444:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188355200 00000100:00100000:3.0:1787858116.463454:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188355200 00000100:00100000:3.0:1787858116.463525:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787858116.463535:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188355200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858116.463574:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858116.463649:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188355200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858116.463658:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787858116.463716:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188355200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787858116.464029:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787858117.359891:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858117.999578:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188355584:0@lo:400:kworker.0 00000100:00100000:1.0:1787858117.999850:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188355456:0@lo:400:kworker.0 00000100:00100000:3.0:1787858117.999926:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188355712:0@lo:400:kworker.0 00000100:00100000:0.0:1787858118.000016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858118.000141:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188355328:0@lo:400:kworker.0 00000100:00100000:1.0:1787858118.004847:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188355584 00000100:00100000:1.0:1787858118.004876:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188355584 00000100:00100000:1.0:1787858118.005090:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1787858118.005110:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188355584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858118.005433:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874704188355584:12345-0@lo:400:kworker.0 Request processed in 330us (5416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858118.005443:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00080000:1.0:1787858118.005485:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858118.006377:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858118.006649:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188355712 00000100:00100000:1.0:1787858118.006663:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188355712 00000100:00100000:1.0:1787858118.006745:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1787858118.006754:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188355712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787858118.006847:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188355712:12345-0@lo:400:kworker.0 Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858118.006855:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1787858118.006917:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188355712:0@lo:400:kworker.0 00000100:00080000:3.0:1787858118.006937:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858118.013505:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874704188355584:0@lo:400:kworker.0 00000100:00100000:3.0:1787858118.013645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858118.013715:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188355968:0@lo:400:kworker.0 00000100:00100000:3.0:1787858118.013802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858118.013881:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858118.013886:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188355968 00000100:00100000:3.0:1787858118.013899:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188355968 00000100:00100000:2.0:1787858118.013918:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c507e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188355840:0@lo:400:kworker.0 00000100:00100000:2.0:1787858118.013956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858118.013999:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188355456 00000100:00100000:2.0:1787858118.014004:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188355456 00000100:00100000:3.0:1787858118.014021:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1787858118.014036:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188355968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858118.014109:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188355968:12345-0@lo:400:kworker.0 Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858118.014118:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00080000:3.0:1787858118.014150:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787858118.014176:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188355968:0@lo:400:kworker.0 00000100:00100000:0.0:1787858118.014500:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188355840 00000100:00100000:0.0:1787858118.014507:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188355840 00000100:00080000:3.0:1787858118.014570:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858118.014583:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1787858118.014594:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c37d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188355456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787858118.014663:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c37d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188355456:12345-0@lo:400:kworker.0 Request processed in 71us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858118.014672:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1787858118.014732:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188355456:0@lo:400:kworker.0 00000100:00100000:0.0:1787858118.018286:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1787858118.018322:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188355840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858118.018470:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99990153de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188355840:12345-0@lo:400:kworker.0 Request processed in 169us (4513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858118.018478:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1787858118.022681:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188355328 00000100:00100000:0.0:1787858118.022706:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188355328 00000100:00100000:0.0:1787858118.022790:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1787858118.022801:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188355328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858118.022995:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188355328:12345-0@lo:400:kworker.0 Request processed in 194us (9114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858118.023004:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1787858118.023091:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188355328:0@lo:400:kworker.0 00000100:00100000:0.0:1787858118.023116:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c507e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188355840:0@lo:400:kworker.0 00010000:00010000:0.0:1787858118.387195:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787858118.403999:0:27916:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787858118.404016:0:27916:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787858118.404548:0:27916:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787858118.404562:0:27916:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787858118.510039:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188356096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787858118.510149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787858118.510339:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188356096 00000100:00100000:1.0:1787858118.510351:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188356096 00000100:00100000:1.0:1787858118.510427:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787858118.510441:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188356096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787858118.510496:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787858118.523629:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188356096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13176us (13464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858118.523631:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188356096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787858118.523651:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:1.0:1787858119.406081:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858120.275632:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858120.275676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858120.275705:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858120.275725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858120.275742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858120.275761:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858120.275782:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858120.275809:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171949824 00000100:00100000:3.0:1787858120.275811:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171949568 00000100:00100000:3.0:1787858120.275833:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171949568 00000100:00100000:1.0:1787858120.275833:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171949824 00000100:00100000:1.0:1787858120.275874:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171950336 00000100:00100000:1.0:1787858120.275877:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171950336 00000100:00100000:3.0:1787858120.275879:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 710 00000100:00100000:3.0:1787858120.275887:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171949568:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858120.275894:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171949952 00000100:00100000:1.0:1787858120.275897:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171949952 00000100:00100000:1.0:1787858120.275908:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171950208 00000100:00100000:1.0:1787858120.275910:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171950208 00000100:00100000:1.0:1787858120.275936:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 787 00000100:00100000:1.0:1787858120.275942:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171949824:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858120.275974:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2348:x1874704171949568:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 87us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858120.275981:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 710 00000100:00100000:3.0:1787858120.277578:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 788 00000100:00100000:3.0:1787858120.277611:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171950336:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858120.278797:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 789 00000100:00100000:0.0:1787858120.278844:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171949952:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858120.283973:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:365dae28-8203-4526-83a5-01baf5c55d8b+16:2348:x1874704171949824:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 8018us (8283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858120.284005:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 787 00000100:00100000:1.0:1787858120.284090:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 790 00000100:00100000:1.0:1787858120.284109:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171950208:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858120.284179:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2348:x1874704171950208:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 79us (8396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858120.284186:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 790 00000100:00100000:3.0:1787858120.286471:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2348:x1874704171950336:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 8862us (10727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858120.286488:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 788 00000100:00100000:3.0:1787858120.286546:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171950080 00000100:00100000:3.0:1787858120.286555:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171950080 00000100:00100000:3.0:1787858120.286628:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171949696 00000100:00100000:3.0:1787858120.286633:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171949696 00000100:00100000:3.0:1787858120.286668:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 724 00000100:00100000:3.0:1787858120.286677:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2348:x1874704171950080:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858120.286753:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2348:x1874704171950080:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 76us (11045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858120.286760:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 724 00000100:00100000:3.0:1787858120.286775:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 725 00000100:00100000:3.0:1787858120.286782:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:2348:x1874704171949696:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858120.286866:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:365dae28-8203-4526-83a5-01baf5c55d8b+92:2348:x1874704171949696:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 84us (11121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858120.286873:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 725 00000100:00080000:1.0:1787858120.288126:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787858120.288136:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787858120.288140:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787858120.288278:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2348:x1874704171949952:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 9460us (12507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858120.288291:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 789 00010000:00010000:3.0:1787858120.430148:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858120.716736:0:27967:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858120.716747:0:27967:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858120.720080:0:27967:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858120.720104:0:27967:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787858121.454458:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858121.584142:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787858121.584176:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188356224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787858121.584270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858121.585548:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188356224 00000100:00100000:3.0:1787858121.585560:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188356224 00000100:00100000:3.0:1787858121.585658:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00080000:1.0:1787858121.585917:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787858121.585986:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188356224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787858121.586035:0:6716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787858121.586145:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188356224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 476us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858121.586153:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787858121.586589:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188356224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787858122.478171:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787858123.116613:0:28018:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787858123.116627:0:28018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787858123.118506:0:28018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787858123.118537:0:28018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787858123.120292:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188356352:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.120598:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858123.120709:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188356864:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.120740:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858123.120774:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787858123.120780:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188356736:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.120809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858123.120860:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188356480:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.120898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858123.120918:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188356992:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.121017:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858123.121040:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787858123.121047:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188356608:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.121070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787858123.121114:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188356864 00000100:00100000:3.0:1787858123.121125:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188356864 00000100:00100000:3.0:1787858123.121190:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188356480 00000100:00100000:3.0:1787858123.121193:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188356480 00000100:00100000:3.0:1787858123.121211:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188356608 00000100:00100000:3.0:1787858123.121213:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188356608 00000100:00100000:3.0:1787858123.121234:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1787858123.121244:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188356864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.121300:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874704188356864:12345-0@lo:400:kworker.0 Request processed in 56us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858123.121310:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1787858123.121344:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1787858123.121350:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188356480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.121382:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901450f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874704188356480:12345-0@lo:400:kworker.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858123.121388:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1787858123.121400:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1787858123.121405:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188356608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.121429:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874704188356608:12345-0@lo:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858123.121434:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1787858123.121454:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188356736 00000100:00100000:3.0:1787858123.123120:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188356736 00000100:00100000:3.0:1787858123.123196:0:14028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188356992 00000100:00100000:3.0:1787858123.123200:0:14028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188356992 00000100:00100000:3.0:1787858123.123228:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1787858123.123239:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188356736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.123347:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901452940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874704188356736:12345-0@lo:400:kworker.0 Request processed in 110us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858123.123354:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1787858123.123369:0:14028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1787858123.123375:0:14028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188356992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.123403:0:14028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9999014503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874704188356992:12345-0@lo:400:kworker.0 Request processed in 29us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858123.123409:0:14028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00080000:3.0:1787858123.123449:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787858123.123452:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787858123.123455:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787858123.123515:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874704188356608:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.123533:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874704188356480:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.123544:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874704188356992:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.123588:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901451a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874704188356736:0@lo:400:kworker.0 00000100:00100000:3.0:1787858123.123602:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874704188356864:0@lo:400:kworker.0 00000100:00100000:0.0:1787858123.128432:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188356352 00000100:00100000:0.0:1787858123.129253:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188356352 00000100:00100000:0.0:1787858123.129344:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1787858123.129358:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188356352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787858123.131856:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19aa925-029c-4b3f-9a96-6d2fc52887f3+19:3303:x1874704188356352:12345-0@lo:400:kworker.0 Request processed in 2489us (11246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858123.131881:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1787858123.131911:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9997c37d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e19aa925-029c-4b3f-9a96-6d2fc52887f3:3303:1874704188356352:0@lo:400:kworker.0 00010000:00010000:1.0:1787858123.504452:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787858123.630515:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9999014530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188357120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787858123.630641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858123.630807:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188357120 00000100:00100000:2.0:1787858123.630871:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188357120 00000100:00100000:2.0:1787858123.630949:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787858123.630960:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188357120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787858123.631014:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787858123.631083:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c507f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874704188357120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858123.631091:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787858123.631602:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9999014530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874704188357120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787858124.526950:0:17404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787858124.974206:0:11703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787858124.974218:0:11703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787858124.974798:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787858124.974811:0:11703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787858125.393251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858125.393441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858125.393483:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858125.393515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858125.393533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858125.393555:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858125.393586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1787858125.393625:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171950976 00000100:00100000:1.0:1787858125.393641:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171950976 00000100:00100000:1.0:1787858125.393728:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171950592 00000100:00100000:1.0:1787858125.393732:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171950592 00000100:00100000:1.0:1787858125.393775:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 729 00000100:00100000:1.0:1787858125.393788:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171950976:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858125.394050:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 730 00000100:00100000:0.0:1787858125.394063:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+92:2350:x1874704171950592:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1787858125.394155:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171950720 00000100:00100000:3.0:1787858125.394161:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171950720 00000100:00100000:3.0:1787858125.394199:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171951232 00000100:00100000:3.0:1787858125.394202:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171951232 00000100:00100000:3.0:1787858125.394223:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171950848 00000100:00100000:3.0:1787858125.394225:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171950848 00000100:00100000:3.0:1787858125.394239:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171951104 00000100:00100000:3.0:1787858125.394241:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171951104 00000100:00100000:3.0:1787858125.394257:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 793 00000100:00100000:3.0:1787858125.394264:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171950720:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1787858125.394327:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+36:2350:x1874704171950976:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 541us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858125.394337:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 729 00000100:00100000:1.0:1787858125.394376:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 794 00000100:00100000:1.0:1787858125.394384:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171951232:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1787858125.394550:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704171950464 00000100:00100000:2.0:1787858125.394556:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704171950464 00000100:00100000:2.0:1787858125.394592:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 712 00000100:00100000:2.0:1787858125.394600:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171950464:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858125.394680:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999901250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:365dae28-8203-4526-83a5-01baf5c55d8b+92:2350:x1874704171950592:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 620us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858125.394690:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 730 00000100:00100000:0.0:1787858125.394717:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 795 00000100:00100000:0.0:1787858125.394725:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171950848:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858125.394771:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:365dae28-8203-4526-83a5-01baf5c55d8b+19:2350:x1874704171950848:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 47us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858125.394778:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 795 00000100:00100000:0.0:1787858125.394794:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 796 00000100:00100000:0.0:1787858125.394800:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171951104:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1787858125.394858:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd883d04-1f86-4100-8fde-ccbf466b6b53+8:2350:x1874704171951104:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 58us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787858125.394865:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 796 00000100:00100000:3.0:1787858125.395058:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:365dae28-8203-4526-83a5-01baf5c55d8b+16:2350:x1874704171950720:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 793us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787858125.395066:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 793 00000100:00100000:1.0:1787858125.395208:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9997c1d41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd883d04-1f86-4100-8fde-ccbf466b6b53+11:2350:x1874704171951232:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 823us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787858125.395217:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 794 00000100:00080000:1.0:1787858125.395240:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787858125.395246:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787858125.395249:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787858125.410447:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9998c6e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a844d87e-58d2-455f-ad2c-5bf80fe2767e+13:2350:x1874704171950464:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 6148us (7508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858125.410472:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 712 00010000:00010000:2.0:1787858125.552500:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787858126.058422:0:28069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12u: @@@@@@ FAIL: request on 0x200000402:0x37:0x0 is not SUCCEED on mds1 00010000:00010000:0.0:1787858126.574549:0:7647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787858126.702410:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188357248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787858126.702547:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787858126.702913:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874704188357248 00000100:00100000:2.0:1787858126.702923:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874704188357248 00000100:00100000:2.0:1787858126.703024:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787858126.703039:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188357248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787858126.703115:0:6715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787858126.703209:0:5852:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787858126.708205:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff999900d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874704188357248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5153us (5642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787858126.708227:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787858126.715488:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff999901450b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874704188357248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787858127.601175:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 68973 lines, 68973 kept, 0 dropped, 0 bad.